EN
Sign in Publish
contextetech /

Mistral 7B on a 16 GB Mac with Ollama

v1
English License: MIT Published on updated 1 hour ago 0 uses

Ollama Modelfile to run Mistral 7B Instruct locally on a 16 GB Mac: Q4 quantization, 8k context, concise answers in English.

Modelmistral:7b-instruct-q4_K_M
Tested hardwareApple Silicon Mac with 16 GB of memory

Modelfile

FROM mistral:7b-instruct-q4_K_M
PARAMETER num_ctx 8192
PARAMETER temperature 0.3
SYSTEM """You are a helpful assistant. Answer in clear, concise English.
If you don't know, say so."""

Launch command

ollama create mistral-en -f Modelfile && ollama run mistral-en

Community

No comments yet. Share your feedback, it will help the next person.