Page 1 of 1
ollama increasing the context window
Posted: Fri Jan 31, 2025 6:20 am
by Antonio Linares
Ollama defaults to 2k context window. To increase it:
ollama run deepseek-r1:32b
/set parameter num_ctx 8192
/save deepseek-r1:32b-8k
ollama serve
Re: ollama increasing the context window
Posted: Sat Feb 01, 2025 11:02 am
by Antonio Linares
Access this from your web browser to check if Ollama server is running:
localhost:11434
and you will get:
"Ollama is running"
Re: ollama increasing the context window
Posted: Sat Feb 01, 2025 11:09 am
by Antonio Linares
on Mac need to run this command:
launchctl setenv OLLAMA_HOST "0.0.0.0"
and restart the ollama
Our good friend Lailton is testing from his Mac M1 Pro
