Ollama defaults to 2k context window. To increase it:
ollama run deepseek-r1:32b
/set parameter num_ctx 8192
/save deepseek-r1:32b-8k
ollama serve
ollama increasing the context window
- Antonio Linares
- Site Admin
- Posts: 42574
- Joined: Thu Oct 06, 2005 5:47 pm
- Location: Spain
- Has thanked: 36 times
- Been thanked: 84 times
- Contact:
- Antonio Linares
- Site Admin
- Posts: 42574
- Joined: Thu Oct 06, 2005 5:47 pm
- Location: Spain
- Has thanked: 36 times
- Been thanked: 84 times
- Contact:
Re: ollama increasing the context window
Access this from your web browser to check if Ollama server is running:
localhost:11434
and you will get:
"Ollama is running"
localhost:11434
and you will get:
"Ollama is running"
- Antonio Linares
- Site Admin
- Posts: 42574
- Joined: Thu Oct 06, 2005 5:47 pm
- Location: Spain
- Has thanked: 36 times
- Been thanked: 84 times
- Contact:
Re: ollama increasing the context window
on Mac need to run this command:
launchctl setenv OLLAMA_HOST "0.0.0.0"
and restart the ollama
Our good friend Lailton is testing from his Mac M1 Pro
launchctl setenv OLLAMA_HOST "0.0.0.0"
and restart the ollama
Our good friend Lailton is testing from his Mac M1 Pro
