ollama increasing the context window

Post Reply
User avatar
Antonio Linares
Site Admin
Posts: 42574
Joined: Thu Oct 06, 2005 5:47 pm
Location: Spain
Has thanked: 36 times
Been thanked: 84 times
Contact:

ollama increasing the context window

Post by Antonio Linares »

Ollama defaults to 2k context window. To increase it:

ollama run deepseek-r1:32b
/set parameter num_ctx 8192
/save deepseek-r1:32b-8k
ollama serve
regards, saludos

Antonio Linares
www.fivetechsoft.com
User avatar
Antonio Linares
Site Admin
Posts: 42574
Joined: Thu Oct 06, 2005 5:47 pm
Location: Spain
Has thanked: 36 times
Been thanked: 84 times
Contact:

Re: ollama increasing the context window

Post by Antonio Linares »

Access this from your web browser to check if Ollama server is running:

localhost:11434

and you will get:

"Ollama is running"
regards, saludos

Antonio Linares
www.fivetechsoft.com
User avatar
Antonio Linares
Site Admin
Posts: 42574
Joined: Thu Oct 06, 2005 5:47 pm
Location: Spain
Has thanked: 36 times
Been thanked: 84 times
Contact:

Re: ollama increasing the context window

Post by Antonio Linares »

on Mac need to run this command:

launchctl setenv OLLAMA_HOST "0.0.0.0"

and restart the ollama

Our good friend Lailton is testing from his Mac M1 Pro :D
regards, saludos

Antonio Linares
www.fivetechsoft.com
Post Reply