You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
When I run Alpaca, the Ollama instance is under-utilizing my resources, resulting in slower outputs.
Describe the solution you'd like
A menu option under Preferences>General for setting the number of threads as an Ollama model parameter
Describe alternatives you've considered
Editing config files for the ollama model
Additional context
This would add a lot of convenience for people who want to configure how many cores the ollama instance can use, and it would be nice easily change this value for each model. I currently have a change implemented already, and I'm testing it now.
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem? Please describe.
When I run Alpaca, the Ollama instance is under-utilizing my resources, resulting in slower outputs.
Describe the solution you'd like
A menu option under Preferences>General for setting the number of threads as an Ollama model parameter
Describe alternatives you've considered
Editing config files for the ollama model
Additional context
This would add a lot of convenience for people who want to configure how many cores the ollama instance can use, and it would be nice easily change this value for each model. I currently have a change implemented already, and I'm testing it now.
The text was updated successfully, but these errors were encountered: