How do I set default Advanced Parameters for new users? #2073
Kanishk-Kumar
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Description
If I set some advanced parameters for a model as an admin, shouldn't that be applied for new users? Even if I set those parameters like temperature, n_ctx at modelfile level, they're not loaded as default.
Is there a way to pass such parameters as environment variables? I can't find the code where defaults (for example temperature = 0.8) is set, can someone please point me to that? Thanks!
Edit: When parameters set at model file level, they do get loaded as default, regardless of what settings UI says.
Environment
Open WebUI Version: v0.1.123
Ollama (if applicable): 0.1.30
Operating System: Ubuntu 22.04.4 LTS
Browser (if applicable): Chrome 124.0.6367.156
Installation Method
Docker
Additional Information
I can't use latest Ollama because of an embedding issue. ollama/ollama#3777
Beta Was this translation helpful? Give feedback.
All reactions