Temperature: the max is 1. I would like to use 1.8 sometimes.
Context lenght: The max is 10240000 (10240k) This is way too much! is there any model that come close to this?
Batch Size (num_batch): the lowest it go is 256. I tried 128 with Silly tavern, and it uses a little less vram with no difference in quality...
Is there a way to turn these ranges configurable?
Originally created by @luisbrandao on GitHub (Feb 18, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/10266
Hello,
i'm unhappy with ranges on the advanced param.
For example.
* **Temperature**: the max is 1. I would like to use 1.8 sometimes.
* **Context lenght**: The max is 10240000 (10240k) This is way too much! is there any model that come close to this?
* **Batch Size (num_batch)**: the lowest it go is 256. I tried 128 with Silly tavern, and it uses a little less vram with no difference in quality...
Is there a way to turn these ranges configurable?
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Originally created by @luisbrandao on GitHub (Feb 18, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/10266
Hello,
i'm unhappy with ranges on the advanced param.
For example.
Is there a way to turn these ranges configurable?