[feature] Configurable range on Advanced Params #3946

Closed
opened 2025-11-11 15:43:02 -06:00 by GiteaMirror · 0 comments
Owner

Originally created by @luisbrandao on GitHub (Feb 18, 2025).

Hello,

i'm unhappy with ranges on the advanced param.

For example.

  • Temperature: the max is 1. I would like to use 1.8 sometimes.
  • Context lenght: The max is 10240000 (10240k) This is way too much! is there any model that come close to this?
  • Batch Size (num_batch): the lowest it go is 256. I tried 128 with Silly tavern, and it uses a little less vram with no difference in quality...

Is there a way to turn these ranges configurable?

Originally created by @luisbrandao on GitHub (Feb 18, 2025). Hello, i'm unhappy with ranges on the advanced param. For example. * **Temperature**: the max is 1. I would like to use 1.8 sometimes. * **Context lenght**: The max is 10240000 (10240k) This is way too much! is there any model that come close to this? * **Batch Size (num_batch)**: the lowest it go is 256. I tried 128 with Silly tavern, and it uses a little less vram with no difference in quality... Is there a way to turn these ranges configurable?
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#3946