you are unable to use the slider in the context length slider to set any meaningful context length, you have to manually enter a number.
as the middle is already 5 million context. something sensible would be that the max is 128k.
another option: the max context length changes on the model you are using:
gemini: 1m
chatgpt: 128k
llama: 128k
qwen: 128k
etc.
if you manually click into it you would be able to change it to higher than that.
Originally created by @Eve-146T on GitHub (Dec 10, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/7743
you are unable to use the slider in the context length slider to set any meaningful context length, you have to manually enter a number.
as the middle is already 5 million context. something sensible would be that the max is 128k.
another option: the max context length changes on the model you are using:
gemini: 1m
chatgpt: 128k
llama: 128k
qwen: 128k
etc.
if you manually click into it you would be able to change it to higher than that.
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Originally created by @Eve-146T on GitHub (Dec 10, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/7743
you are unable to use the slider in the context length slider to set any meaningful context length, you have to manually enter a number.
as the middle is already 5 million context. something sensible would be that the max is 128k.
another option: the max context length changes on the model you are using:
gemini: 1m
chatgpt: 128k
llama: 128k
qwen: 128k
etc.
if you manually click into it you would be able to change it to higher than that.