mirror of
https://github.com/open-webui/open-webui.git
synced 2026-05-06 10:58:17 -05:00
Title Auto-Generation Doesn’t Respect Custom Context Length #812
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @isr431 on GitHub (May 5, 2024).
Bug Report
Description
Bug Summary:
When a custom context length is set, it isn't respected by title auto-generation. As a result, the model is being re-loaded entirely with the default context when generating a title, adding unnecessary delay.
Steps to Reproduce:
Select 'Settings' > 'General' > 'Advanced Parameters' and set 'Context Length' to any value other than the default of 2048. Turn on title auto-generation.
Expected Behavior:
Title auto-generation should respect the custom context length, removing the need to reload the model.
Actual Behavior:
Title auto-generation did not respect the custom context length, causing the model to be reloaded with the default context of 2048.
Environment
Open WebUI Version: v0.1.123
Ollama (if applicable): 0.1.33
Operating System: Windows 11
Browser (if applicable): Chrome Version 124.0.6367.119
Reproduction Details
Confirmation:
Installation Method
Open WebUI was installed using Docker.
Additional Information
Was able to confirm issue by checking Ollama server logs.
@tjbck commented on GitHub (May 7, 2024):
Should be fixed on our dev branch! Let us know if the issue persists!