mirror of
https://github.com/open-webui/open-webui.git
synced 2026-05-07 03:18:23 -05:00
Increasing num_keep/num_predict causes multiple <thinking> tabs #3520
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @Babyhamsta on GitHub (Jan 31, 2025).
Bug Report
Installation Method
Pip install (v0.5.7)
Environment
Open WebUI Version: 0.5.7
Ollama (if applicable): 0.5.7
Operating System: Windows 10
Browser (if applicable): Ungoogled Chromium (https://github.com/ungoogled-software/ungoogled-chromium)
Confirmation:
Expected Behavior:
Thinking tab should only be created once and should update multiple times with new data/information.
Actual Behavior:
The thinking tab was created for each step I believe.
Description
Bug Summary:
When asking R1 for some assistance with a bug I was having with C# code. I wanted a larger context length and potential response so I increased the 2 settings num_keep/num_predict. After doing so the AI/UI proceeded to bug out and create many many many thinking tabs. It ran for quite a long time and I didn't allow it finish it's response as it ran longer than 10 minutes.
Reproduction Details
Steps to Reproduce:
Increase num_keep/num_predict:
Num_keep: 1002776
Num_predict: 20000
My exact prompt:
Logs and Screenshots
Browser Console Logs:
Docker Container Logs:
[Include relevant Docker container logs, if applicable]
Screenshots/Screen Recordings (if applicable):
Additional Information
Like I said that is about it, just increased those two params, maybe they were a bit extreme but I'm not really sure.
Note
If the bug report is incomplete or does not follow the provided instructions, it may not be addressed. Please ensure that you have followed the steps outlined in the README.md and troubleshooting.md documents, and provide all necessary information for us to reproduce and address the issue. Thank you!
@Babyhamsta commented on GitHub (Jan 31, 2025):
Actually I see that I was increasing the wrong ones, should of done Context and num_predict vs keep. But I still wonder why it recreates the think each time.