github-starred/open-webui
2
0
Fork 0
mirror of https://github.com/open-webui/open-webui.git synced 2026-08-26 21:54:50 -05:00
Code Issues 2.4k Packages Projects Releases 129 Wiki Activity

issue: Cannot correctly handle the think tag of qwq model #4280

New Issue
Closed
opened 2025-11-11 15:50:18 -06:00 by GiteaMirror · 8 comments
GiteaMirror commented 2025-11-11 15:50:18 -06:00
Owner
Copy Link
Copy Source

Originally created by @qhjqhj on GitHub (Mar 6, 2025).

Check Existing Issues

  • I have searched the existing issues and discussions.

Installation Method

Git Clone

Open WebUI Version

0.5.20

Ollama Version (if applicable)

0.5.13

Operating System

windows 11

Browser (if applicable)

No response

Confirmation

  • I have read and followed all instructions in README.md.
  • I am using the latest version of both Open WebUI and Ollama.
  • I have checked the browser console logs.
  • I have checked the Docker container logs.
  • I have listed steps to reproduce the bug in detail.

Expected Behavior

Separate thinking from formal output

Actual Behavior

The content of thinking and the content of formal output cannot be distinguished, and the formal content cannot be output

Steps to Reproduce

  1. run ollama serve
  2. run open-webui serve
  3. Open the browser and select the qwq model
  4. Ask a code-related question, such as "Write the code for the Viterbi algorithm using Python"
    When running the qwq:latest model of Ollama on the backend, the content in the tag is output as normal content, and part of the code output seems to be lost

Logs & Screenshots

Image
Image

Additional Information

No response

Originally created by @qhjqhj on GitHub (Mar 6, 2025). ### Check Existing Issues - [x] I have searched the existing issues and discussions. ### Installation Method Git Clone ### Open WebUI Version 0.5.20 ### Ollama Version (if applicable) 0.5.13 ### Operating System windows 11 ### Browser (if applicable) _No response_ ### Confirmation - [x] I have read and followed all instructions in `README.md`. - [x] I am using the latest version of **both** Open WebUI and Ollama. - [x] I have checked the browser console logs. - [x] I have checked the Docker container logs. - [x] I have listed steps to reproduce the bug in detail. ### Expected Behavior Separate thinking from formal output ### Actual Behavior The content of thinking and the content of formal output cannot be distinguished, and the formal content cannot be output ### Steps to Reproduce 1. run ollama serve 2. run open-webui serve 3. Open the browser and select the qwq model 4. Ask a code-related question, such as "Write the code for the Viterbi algorithm using Python" When running the qwq:latest model of Ollama on the backend, the content in the <think> tag is output as normal content, and part of the code output seems to be lost ### Logs & Screenshots ![Image](https://github.com/user-attachments/assets/1a074a36-554e-4737-8d0f-f2dcbddfff82) ![Image](https://github.com/user-attachments/assets/81fe239d-ad85-4ba4-931c-4d4cdc8d2ee6) ### Additional Information _No response_
GiteaMirror added the bug label 2025-11-11 15:50:18 -06:00
GiteaMirror commented 2025-11-11 15:50:21 -06:00
Author
Owner
Copy Link
Copy Source

@Eidenz commented on GitHub (Mar 6, 2025):

Adding to this, it doesn't even seem to have its normal output in the thinking tag.

On my end, everything in the thinking tag seems to indeed be the thought process, but once it's done it outputs no answer, and openwebui acts as if the model was still thinking.

@Eidenz commented on GitHub (Mar 6, 2025): Adding to this, it doesn't even seem to have its normal output in the thinking tag. On my end, everything in the thinking tag seems to indeed be the thought process, but once it's done it outputs no answer, and openwebui acts as if the model was still thinking.
GiteaMirror commented 2025-11-11 15:50:22 -06:00
Author
Owner
Copy Link
Copy Source

@mihkhub commented on GitHub (Mar 6, 2025):

QwQ-32b thinking tag pair "

@mihkhub commented on GitHub (Mar 6, 2025): QwQ-32b thinking tag pair "<think> </think>
GiteaMirror commented 2025-11-11 15:50:24 -06:00
Author
Owner
Copy Link
Copy Source

@EntropyYue commented on GitHub (Mar 6, 2025):

It seems that the model's thinking output has been stopped before it has finished, please try increasing nun_ctx and num_predict

@EntropyYue commented on GitHub (Mar 6, 2025): It seems that the model's thinking output has been stopped before it has finished, please try increasing `nun_ctx` and `num_predict`
GiteaMirror commented 2025-11-11 15:50:26 -06:00
Author
Owner
Copy Link
Copy Source

@Duxon commented on GitHub (Mar 6, 2025):

How to increase num_ctx (to 131072) in the Open-WebUI settings? I can't find that seeting.

@Duxon commented on GitHub (Mar 6, 2025): How to increase `num_ctx` (to 131072) in the Open-WebUI settings? I can't find that seeting.
GiteaMirror commented 2025-11-11 15:50:28 -06:00
Author
Owner
Copy Link
Copy Source

@EntropyYue commented on GitHub (Mar 6, 2025):

If you are using en-US, it will display as Context Length

@EntropyYue commented on GitHub (Mar 6, 2025): If you are using en-US, it will display as `Context Length`
GiteaMirror commented 2025-11-11 15:50:30 -06:00
Author
Owner
Copy Link
Copy Source

@qhjqhj commented on GitHub (Mar 6, 2025):

It seems that the model's thinking output has been stopped before it has finished, please try increasing nun_ctx and num_predict

I tried it several times, and the total number of tokens generated was different. It seems that the issue is not caused by the maximum length limit.

@qhjqhj commented on GitHub (Mar 6, 2025): > It seems that the model's thinking output has been stopped before it has finished, please try increasing `nun_ctx` and `num_predict` I tried it several times, and the total number of tokens generated was different. It seems that the issue is not caused by the maximum length limit.
GiteaMirror commented 2025-11-11 15:50:30 -06:00
Author
Owner
Copy Link
Copy Source

@bjj commented on GitHub (Mar 6, 2025):

See #11259

@bjj commented on GitHub (Mar 6, 2025): See #11259
GiteaMirror commented 2025-11-11 15:50:31 -06:00
Author
Owner
Copy Link
Copy Source

@EntropyYue commented on GitHub (Mar 6, 2025):

Please provide screenshots of other situations, which will help us better solve the problem

@EntropyYue commented on GitHub (Mar 6, 2025): Please provide screenshots of other situations, which will help us better solve the problem
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
confirmed
confirmed issue
core
documentation
enhancement
good first issue
help wanted
non-core
pull-request
Mirrored from GitHub Pull Request
 python
question
testing wanted
No labels bug
Milestone
No items
No Milestone
Projects
Clear projects
No projects
Assignees
Clear assignees
GiteaMirror ninjasurge (Kaehlen Rog)
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#4280