[GH-ISSUE #18058] issue: handle thinking for Qwen3-VL models #34005

New Issue

GiteaMirror · 2026-04-25T07:53:58-05:00

GiteaMirror commented

2026-04-25 07:53:58 -05:00

Originally created by @SlavikCA on GitHub (Oct 5, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/18058

Check Existing Issues

I have searched for any existing and/or related issues.
I have searched for any existing and/or related discussions.
I am using the latest version of Open WebUI.

Installation Method

Docker

Open WebUI Version

0.6.32

Ollama Version (if applicable)

vllm 0.11.0

Operating System

Ubuntu 24

Browser (if applicable)

Brave

Confirmation

I have read and followed all instructions in README.md.
I am using the latest version of both Open WebUI and Ollama.
I have included the browser console logs.
I have included the Docker container logs.
I have provided every relevant configuration, setting, and environment variable used in my setup.
I have clearly listed every relevant configuration, custom setting, environment variable, and command-line option that influences my setup (such as Docker Compose overrides, .env values, browser settings, authentication configurations, etc).
I have documented step-by-step reproduction instructions that are precise, sequential, and leave nothing to interpretation. My steps:
Start with the initial platform/version/OS and dependencies used,
Specify exact install/launch/configure commands,
List URLs visited, user input (incl. example values/emails/passwords if needed),
Describe all options and toggles enabled or changed,
Include any files or environmental changes,
Identify the expected and actual result at each stage,
Ensure any reasonably skilled user can follow and hit the same issue.

Expected Behavior

"Reasoning" or "Thinking" part of the response printed to collapsed THINKING element.

Actual Behavior

"Reasoning" or "Thinking" part of the response printed to ANSWER element.

Steps to Reproduce

I'm running Qwen/Qwen3-VL-30B-A3B-Thinking-FP8
vllm 0.11.0
added that model in "ADMIN SETTINGS" -> "CONNECTIONS" -> "Open API Connection" -> http://192.168.0.242:36000/v1
submitted the query

Logs & Screenshots

Additional info

curl 'http://192.168.0.242:36000/v1/chat/completions' \
 -H 'Content-Type: application/json' \
 -d '{
    "messages": [
        {
        "role": "user",
        "content": "What is sun?"
        }
    ]
}' | jq

{
  "id": "chatcmpl-2e26f06248e14986aabaf55effa7cd6d",
  "object": "chat.completion",
  "created": 1759623929,
  "model": "qwen3vl-30b",
  "choices": [
    {
      "index": 0,
      "message": {
        "role": "assistant",
        "content": "Okay, the user asked, \"What is sun?\" Hmm, this seems like a very basic question, but I need to be careful not to assume too much. Maybe they're a young student just starting to learn about astronomy, or perhaps someone from a different cultural background where the concept isn't common. Or could it be a non-native English speaker? The phrasing is simple, almost like a child's question.\n\nFirst, I should confirm what they're really asking. \"Sun\" can refer to the star itself, the concept in mythology, or even the light source in a room. But given the capitalization (\"sun\" isn't usually capitalized unless it's part of a name), it's likely about the star. Still, I should cover all bases briefly.\n\nI recall that the Sun is a star, but how to explain it simply? Need to avoid jargon. Maybe start with the most common understanding: the bright object in our sky that gives us light and heat. Then explain it's a star, like others but close to Earth. Should mention it's made of gas, mostly hydrogen and helium, and that nuclear fusion happens in its core. \n\nWait, the user might not know what fusion is. Should I explain it? Maybe briefly—like how atoms smash together and release energy. But keep it simple: \"burns hydrogen to make energy.\" Also important to note it's not a planet; some people confuse it with Earth's moon. \n\nOh, and the Sun's role in the solar system! It's the center, gravity holds everything together. Plants need it for photosynthesis—that connects to why it matters to daily life. Maybe add how it's essential for life on Earth. \n\nShould I address why it's yellow? Sometimes people think it's yellow, but it's actually white. The atmosphere makes it look yellow. But maybe that's too much detail for a basic question. Unless the user is curious about color. \n\nAlso, cultural aspects? Like how different cultures have sun myths. But the question seems scientific. Still, a brief note could be useful, but only if it's relevant. The main answer should be factual. \n\nCheck if there are common misconceptions. For example, some think the Sun is solid, but it's a plasma ball. Or that it's the largest star—no, there are bigger ones. But since it's the closest, it appears large. \n\nThe user might want to know about safety too—like why you shouldn't look at the Sun. But the question is \"what is,\" not \"how to handle.\" Maybe stick to definition unless asked. \n\nStructure: Start with a simple definition, then break down key points—star, composition, energy, role in solar system, importance to Earth. Keep paragraphs short. End with why it's significant. \n\nWait, the user didn't specify depth. Since it's a basic question, keep it concise but cover essentials. Avoid overwhelming. Use analogies: \"like a giant nuclear furnace.\" \n\nAlso, note that the Sun is one of many stars. People might not realize it's not special in the universe, just close. But emphasize its importance to us. \n\nDouble-check facts: Hydrogen to helium fusion, core temperature 15 million °C, surface 5,500 °C. Correct. Solar system is held by gravity. Yes. \n\nShould I mention solar flares or sunspots? Maybe not unless asked. Stick to basics. \n\nFinal thought: The answer should be clear, friendly, and accurate without being technical. Make sure it's accessible to all ages. If the user needs more, they can ask follow-ups.\n</think>\n\nThe **Sun** is the **star** at the center of our **Solar System**. Here's a clear, concise explanation:\n\n### Key Facts:\n1. **What it is**:  \n   - A **giant ball of hot, glowing gas** (mostly hydrogen and helium, about 92% hydrogen, 7% helium, and 1% other elements).  \n   - Not a planet or a rock—it’s a **star**, meaning it generates energy through **nuclear fusion** in its core.  \n\n2. **How it works**:  \n   - At its core, extreme pressure and temperature (about **15 million °C**) force hydrogen atoms to fuse into helium.  \n   - This process releases **vast energy** (light and heat) via **nuclear fusion**, which radiates outward and powers the Sun.  \n\n3. **Why it matters**:  \n   - **Source of light and heat**: Provides energy for life on Earth (e.g., photosynthesis for plants, warmth for ecosystems).  \n   - **Gravitational anchor**: Holds the Solar System together—Earth and all other planets orbit around it due to its gravity.  \n   - **Drives weather and climate**: Solar energy powers Earth’s weather systems and ocean currents.  \n\n4. **Size and distance**:  \n   - **Diameter**: ~1.4 million km (109 times wider than Earth).  \n   - **Distance from Earth**: ~150 million km (93 million miles)—about 8 light-minutes away.  \n   - **Mass**: 333,000 times Earth’s mass (it contains 99.86% of all Solar System mass!).  \n\n5. **Appearance**:  \n   - Looks **yellow-white** from space (but appears yellow from Earth due to atmospheric scattering).  \n   - Surface temperature: **~5,500°C** (10,000°F).  \n   - Has visible features like **sunspots** (cooler, dark regions) and **solar flares** (explosions of energy).  \n\n### Fun Comparisons:\n- If the Sun were a **marble**, Earth would be a **grain of sand** 150 meters away.  \n- It’s **not the largest star**—some stars are millions of times bigger—but it’s the **closest star to Earth**.  \n- The Sun’s energy reaches us in **8 minutes** as sunlight.  \n\n### Why It’s Important for Life:\nWithout the Sun, Earth would be **freezing cold** and lifeless. It’s the reason plants grow, water cycles, and humans can survive.  \n\n### Note:  \n- In mythology, the Sun is often personified (e.g., Greek *Helios*, Egyptian *Ra*), but scientifically, it’s a **main-sequence star**—like billions of others in the Milky Way.  \n- **Never look directly at the Sun**—it can cause permanent eye damage!  \n\nIn short: **The Sun is our local star—Earth’s life-sustaining powerhouse and the gravitational heart of the Solar System.** 🌞",
        "refusal": null,
        "annotations": null,
        "audio": null,
        "function_call": null,
        "tool_calls": [],
        "reasoning_content": null
      },
      "logprobs": null,
      "finish_reason": "stop",
      "stop_reason": null,
      "token_ids": null
    }
  ],
  "service_tier": null,
  "system_fingerprint": null,
  "usage": {
    "prompt_tokens": 14,
    "total_tokens": 1415,
    "completion_tokens": 1401,
    "prompt_tokens_details": null
  },
  "prompt_logprobs": null,
  "prompt_token_ids": null,
  "kv_transfer_params": null
}

Is it possible to configure OpenWebUI to somehow "assume" that the reply is always starts as ?

Originally created by @SlavikCA on GitHub (Oct 5, 2025). Original GitHub issue: https://github.com/open-webui/open-webui/issues/18058 ### Check Existing Issues - [x] I have searched for any existing and/or related issues. - [x] I have searched for any existing and/or related discussions. - [x] I am using the latest version of Open WebUI. ### Installation Method Docker ### Open WebUI Version 0.6.32 ### Ollama Version (if applicable) vllm 0.11.0 ### Operating System Ubuntu 24 ### Browser (if applicable) Brave ### Confirmation - [x] I have read and followed all instructions in `README.md`. - [x] I am using the latest version of **both** Open WebUI and Ollama. - [x] I have included the browser console logs. - [x] I have included the Docker container logs. - [x] I have **provided every relevant configuration, setting, and environment variable used in my setup.** - [x] I have clearly **listed every relevant configuration, custom setting, environment variable, and command-line option that influences my setup** (such as Docker Compose overrides, .env values, browser settings, authentication configurations, etc). - [x] I have documented **step-by-step reproduction instructions that are precise, sequential, and leave nothing to interpretation**. My steps: - Start with the initial platform/version/OS and dependencies used, - Specify exact install/launch/configure commands, - List URLs visited, user input (incl. example values/emails/passwords if needed), - Describe all options and toggles enabled or changed, - Include any files or environmental changes, - Identify the expected and actual result at each stage, - Ensure any reasonably skilled user can follow and hit the same issue. ### Expected Behavior "Reasoning" or "Thinking" part of the response printed to collapsed THINKING element. ### Actual Behavior "Reasoning" or "Thinking" part of the response printed to ANSWER element. ### Steps to Reproduce - I'm running Qwen/Qwen3-VL-30B-A3B-Thinking-FP8 - vllm 0.11.0 - added that model in "ADMIN SETTINGS" -> "CONNECTIONS" -> "Open API Connection" -> http://192.168.0.242:36000/v1 - submitted the query ### Logs & Screenshots <img width="988" height="1436" alt="Image" src="https://github.com/user-attachments/assets/45c3fb1d-90db-4047-a033-9129f984322a" /> ##### Additional info ``` curl 'http://192.168.0.242:36000/v1/chat/completions' \ -H 'Content-Type: application/json' \ -d '{ "messages": [ { "role": "user", "content": "What is sun?" } ] }' | jq { "id": "chatcmpl-2e26f06248e14986aabaf55effa7cd6d", "object": "chat.completion", "created": 1759623929, "model": "qwen3vl-30b", "choices": [ { "index": 0, "message": { "role": "assistant", "content": "Okay, the user asked, \"What is sun?\" Hmm, this seems like a very basic question, but I need to be careful not to assume too much. Maybe they're a young student just starting to learn about astronomy, or perhaps someone from a different cultural background where the concept isn't common. Or could it be a non-native English speaker? The phrasing is simple, almost like a child's question.\n\nFirst, I should confirm what they're really asking. \"Sun\" can refer to the star itself, the concept in mythology, or even the light source in a room. But given the capitalization (\"sun\" isn't usually capitalized unless it's part of a name), it's likely about the star. Still, I should cover all bases briefly.\n\nI recall that the Sun is a star, but how to explain it simply? Need to avoid jargon. Maybe start with the most common understanding: the bright object in our sky that gives us light and heat. Then explain it's a star, like others but close to Earth. Should mention it's made of gas, mostly hydrogen and helium, and that nuclear fusion happens in its core. \n\nWait, the user might not know what fusion is. Should I explain it? Maybe briefly—like how atoms smash together and release energy. But keep it simple: \"burns hydrogen to make energy.\" Also important to note it's not a planet; some people confuse it with Earth's moon. \n\nOh, and the Sun's role in the solar system! It's the center, gravity holds everything together. Plants need it for photosynthesis—that connects to why it matters to daily life. Maybe add how it's essential for life on Earth. \n\nShould I address why it's yellow? Sometimes people think it's yellow, but it's actually white. The atmosphere makes it look yellow. But maybe that's too much detail for a basic question. Unless the user is curious about color. \n\nAlso, cultural aspects? Like how different cultures have sun myths. But the question seems scientific. Still, a brief note could be useful, but only if it's relevant. The main answer should be factual. \n\nCheck if there are common misconceptions. For example, some think the Sun is solid, but it's a plasma ball. Or that it's the largest star—no, there are bigger ones. But since it's the closest, it appears large. \n\nThe user might want to know about safety too—like why you shouldn't look at the Sun. But the question is \"what is,\" not \"how to handle.\" Maybe stick to definition unless asked. \n\nStructure: Start with a simple definition, then break down key points—star, composition, energy, role in solar system, importance to Earth. Keep paragraphs short. End with why it's significant. \n\nWait, the user didn't specify depth. Since it's a basic question, keep it concise but cover essentials. Avoid overwhelming. Use analogies: \"like a giant nuclear furnace.\" \n\nAlso, note that the Sun is one of many stars. People might not realize it's not special in the universe, just close. But emphasize its importance to us. \n\nDouble-check facts: Hydrogen to helium fusion, core temperature 15 million °C, surface 5,500 °C. Correct. Solar system is held by gravity. Yes. \n\nShould I mention solar flares or sunspots? Maybe not unless asked. Stick to basics. \n\nFinal thought: The answer should be clear, friendly, and accurate without being technical. Make sure it's accessible to all ages. If the user needs more, they can ask follow-ups.\n</think>\n\nThe **Sun** is the **star** at the center of our **Solar System**. Here's a clear, concise explanation:\n\n### Key Facts:\n1. **What it is**: \n - A **giant ball of hot, glowing gas** (mostly hydrogen and helium, about 92% hydrogen, 7% helium, and 1% other elements). \n - Not a planet or a rock—it’s a **star**, meaning it generates energy through **nuclear fusion** in its core. \n\n2. **How it works**: \n - At its core, extreme pressure and temperature (about **15 million °C**) force hydrogen atoms to fuse into helium. \n - This process releases **vast energy** (light and heat) via **nuclear fusion**, which radiates outward and powers the Sun. \n\n3. **Why it matters**: \n - **Source of light and heat**: Provides energy for life on Earth (e.g., photosynthesis for plants, warmth for ecosystems). \n - **Gravitational anchor**: Holds the Solar System together—Earth and all other planets orbit around it due to its gravity. \n - **Drives weather and climate**: Solar energy powers Earth’s weather systems and ocean currents. \n\n4. **Size and distance**: \n - **Diameter**: ~1.4 million km (109 times wider than Earth). \n - **Distance from Earth**: ~150 million km (93 million miles)—about 8 light-minutes away. \n - **Mass**: 333,000 times Earth’s mass (it contains 99.86% of all Solar System mass!). \n\n5. **Appearance**: \n - Looks **yellow-white** from space (but appears yellow from Earth due to atmospheric scattering). \n - Surface temperature: **~5,500°C** (10,000°F). \n - Has visible features like **sunspots** (cooler, dark regions) and **solar flares** (explosions of energy). \n\n### Fun Comparisons:\n- If the Sun were a **marble**, Earth would be a **grain of sand** 150 meters away. \n- It’s **not the largest star**—some stars are millions of times bigger—but it’s the **closest star to Earth**. \n- The Sun’s energy reaches us in **8 minutes** as sunlight. \n\n### Why It’s Important for Life:\nWithout the Sun, Earth would be **freezing cold** and lifeless. It’s the reason plants grow, water cycles, and humans can survive. \n\n### Note: \n- In mythology, the Sun is often personified (e.g., Greek *Helios*, Egyptian *Ra*), but scientifically, it’s a **main-sequence star**—like billions of others in the Milky Way. \n- **Never look directly at the Sun**—it can cause permanent eye damage! \n\nIn short: **The Sun is our local star—Earth’s life-sustaining powerhouse and the gravitational heart of the Solar System.** 🌞", "refusal": null, "annotations": null, "audio": null, "function_call": null, "tool_calls": [], "reasoning_content": null }, "logprobs": null, "finish_reason": "stop", "stop_reason": null, "token_ids": null } ], "service_tier": null, "system_fingerprint": null, "usage": { "prompt_tokens": 14, "total_tokens": 1415, "completion_tokens": 1401, "prompt_tokens_details": null }, "prompt_logprobs": null, "prompt_token_ids": null, "kv_transfer_params": null } ``` Is it possible to configure OpenWebUI to somehow "assume" that the reply is always starts as <think>?

GiteaMirror added the bug label 2026-04-25 07:53:58 -05:00

GiteaMirror closed this issue

2026-04-25 07:54:00 -05:00

GiteaMirror commented

2026-04-25 07:54:00 -05:00

@SlavikCA commented on GitHub (Oct 5, 2025):

Looks like this is the solution:

https://github.com/vllm-project/vllm/issues/26239

@SlavikCA commented on GitHub (Oct 5, 2025): Looks like this is the solution: https://github.com/vllm-project/vllm/issues/26239

GiteaMirror commented

2026-04-25 07:54:01 -05:00

@pkeffect commented on GitHub (Oct 5, 2025):

You could always write a custom filter function to handle the thinking tags detection also.

@pkeffect commented on GitHub (Oct 5, 2025): You could always write a custom filter function to handle the thinking tags detection also.

Sign in to join this conversation.

Branches Tags

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: github-starred/open-webui#34005