[PR #5645] [MERGED] [feat] Set whether to stream individually for the model #21726

New Issue

GiteaMirror · 2026-04-20T03:41:09-05:00

GiteaMirror commented

2026-04-20 03:41:09 -05:00

📋 Pull Request Information

Original PR: https://github.com/open-webui/open-webui/pull/5645
Author: @kivvi3412
Created: 9/24/2024
Status: ✅ Merged
Merged: 9/24/2024
Merged by: @tjbck

Base: dev ← Head: main

📝 Commits (10+)

bd81fc8 downgrade authlib to 1.3.1
5fe2795 Merge pull request #5556 from open-webui/dev
9b05fe3 Update pyproject.toml
79b5430 Merge pull request #5546 from itaybar/bugfix/downgrade_authlib
578d52b Merge pull request #5562 from open-webui/dev
ff8a2da Merge pull request #5565 from open-webui/dev
f47dffe Merge pull request #5576 from open-webui/dev
54d63ec Merge pull request #5583 from open-webui/dev
6b46316 Merge pull request #5584 from open-webui/dev
0d01ea5 Set whether to stream responses for this model individually, overriding the global setting

📊 Changes

4 files changed (+29 additions, -4 deletions)

View changed files

📝 src/lib/components/chat/Chat.svelte (+2 -2)
📝 src/lib/components/chat/Settings/Advanced/AdvancedParams.svelte (+25 -0)
📝 src/lib/i18n/locales/zh-CN/translation.json (+1 -1)
📝 src/lib/i18n/locales/zh-TW/translation.json (+1 -1)

📄 Description

Pull Request Checklist

Note to first-time contributors: Please open a discussion post in Discussions and describe your changes before submitting a pull request.

Before submitting, make sure you've checked the following:

Target branch: Please verify that the pull request targets the dev branch.
Description: Provide a concise description of the changes made in this pull request.
Changelog: Ensure a changelog entry following the format of Keep a Changelog is added at the bottom of the PR description.
Documentation: Have you updated relevant documentation Open WebUI Docs, or other documentation sources?
Dependencies: Are there any new dependencies? Have you updated the dependency versions in the documentation?
Testing: Have you written and run sufficient tests for validating the changes?
Code review: Have you performed a self-review of your code, addressing any coding standard issues and ensuring adherence to the project's coding standards?
Prefix: To cleary categorize this pull request, prefix the pull request title, using one of the following:
- BREAKING CHANGE: Significant changes that may affect compatibility
- build: Changes that affect the build system or external dependencies
- ci: Changes to our continuous integration processes or workflows
- chore: Refactor, cleanup, or other non-functional code changes
- docs: Documentation update or addition
- feat: Introduces a new feature or enhancement to the codebase
- fix: Bug fix or error correction
- i18n: Internationalization or localization changes
- perf: Performance improvement
- refactor: Code restructuring for better maintainability, readability, or scalability
- style: Changes that do not affect the meaning of the code (white-space, formatting, missing semi-colons, etc.)
- test: Adding missing tests or correcting existing tests
- WIP: Work in progress, a temporary label for incomplete or ongoing work

Changelog Entry

Description

The O1 model cannot use streaming. If I want O1 to respond correctly, I must turn off streaming in the global settings panel for it to work normally.
If streaming is turned off in the global settings panel, then all models will be unable to use streaming.
If you want to set streaming on or off for individual models, it is not possible in the current version. Therefore, I submitted this PR to allow setting streaming individually for each model.

Added

In the advanced settings of the model, stream_response has been added, which can be set to Default, On, and Off. The default setting is Default, using the global panel streaming settings.

Screenshots or Videos

After using the new code, the model can be individually set to enable or disable streaming.

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/open-webui/open-webui/pull/5645 **Author:** [@kivvi3412](https://github.com/kivvi3412) **Created:** 9/24/2024 **Status:** ✅ Merged **Merged:** 9/24/2024 **Merged by:** [@tjbck](https://github.com/tjbck) **Base:** `dev` ← **Head:** `main` --- ### 📝 Commits (10+) - [`bd81fc8`](https://github.com/open-webui/open-webui/commit/bd81fc8bffc27739920986f5bab1dd218e639d85) downgrade authlib to 1.3.1 - [`5fe2795`](https://github.com/open-webui/open-webui/commit/5fe2795db8d6659a3f6192ed70f8e2104506c22c) Merge pull request #5556 from open-webui/dev - [`9b05fe3`](https://github.com/open-webui/open-webui/commit/9b05fe3c54b1f0388b640b356ea49bcc30536694) Update pyproject.toml - [`79b5430`](https://github.com/open-webui/open-webui/commit/79b5430a9e729cb18d0123bd0319cffe0d3bad7b) Merge pull request #5546 from itaybar/bugfix/downgrade_authlib - [`578d52b`](https://github.com/open-webui/open-webui/commit/578d52b89ddbc549127bd7d5b9796835e0443580) Merge pull request #5562 from open-webui/dev - [`ff8a2da`](https://github.com/open-webui/open-webui/commit/ff8a2da751e4b64441909554965cd51c60f5332a) Merge pull request #5565 from open-webui/dev - [`f47dffe`](https://github.com/open-webui/open-webui/commit/f47dffe6e11c6fc63f2dc6029c4cb5e458d22fe7) Merge pull request #5576 from open-webui/dev - [`54d63ec`](https://github.com/open-webui/open-webui/commit/54d63ece6f85d96f8c079dd802c71be6a9518d3e) Merge pull request #5583 from open-webui/dev - [`6b46316`](https://github.com/open-webui/open-webui/commit/6b463164f4b129e0ce4bdc9008dd661214fe5eb5) Merge pull request #5584 from open-webui/dev - [`0d01ea5`](https://github.com/open-webui/open-webui/commit/0d01ea5f2fa3f5692ed94a88a7ab9b67a61bf62c) Set whether to stream responses for this model individually, overriding the global setting ### 📊 Changes **4 files changed** (+29 additions, -4 deletions) <details> <summary>View changed files</summary> 📝 `src/lib/components/chat/Chat.svelte` (+2 -2) 📝 `src/lib/components/chat/Settings/Advanced/AdvancedParams.svelte` (+25 -0) 📝 `src/lib/i18n/locales/zh-CN/translation.json` (+1 -1) 📝 `src/lib/i18n/locales/zh-TW/translation.json` (+1 -1) </details> ### 📄 Description # Pull Request Checklist ### Note to first-time contributors: Please open a discussion post in [Discussions](https://github.com/open-webui/open-webui/discussions) and describe your changes before submitting a pull request. **Before submitting, make sure you've checked the following:** - [x] **Target branch:** Please verify that the pull request targets the `dev` branch. - [x] **Description:** Provide a concise description of the changes made in this pull request. - [x] **Changelog:** Ensure a changelog entry following the format of [Keep a Changelog](https://keepachangelog.com/) is added at the bottom of the PR description. - [ ] **Documentation:** Have you updated relevant documentation [Open WebUI Docs](https://github.com/open-webui/docs), or other documentation sources? - [ ] **Dependencies:** Are there any new dependencies? Have you updated the dependency versions in the documentation? - [x] **Testing:** Have you written and run sufficient tests for validating the changes? - [x] **Code review:** Have you performed a self-review of your code, addressing any coding standard issues and ensuring adherence to the project's coding standards? - [x] **Prefix:** To cleary categorize this pull request, prefix the pull request title, using one of the following: - **BREAKING CHANGE**: Significant changes that may affect compatibility - **build**: Changes that affect the build system or external dependencies - **ci**: Changes to our continuous integration processes or workflows - **chore**: Refactor, cleanup, or other non-functional code changes - **docs**: Documentation update or addition - **feat**: Introduces a new feature or enhancement to the codebase - **fix**: Bug fix or error correction - **i18n**: Internationalization or localization changes - **perf**: Performance improvement - **refactor**: Code restructuring for better maintainability, readability, or scalability - **style**: Changes that do not affect the meaning of the code (white-space, formatting, missing semi-colons, etc.) - **test**: Adding missing tests or correcting existing tests - **WIP**: Work in progress, a temporary label for incomplete or ongoing work # Changelog Entry ### Description - The O1 model cannot use streaming. If I want O1 to respond correctly, I must turn off streaming in the global settings panel for it to work normally. - If streaming is turned off in the global settings panel, then all models will be unable to use streaming. - If you want to set streaming on or off for individual models, it is not possible in the current version. Therefore, I submitted this PR to allow setting streaming individually for each model. <img width="1433" alt="image" src="https://github.com/user-attachments/assets/38f1da3b-c6a0-4012-800f-6700c0fbf972"> <img width="741" alt="image" src="https://github.com/user-attachments/assets/a4988aa9-ab90-471e-9567-efbe238a351e"> ### Added - In the advanced settings of the model, stream_response has been added, which can be set to Default, On, and Off. The default setting is Default, using the global panel streaming settings. <img width="733" alt="image" src="https://github.com/user-attachments/assets/1cbc9e09-5d5b-4017-81e3-cc5527255185"> ### Screenshots or Videos - After using the new code, the model can be individually set to enable or disable streaming. <img width="937" alt="image" src="https://github.com/user-attachments/assets/c506c22e-3ad4-45f3-bd49-f9ffc8418a74"> <img width="939" alt="image" src="https://github.com/user-attachments/assets/58572fd5-0531-4f5f-85f8-03cddbeadd92"> --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

GiteaMirror added the pull-request label 2026-04-20 03:41:09 -05:00

GiteaMirror closed this issue

2026-04-20 03:41:11 -05:00

GiteaMirror referenced this issue

2026-04-25 09:17:04 -05:00

[GH-ISSUE #21726] issue: RAG duplication when view_knowledge_file tool is used #35083

GiteaMirror referenced this issue

2026-04-25 09:53:19 -05:00

[GH-ISSUE #24076] issue: RAG template: duplicate `{{CONTEXT}}` / `[context]` placeholders inject retrieved context multiple times without warning #35705

GiteaMirror referenced this issue

2026-05-05 22:35:54 -05:00

[GH-ISSUE #21726] issue: RAG duplication when view_knowledge_file tool is used #58220