[GH-ISSUE #14398] issue: Using stream filter causes streaming to slow down #17236

New Issue

GiteaMirror · 2026-04-19T22:56:46-05:00

GiteaMirror commented

2026-04-19 22:56:46 -05:00

Originally created by @EntropyYue on GitHub (May 27, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/14398

Check Existing Issues

I have searched the existing issues and discussions.
I am using the latest version of Open WebUI.

Installation Method

Docker

Open WebUI Version

0.6.11

Ollama Version (if applicable)

No response

Operating System

Windows 10

Browser (if applicable)

No response

Confirmation

I have read and followed all instructions in README.md.
I am using the latest version of both Open WebUI and Ollama.
I have included the browser console logs.
I have included the Docker container logs.
I have provided every relevant configuration, setting, and environment variable used in my setup.
I have clearly listed every relevant configuration, custom setting, environment variable, and command-line option that influences my setup (such as Docker Compose overrides, .env values, browser settings, authentication configurations, etc).
I have documented step-by-step reproduction instructions that are precise, sequential, and leave nothing to interpretation. My steps:
Start with the initial platform/version/OS and dependencies used,
Specify exact install/launch/configure commands,
List URLs visited, user input (incl. example values/emails/passwords if needed),
Describe all options and toggles enabled or changed,
Include any files or environmental changes,
Identify the expected and actual result at each stage,
Ensure any reasonably skilled user can follow and hit the same issue.

Expected Behavior

In version 0.6.10, the stream filter operates at normal speed

Actual Behavior

In version 0.6.11, due to the stream filter, the streaming speed has slowed down

Steps to Reproduce

Create a simple stream filter

from pydantic import BaseModel, Field
from typing import Optional


class Filter:
    class Valves(BaseModel):
        priority: int = Field(
            default=0, description="Priority level for the filter operations."
        )

    def __init__(self):
        self.valves = self.Valves()
        pass

    def stream(self, event: dict) -> dict:
        for choice in event.get("choices", []):
            delta = choice.get("delta", {})
            if "content" in delta:
                delta["content"] = delta["content"].replace("😊", "")  # Strip emojis
        return event

Test the speed of streaming in versions 0.6.10 and 0.6.11 respectively

Logs & Screenshots

No error logs

Additional Information

No response

Originally created by @EntropyYue on GitHub (May 27, 2025). Original GitHub issue: https://github.com/open-webui/open-webui/issues/14398 ### Check Existing Issues - [x] I have searched the existing issues and discussions. - [x] I am using the latest version of Open WebUI. ### Installation Method Docker ### Open WebUI Version 0.6.11 ### Ollama Version (if applicable) _No response_ ### Operating System Windows 10 ### Browser (if applicable) _No response_ ### Confirmation - [x] I have read and followed all instructions in `README.md`. - [x] I am using the latest version of **both** Open WebUI and Ollama. - [x] I have included the browser console logs. - [x] I have included the Docker container logs. - [x] I have **provided every relevant configuration, setting, and environment variable used in my setup.** - [x] I have clearly **listed every relevant configuration, custom setting, environment variable, and command-line option that influences my setup** (such as Docker Compose overrides, .env values, browser settings, authentication configurations, etc). - [x] I have documented **step-by-step reproduction instructions that are precise, sequential, and leave nothing to interpretation**. My steps: - Start with the initial platform/version/OS and dependencies used, - Specify exact install/launch/configure commands, - List URLs visited, user input (incl. example values/emails/passwords if needed), - Describe all options and toggles enabled or changed, - Include any files or environmental changes, - Identify the expected and actual result at each stage, - Ensure any reasonably skilled user can follow and hit the same issue. ### Expected Behavior In version 0.6.10, the stream filter operates at normal speed ### Actual Behavior In version 0.6.11, due to the stream filter, the streaming speed has slowed down ### Steps to Reproduce Create a simple stream filter ```python from pydantic import BaseModel, Field from typing import Optional class Filter: class Valves(BaseModel): priority: int = Field( default=0, description="Priority level for the filter operations." ) def __init__(self): self.valves = self.Valves() pass def stream(self, event: dict) -> dict: for choice in event.get("choices", []): delta = choice.get("delta", {}) if "content" in delta: delta["content"] = delta["content"].replace("😊", "") # Strip emojis return event ``` Test the speed of streaming in versions 0.6.10 and 0.6.11 respectively ### Logs & Screenshots No error logs ### Additional Information _No response_

GiteaMirror added the bug label 2026-04-19 22:56:46 -05:00

GiteaMirror closed this issue

2026-04-19 22:56:46 -05:00

GiteaMirror commented

2026-04-19 22:56:47 -05:00

@EntropyYue commented on GitHub (May 27, 2025):

Although #14378 also causes the speed to slow down, this problem still exists when I test with the fixed version

@EntropyYue commented on GitHub (May 27, 2025): Although #14378 also causes the speed to slow down, this problem still exists when I test with the fixed version

GiteaMirror commented

2026-04-19 22:56:47 -05:00

@tjbck commented on GitHub (May 27, 2025):

Should be addressed with 40bea00e3d, testing wanted here.

@tjbck commented on GitHub (May 27, 2025): Should be addressed with 40bea00e3d9f5efd2b75327303822aa0cf74d242, testing wanted here.

GiteaMirror commented

2026-04-19 22:56:48 -05:00

@EntropyYue commented on GitHub (May 27, 2025):

When I sent the message, I received the following error

Error: get_function_module() got an unexpected keyword argument 'load_from_db'

@EntropyYue commented on GitHub (May 27, 2025): When I sent the message, I received the following error ``` Error: get_function_module() got an unexpected keyword argument 'load_from_db' ```

GiteaMirror referenced this issue

2026-04-20 00:25:39 -05:00

[GH-ISSUE #17236] issue: "temperature" value is ignored when using the API #18215

GiteaMirror referenced this issue

2026-04-25 07:37:23 -05:00

[GH-ISSUE #17236] issue: "temperature" value is ignored when using the API #33744

GiteaMirror referenced this issue

2026-05-05 20:11:54 -05:00

[GH-ISSUE #17236] issue: "temperature" value is ignored when using the API #56881

Sign in to join this conversation.