[PR #23859] perf: emit text tokens as deltas instead of re-serializing the whole chat per SSE event #27411

New Issue

GiteaMirror · 2026-04-20T07:03:31-05:00

GiteaMirror commented

2026-04-20 07:03:31 -05:00

📋 Pull Request Information

Original PR: https://github.com/open-webui/open-webui/pull/23859
Author: @Classic298
Created: 4/17/2026
Status: 🔄 Open

Base: dev ← Head: perf/stream-delta-emit

📝 Commits (3)

07ee26b docs: add writeup for O(N^2) WebSocket payload bloat during LLM streaming
d7b36be perf(stream): emit text tokens as deltas instead of re-serializing the whole chat per SSE event
6155105 style(stream): tighten comments on delta-emit change

📊 Changes

1 file changed (+67 additions, -12 deletions)

View changed files

📝 backend/open_webui/utils/middleware.py (+67 -12)

📄 Description

Partially fixes https://github.com/open-webui/open-webui/issues/23733

Contributor License Agreement

By submitting this pull request, I confirm that I have read and fully agree to the Contributor License Agreement (CLA), and I am providing my contributions under its terms.

Note

Deleting the CLA section will lead to immediate closure of your PR and it will not be merged in.

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/open-webui/open-webui/pull/23859 **Author:** [@Classic298](https://github.com/Classic298) **Created:** 4/17/2026 **Status:** 🔄 Open **Base:** `dev` ← **Head:** `perf/stream-delta-emit` --- ### 📝 Commits (3) - [`07ee26b`](https://github.com/open-webui/open-webui/commit/07ee26b4f7de2a0d6e069f63972a9832af4bde63) docs: add writeup for O(N^2) WebSocket payload bloat during LLM streaming - [`d7b36be`](https://github.com/open-webui/open-webui/commit/d7b36be54dbf69a31f47de6c8e30445de1bc9093) perf(stream): emit text tokens as deltas instead of re-serializing the whole chat per SSE event - [`6155105`](https://github.com/open-webui/open-webui/commit/6155105971501a2dc6de9864a9e82553765bbf18) style(stream): tighten comments on delta-emit change ### 📊 Changes **1 file changed** (+67 additions, -12 deletions) <details> <summary>View changed files</summary> 📝 `backend/open_webui/utils/middleware.py` (+67 -12) </details> ### 📄 Description Partially fixes https://github.com/open-webui/open-webui/issues/23733 ### Contributor License Agreement  - [X] By submitting this pull request, I confirm that I have read and fully agree to the [Contributor License Agreement (CLA)](https://github.com/open-webui/open-webui/blob/main/CONTRIBUTOR_LICENSE_AGREEMENT), and I am providing my contributions under its terms. > [!NOTE] > Deleting the CLA section will lead to immediate closure of your PR and it will not be merged in. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

GiteaMirror added the pull-request label 2026-04-20 07:03:31 -05:00

Sign in to join this conversation.

Branches Tags

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: github-starred/open-webui#27411