[PR #24461] [MERGED] fix: stream GET /chats/all to prevent OOM on large chat histories #131331

New Issue

GiteaMirror · 2026-05-21T16:41:46-05:00

GiteaMirror commented

2026-05-21 16:41:46 -05:00

📋 Pull Request Information

Original PR: https://github.com/open-webui/open-webui/pull/24461
Author: @Classic298
Created: 5/8/2026
Status: ✅ Merged
Merged: 5/8/2026
Merged by: @tjbck

Base: dev ← Head: fix/stream-chats-all-export

📝 Commits (1)

16c6613 fix: stream GET /chats/all to prevent OOM on large chat histories

📊 Changes

2 files changed (+78 additions, -24 deletions)

View changed files

📝 backend/open_webui/routers/chats.py (+39 -4)
📝 src/lib/apis/chats/index.ts (+39 -20)

📄 Description

Convert the /chats/all endpoint from loading all user chats into memory at once to a streaming NDJSON response that fetches chats in batches of
100. This prevents Out-of-Memory crashes for users with large chat histories.

Backend: Added async generator that paginates through chats with short-lived DB sessions per batch (critical for SQLite lock release).

Frontend: Updated getAllChats to consume the NDJSON stream via ReadableStream reader, accumulating results for the export file.

Ref: open-webui#22206

Contributor License Agreement

By submitting this pull request, I confirm that I have read and fully agree to the Contributor License Agreement (CLA), and I am providing my contributions under its terms.

Note

Deleting the CLA section will lead to immediate closure of your PR and it will not be merged in.

_{🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.}

## 📋 Pull Request Information **Original PR:** https://github.com/open-webui/open-webui/pull/24461 **Author:** [@Classic298](https://github.com/Classic298) **Created:** 5/8/2026 **Status:** ✅ Merged **Merged:** 5/8/2026 **Merged by:** [@tjbck](https://github.com/tjbck) **Base:** `dev` ← **Head:** `fix/stream-chats-all-export` --- ### 📝 Commits (1) - [`16c6613`](https://github.com/open-webui/open-webui/commit/16c66132927ab64771f86c08625844941c7f2b2e) fix: stream GET /chats/all to prevent OOM on large chat histories ### 📊 Changes **2 files changed** (+78 additions, -24 deletions) <details> <summary>View changed files</summary> 📝 `backend/open_webui/routers/chats.py` (+39 -4) 📝 `src/lib/apis/chats/index.ts` (+39 -20) </details> ### 📄 Description Convert the /chats/all endpoint from loading all user chats into memory at once to a streaming NDJSON response that fetches chats in batches of 100. This prevents Out-of-Memory crashes for users with large chat histories. Backend: Added async generator that paginates through chats with short-lived DB sessions per batch (critical for SQLite lock release). Frontend: Updated getAllChats to consume the NDJSON stream via ReadableStream reader, accumulating results for the export file. Ref: open-webui#22206 ### Contributor License Agreement  - [x] By submitting this pull request, I confirm that I have read and fully agree to the [Contributor License Agreement (CLA)](https://github.com/open-webui/open-webui/blob/main/CONTRIBUTOR_LICENSE_AGREEMENT), and I am providing my contributions under its terms. > [!NOTE] > Deleting the CLA section will lead to immediate closure of your PR and it will not be merged in. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>

GiteaMirror added the pull-request label 2026-05-21 16:41:46 -05:00

GiteaMirror closed this issue

2026-05-21 16:41:51 -05:00

Sign in to join this conversation.

Branches Tags

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: github-starred/open-webui#131331