[PR #22242] [CLOSED] Fix: implement server-side pagination to resolve OOM #22206 #26567

Closed
opened 2026-04-20 06:34:39 -05:00 by GiteaMirror · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/open-webui/open-webui/pull/22242
Author: @batrapulkit
Created: 3/4/2026
Status: Closed

Base: devHead: fix/api-memory-pagination


📝 Commits (10+)

📊 Changes

5 files changed (+366 additions, -23 deletions)

View changed files

📝 backend/open_webui/models/chats.py (+60 -12)
📝 backend/open_webui/models/feedbacks.py (+28 -4)
📝 backend/open_webui/models/memories.py (+26 -4)
📝 backend/open_webui/models/messages.py (+5 -3)
backend/open_webui/test/apps/webui/routers/test_unbounded_queries.py (+247 -0)

📄 Description

Summary: Fixes critical OOM crashes (#22206) by implementing server-side pagination and optimizing memory-intensive database queries.

The Problem: Endpoints like /api/v1/chats/all, /api/v1/memories/, and /api/v1/evaluations/ load entire datasets into memory at once, causing OOM crashes on enterprise-scale instances.

The Fix:

Server-side Pagination: Added skip and limit to SQLAlchemy queries in models/chats.py, models/feedbacks.py, models/memories.py, and models/messages.py.

Correlated Subqueries: Optimized delete_shared_chats_by_user_id() to perform server-side deletions, removing the need to materialize ID lists in Python.

Column Projection: Optimized get_reply_user_ids_by_message_id() to query only the user_id column, avoiding full row hydration.

Safe Defaults: All parameters use safe defaults (limit=50–200), ensuring backward compatibility.

Regression Testing: Added test_unbounded_queries.py covering 9 critical test cases.

Testing & Validation:

Manual Verification: Verified syntax via AST validation for all 5 modified files.

Memory Benchmark: Simulated large datasets locally; confirmed that memory usage remains stable (O(1) relative to total record count) due to pagination.

Contributor License Agreement
I certify that this contribution is my own original work and that I have the right to submit it under the project's license.

Fixes #22206


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/open-webui/open-webui/pull/22242 **Author:** [@batrapulkit](https://github.com/batrapulkit) **Created:** 3/4/2026 **Status:** ❌ Closed **Base:** `dev` ← **Head:** `fix/api-memory-pagination` --- ### 📝 Commits (10+) - [`fe6783c`](https://github.com/open-webui/open-webui/commit/fe6783c16699911c7be17392596d579333fb110c) Merge pull request #19030 from open-webui/dev - [`fc05e0a`](https://github.com/open-webui/open-webui/commit/fc05e0a6c5d39da60b603b4d520f800d6e36f748) Merge pull request #19405 from open-webui/dev - [`e3faec6`](https://github.com/open-webui/open-webui/commit/e3faec62c58e3a83d89aa3df539feacefa125e0c) Merge pull request #19416 from open-webui/dev - [`9899293`](https://github.com/open-webui/open-webui/commit/9899293f050ad50ae12024cbebee7e018acd851e) Merge pull request #19448 from open-webui/dev - [`140605e`](https://github.com/open-webui/open-webui/commit/140605e660b8186a7d5c79fb3be6ffb147a2f498) Merge pull request #19462 from open-webui/dev - [`6f1486f`](https://github.com/open-webui/open-webui/commit/6f1486ffd0cb288d0e21f41845361924e0d742b3) Merge pull request #19466 from open-webui/dev - [`d95f533`](https://github.com/open-webui/open-webui/commit/d95f533214e3fe5beb5e41ec1f349940bc4c7043) Merge pull request #19729 from open-webui/dev - [`a727153`](https://github.com/open-webui/open-webui/commit/a7271532f8a38da46785afcaa7e65f9a45e7d753) 0.6.43 (#20093) - [`6adde20`](https://github.com/open-webui/open-webui/commit/6adde203cd292a9e3af9c64a2ae36b603fed096a) Merge pull request #20394 from open-webui/dev - [`f9b0534`](https://github.com/open-webui/open-webui/commit/f9b0534e0c442631d1cb7205169588b9b6204179) Merge pull request #20522 from open-webui/dev ### 📊 Changes **5 files changed** (+366 additions, -23 deletions) <details> <summary>View changed files</summary> 📝 `backend/open_webui/models/chats.py` (+60 -12) 📝 `backend/open_webui/models/feedbacks.py` (+28 -4) 📝 `backend/open_webui/models/memories.py` (+26 -4) 📝 `backend/open_webui/models/messages.py` (+5 -3) ➕ `backend/open_webui/test/apps/webui/routers/test_unbounded_queries.py` (+247 -0) </details> ### 📄 Description Summary: Fixes critical OOM crashes (#22206) by implementing server-side pagination and optimizing memory-intensive database queries. The Problem: Endpoints like /api/v1/chats/all, /api/v1/memories/, and /api/v1/evaluations/ load entire datasets into memory at once, causing OOM crashes on enterprise-scale instances. The Fix: Server-side Pagination: Added skip and limit to SQLAlchemy queries in models/chats.py, models/feedbacks.py, models/memories.py, and models/messages.py. Correlated Subqueries: Optimized delete_shared_chats_by_user_id() to perform server-side deletions, removing the need to materialize ID lists in Python. Column Projection: Optimized get_reply_user_ids_by_message_id() to query only the user_id column, avoiding full row hydration. Safe Defaults: All parameters use safe defaults (limit=50–200), ensuring backward compatibility. Regression Testing: Added test_unbounded_queries.py covering 9 critical test cases. Testing & Validation: Manual Verification: Verified syntax via AST validation for all 5 modified files. Memory Benchmark: Simulated large datasets locally; confirmed that memory usage remains stable (O(1) relative to total record count) due to pagination. Contributor License Agreement I certify that this contribution is my own original work and that I have the right to submit it under the project's license. Fixes #22206 --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
GiteaMirror added the pull-request label 2026-04-20 06:34:39 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#26567