github-starred/open-webui
2
0
Fork 0
mirror of https://github.com/open-webui/open-webui.git synced 2026-07-11 10:34:13 -05:00
Code Issues 2.4k Packages Projects Releases 129 Wiki Activity

[GH-ISSUE #18863] feat: payload size limitations for the API #18697

New Issue
Closed
opened 2026-04-20 00:54:31 -05:00 by GiteaMirror · 0 comments
GiteaMirror commented 2026-04-20 00:54:31 -05:00
Owner
Copy Link

Originally created by @JIW-roosi on GitHub (Nov 2, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/18863

Check Existing Issues

  • I have searched all existing open AND closed issues and discussions for similar requests. I have found none that is comparable to my request.

Problem Description

A user was using the open webui API for code generation and refactoring in SQL Server Management Studio.
The prompts injected were massive (roughly 1 million characters from a tabular/semantic model) and some queries took more than 60 hours to complete.
This was not noticed initially, as the user was experimenting on a Friday and effects were only seen on Monday; loading was extremely slow when it worked but was unresponsive most of the time.
Container memory use was continuously higher than 7GB, even going north of 10GB without any other user being able to get a response, when it normally is below 2GB.
A force-logout and jwt token reset was necessary to fix the situation.

Desired Solution you'd like

payload size limitations for the API, as optimisation of large request handling to such an extent seems unfeisable

Alternatives Considered

No response

Additional Context

open webui v0.6.32 in a k8s deployment
endpoint used: /api/chat/completions, auth through jwt token

Originally created by @JIW-roosi on GitHub (Nov 2, 2025). Original GitHub issue: https://github.com/open-webui/open-webui/issues/18863 ### Check Existing Issues - [x] I have searched all existing open AND closed issues and discussions for similar requests. I have found none that is comparable to my request. ### Problem Description A user was using the open webui API for code generation and refactoring in SQL Server Management Studio. The prompts injected were massive (roughly 1 million characters from a tabular/semantic model) and some queries took more than 60 hours to complete. This was not noticed initially, as the user was experimenting on a Friday and effects were only seen on Monday; loading was extremely slow when it worked but was unresponsive most of the time. Container memory use was continuously higher than 7GB, even going north of 10GB without any other user being able to get a response, when it normally is below 2GB. A force-logout and jwt token reset was necessary to fix the situation. ### Desired Solution you'd like payload size limitations for the API, as optimisation of large request handling to such an extent seems unfeisable ### Alternatives Considered _No response_ ### Additional Context open webui v0.6.32 in a k8s deployment endpoint used: /api/chat/completions, auth through jwt token
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
confirmed
confirmed issue
core
documentation
enhancement
good first issue
help wanted
non-core
pull-request
Mirrored from GitHub Pull Request
 python
question
testing wanted
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#18697
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?