[GH-ISSUE #15702] issue: Failed uploading large markdown files to Knowledge #56309

New Issue

GiteaMirror · 2026-05-05T19:08:37-05:00

GiteaMirror commented

2026-05-05 19:08:37 -05:00

Originally created by @raymondhs on GitHub (Jul 14, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/15702

Check Existing Issues

I have searched the existing issues and discussions.
I am using the latest version of Open WebUI.

Installation Method

Git Clone

Open WebUI Version

v0.6.15

Ollama Version (if applicable)

No response

Operating System

Docker

Browser (if applicable)

No response

Confirmation

I have read and followed all instructions in README.md.
I am using the latest version of both Open WebUI and Ollama.
I have included the browser console logs.
I have included the Docker container logs.
I have provided every relevant configuration, setting, and environment variable used in my setup.
I have clearly listed every relevant configuration, custom setting, environment variable, and command-line option that influences my setup (such as Docker Compose overrides, .env values, browser settings, authentication configurations, etc).
I have documented step-by-step reproduction instructions that are precise, sequential, and leave nothing to interpretation. My steps:
Start with the initial platform/version/OS and dependencies used,
Specify exact install/launch/configure commands,
List URLs visited, user input (incl. example values/emails/passwords if needed),
Describe all options and toggles enabled or changed,
Include any files or environmental changes,
Identify the expected and actual result at each stage,
Ensure any reasonably skilled user can follow and hit the same issue.

Expected Behavior

Large markdown files should upload successfully to the knowledge base through the Knowledge collection interface.

Actual Behavior

When attempting to upload markdown files larger than approximately 100KB, the upload fails silently. The file appears to start uploading but never completes (forever spinning). No error message is displayed to the user.

When uploading a folder, the completed progress count increases, but the large files are not shown in the list.

As a workaround, I had to divide the large files into ~100KB chunks, but this is not always ideal and it requires extra preprocessing steps.

Steps to Reproduce

Navigate to the Knowledge section in Open WebUI
Create a new collection or select an existing one
Click "+" button
Select a markdown file that is small (e.g. ~100KB) - this will upload successfully
Try to upload a larger markdown file (e.g., >1MB) - the upload progress indicator keeps spinning without completing
Refresh and check the collection - the larger file is not added to the knowledge base

Logs & Screenshots

DEBUG log was activated and there were a bunch of successful calls by open_webui.retrieval.utils:generate_openai_batch_embeddings, so I don't think the issue comes from the backend embedding API. I checked the embedding backend API server logs and it was fine too. It looks like the embedding was completed.

Additional Information

I have set my kube ingress configuration nginx.ingress.kubernetes.io/proxy-body-size: 4096m, which should be large enough for file uploads.

Any pointers are appreciated as I can't figure out what's wrong from the logs.

Originally created by @raymondhs on GitHub (Jul 14, 2025). Original GitHub issue: https://github.com/open-webui/open-webui/issues/15702 ### Check Existing Issues - [x] I have searched the existing issues and discussions. - [x] I am using the latest version of Open WebUI. ### Installation Method Git Clone ### Open WebUI Version v0.6.15 ### Ollama Version (if applicable) _No response_ ### Operating System Docker ### Browser (if applicable) _No response_ ### Confirmation - [x] I have read and followed all instructions in `README.md`. - [x] I am using the latest version of **both** Open WebUI and Ollama. - [x] I have included the browser console logs. - [x] I have included the Docker container logs. - [x] I have **provided every relevant configuration, setting, and environment variable used in my setup.** - [x] I have clearly **listed every relevant configuration, custom setting, environment variable, and command-line option that influences my setup** (such as Docker Compose overrides, .env values, browser settings, authentication configurations, etc). - [x] I have documented **step-by-step reproduction instructions that are precise, sequential, and leave nothing to interpretation**. My steps: - Start with the initial platform/version/OS and dependencies used, - Specify exact install/launch/configure commands, - List URLs visited, user input (incl. example values/emails/passwords if needed), - Describe all options and toggles enabled or changed, - Include any files or environmental changes, - Identify the expected and actual result at each stage, - Ensure any reasonably skilled user can follow and hit the same issue. ### Expected Behavior Large markdown files should upload successfully to the knowledge base through the Knowledge collection interface. ### Actual Behavior When attempting to upload markdown files larger than approximately 100KB, the upload fails silently. The file appears to start uploading but never completes (forever spinning). No error message is displayed to the user. When uploading a folder, the completed progress count increases, but the large files are not shown in the list. As a workaround, I had to divide the large files into ~100KB chunks, but this is not always ideal and it requires extra preprocessing steps. ### Steps to Reproduce - Navigate to the Knowledge section in Open WebUI - Create a new collection or select an existing one - Click "+" button - Select a markdown file that is small (e.g. ~100KB) - this will upload successfully - Try to upload a larger markdown file (e.g., >1MB) - the upload progress indicator keeps spinning without completing - Refresh and check the collection - the larger file is not added to the knowledge base ### Logs & Screenshots <img width="291" height="129" alt="Image" src="https://github.com/user-attachments/assets/cb94c978-69a9-48e0-88a8-fa1f3766601f" /> DEBUG log was activated and there were a bunch of successful calls by `open_webui.retrieval.utils:generate_openai_batch_embeddings`, so I don't think the issue comes from the backend embedding API. I checked the embedding backend API server logs and it was fine too. It looks like the embedding was completed. ### Additional Information I have set my kube ingress configuration `nginx.ingress.kubernetes.io/proxy-body-size: 4096m`, which should be large enough for file uploads. Any pointers are appreciated as I can't figure out what's wrong from the logs.

GiteaMirror added the bug label 2026-05-05 19:08:37 -05:00

GiteaMirror closed this issue

2026-05-05 19:08:37 -05:00

GiteaMirror commented

2026-05-05 19:08:38 -05:00

@taaa22 commented on GitHub (Jul 14, 2025):

The issue also occurs when you try to upload any document larger than 1 MB in the chat

@taaa22 commented on GitHub (Jul 14, 2025): The issue also occurs when you try to upload any document larger than 1 MB in the chat ![image](https://github.com/user-attachments/assets/dc3aad15-4e90-4e8f-a9eb-3c059f3c88ef)

GiteaMirror commented

2026-05-05 19:08:39 -05:00

@jannikstdl commented on GitHub (Jul 16, 2025):

This is likely due to ingress class configuration on K8s

In this case its often the "..is not a valid JSON"

@jannikstdl commented on GitHub (Jul 16, 2025): This is likely due to ingress class configuration on K8s In this case its often the "..is not a valid JSON"

GiteaMirror commented

2026-05-05 19:08:40 -05:00

@tjbck commented on GitHub (Jul 16, 2025):

Unable to reproduce here.

Related: #15023

@tjbck commented on GitHub (Jul 16, 2025): Unable to reproduce here. Related: #15023

Sign in to join this conversation.

Branches Tags

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: github-starred/open-webui#56309