[GH-ISSUE #17174] issue: process_in_background issue #33723

Closed
opened 2026-04-25 07:36:25 -05:00 by GiteaMirror · 5 comments
Owner

Originally created by @aaronchenlei on GitHub (Sep 3, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/17174

Check Existing Issues

  • I have searched the existing issues and discussions.
  • I am using the latest version of Open WebUI.

Installation Method

Git Clone

Open WebUI Version

0.6.26

Ollama Version (if applicable)

No response

Operating System

ubuntu 22.04

Browser (if applicable)

No response

Confirmation

  • I have read and followed all instructions in README.md.
  • I am using the latest version of both Open WebUI and Ollama.
  • I have included the browser console logs.
  • I have included the Docker container logs.
  • I have provided every relevant configuration, setting, and environment variable used in my setup.
  • I have clearly listed every relevant configuration, custom setting, environment variable, and command-line option that influences my setup (such as Docker Compose overrides, .env values, browser settings, authentication configurations, etc).
  • I have documented step-by-step reproduction instructions that are precise, sequential, and leave nothing to interpretation. My steps:
  • Start with the initial platform/version/OS and dependencies used,
  • Specify exact install/launch/configure commands,
  • List URLs visited, user input (incl. example values/emails/passwords if needed),
  • Describe all options and toggles enabled or changed,
  • Include any files or environmental changes,
  • Identify the expected and actual result at each stage,
  • Ensure any reasonably skilled user can follow and hit the same issue.

Expected Behavior

the upload file should be inserted to file-xxxxxx collection firstly, then insert to knowledge collection.

Actual Behavior

Due to the process_in_background setting to True, the OI initiates the upload to the knowledge collection concurrently with the upload to the file-xxxxxxx collection — even before the CSV file upload is confirmed successful. This race condition leads to inconsistent data states between the two collections.

Steps to Reproduce

upload a csv file to knowledge

Logs & Screenshots

the same csv file.
2025-09-03 07:54:21.181 | INFO | open_webui.retrieval.vector.dbs.chroma:insert:163 - Inserting 55 items into collection b84d4398-02f3-4998-816f-ba17885a234c.

2025-09-03 07:54:21.761 | INFO | open_webui.retrieval.vector.dbs.chroma:insert:163 - Inserting 129 items into collection file-ca3f6c86-bcb3-44d3-a2a3-03ed98669500.

Additional Information

No response

Originally created by @aaronchenlei on GitHub (Sep 3, 2025). Original GitHub issue: https://github.com/open-webui/open-webui/issues/17174 ### Check Existing Issues - [x] I have searched the existing issues and discussions. - [x] I am using the latest version of Open WebUI. ### Installation Method Git Clone ### Open WebUI Version 0.6.26 ### Ollama Version (if applicable) _No response_ ### Operating System ubuntu 22.04 ### Browser (if applicable) _No response_ ### Confirmation - [x] I have read and followed all instructions in `README.md`. - [x] I am using the latest version of **both** Open WebUI and Ollama. - [x] I have included the browser console logs. - [x] I have included the Docker container logs. - [x] I have **provided every relevant configuration, setting, and environment variable used in my setup.** - [x] I have clearly **listed every relevant configuration, custom setting, environment variable, and command-line option that influences my setup** (such as Docker Compose overrides, .env values, browser settings, authentication configurations, etc). - [x] I have documented **step-by-step reproduction instructions that are precise, sequential, and leave nothing to interpretation**. My steps: - Start with the initial platform/version/OS and dependencies used, - Specify exact install/launch/configure commands, - List URLs visited, user input (incl. example values/emails/passwords if needed), - Describe all options and toggles enabled or changed, - Include any files or environmental changes, - Identify the expected and actual result at each stage, - Ensure any reasonably skilled user can follow and hit the same issue. ### Expected Behavior the upload file should be inserted to file-xxxxxx collection firstly, then insert to knowledge collection. ### Actual Behavior Due to the process_in_background setting to True, the OI initiates the upload to the knowledge collection concurrently with the upload to the file-xxxxxxx collection — even before the CSV file upload is confirmed successful. This race condition leads to inconsistent data states between the two collections. ### Steps to Reproduce upload a csv file to knowledge ### Logs & Screenshots the same csv file. 2025-09-03 07:54:21.181 | INFO | open_webui.retrieval.vector.dbs.chroma:insert:163 - Inserting 55 items into collection b84d4398-02f3-4998-816f-ba17885a234c. 2025-09-03 07:54:21.761 | INFO | open_webui.retrieval.vector.dbs.chroma:insert:163 - Inserting 129 items into collection file-ca3f6c86-bcb3-44d3-a2a3-03ed98669500. ### Additional Information _No response_
GiteaMirror added the bug label 2026-04-25 07:36:25 -05:00
Author
Owner

@rgaricano commented on GitHub (Sep 3, 2025):

For reference,
Most simple solution: detect when a file is intended for a knowledge collection and force synchronous processing.

Replace in
https://github.com/open-webui/open-webui/blob/2407d9b905978d68619bdce4021e424046ec8df9/backend/open_webui/routers/files.py#L237-L250

with

if process:  
    if (background_tasks and process_in_background and   
        not (file_metadata and file_metadata.get('collection_name'))):  
...
<!-- gh-comment-id:3248312417 --> @rgaricano commented on GitHub (Sep 3, 2025): For reference, Most simple solution: detect when a file is intended for a knowledge collection and force synchronous processing. Replace in https://github.com/open-webui/open-webui/blob/2407d9b905978d68619bdce4021e424046ec8df9/backend/open_webui/routers/files.py#L237-L250 with ``` if process: if (background_tasks and process_in_background and not (file_metadata and file_metadata.get('collection_name'))): ... ```
Author
Owner

@tjbck commented on GitHub (Dec 11, 2025):

@silentoplayz this might've been addressed with the latest dev, confirmation wanted here.

<!-- gh-comment-id:3643729485 --> @tjbck commented on GitHub (Dec 11, 2025): @silentoplayz this might've been addressed with the latest dev, confirmation wanted here.
Author
Owner

@tjbck commented on GitHub (Dec 11, 2025):

@aaronchenlei do you have a concrete step by step instructions on how we can reproduce?

<!-- gh-comment-id:3644167938 --> @tjbck commented on GitHub (Dec 11, 2025): @aaronchenlei do you have a concrete step by step instructions on how we can reproduce?
Author
Owner

@Classic298 commented on GitHub (Dec 14, 2025):

@silentoplayz can you still repro (or not) on latest dev?

<!-- gh-comment-id:3652223937 --> @Classic298 commented on GitHub (Dec 14, 2025): @silentoplayz can you still repro (or not) on latest dev?
Author
Owner

@silentoplayz commented on GitHub (Jan 14, 2026):

I was never able to reproduce anything here in the first place. @aaronchenlei More information is warranted.

<!-- gh-comment-id:3749120452 --> @silentoplayz commented on GitHub (Jan 14, 2026): I was never able to reproduce anything here in the first place. @aaronchenlei More information is warranted.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#33723