Originally created by @ittomsk on GitHub (Nov 27, 2024).
Description:
When sending simultaneous requests to multiple models, the interface fails to display the progress or results for all models. The issue manifests as follows:
The user sends multiple requests simultaneously (e.g., to 3 models).
The interface displays only a part of the requests (or nothing at all), even though the models continue processing in the background.
Once background processing is complete, results or progress cannot be restored in the interface.
This creates difficulties in tracking tasks and requires manually deleting and resubmitting requests.
Steps to Reproduce:
Start Open-WebUI.
Load multiple models.
Send simultaneous requests to all loaded models.
Observe that only one request or no requests are displayed in the interface.
Expected Behavior:
The interface should correctly display the progress and results for all simultaneous requests.
Once processing is complete, the results of all requests should be visible.
Actual Behavior:
Only one request or none is displayed in the interface, despite requests being processed in the background.
Screenshots/Logs:
Interface screenshot
nvtop screenshot
System Information:
OS: Debian 12, Open-WebUI and ollama are in docker
Additional Notes:
This issue may be related to a lack of synchronization between the model processes and the interface. It could also be caused by interface overload or the absence of a proper request management mechanism.
Originally created by @ittomsk on GitHub (Nov 27, 2024).
**Description:**
When sending simultaneous requests to multiple models, the interface fails to display the progress or results for all models. The issue manifests as follows:
1. The user sends multiple requests simultaneously (e.g., to 3 models).
2. The interface displays only a part of the requests (or nothing at all), even though the models continue processing in the background.
3. Once background processing is complete, results or progress cannot be restored in the interface.
This creates difficulties in tracking tasks and requires manually deleting and resubmitting requests.
**Steps to Reproduce:**
1. Start Open-WebUI.
2. Load multiple models.
3. Send simultaneous requests to all loaded models.
4. Observe that only one request or no requests are displayed in the interface.
**Expected Behavior:**
- The interface should correctly display the progress and results for all simultaneous requests.
- Once processing is complete, the results of all requests should be visible.
**Actual Behavior:**
- Only one request or none is displayed in the interface, despite requests being processed in the background.
**Screenshots/Logs:**
Interface screenshot

nvtop screenshot

**System Information:**
- OS: Debian 12, Open-WebUI and ollama are in docker
- Open-WebUI Version: v0.4.6 (from ghcr.io/open-webui/open-webui:main)
- Ollama: 0.4.5 (from ollama/ollama:latest)
- Hardware: NVidia RTX 3090
**Additional Notes:**
This issue may be related to a lack of synchronization between the model processes and the interface. It could also be caused by interface overload or the absence of a proper request management mechanism.
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Originally created by @ittomsk on GitHub (Nov 27, 2024).
Description:
When sending simultaneous requests to multiple models, the interface fails to display the progress or results for all models. The issue manifests as follows:
This creates difficulties in tracking tasks and requires manually deleting and resubmitting requests.
Steps to Reproduce:
Expected Behavior:
Actual Behavior:
Screenshots/Logs:

Interface screenshot
nvtop screenshot

System Information:
Additional Notes:
This issue may be related to a lack of synchronization between the model processes and the interface. It could also be caused by interface overload or the absence of a proper request management mechanism.