Simultaneous Requests to Multiple Models Not Displayed in the Interface #2844

Closed
opened 2025-11-11 15:15:34 -06:00 by GiteaMirror · 0 comments
Owner

Originally created by @ittomsk on GitHub (Nov 27, 2024).

Description:
When sending simultaneous requests to multiple models, the interface fails to display the progress or results for all models. The issue manifests as follows:

  1. The user sends multiple requests simultaneously (e.g., to 3 models).
  2. The interface displays only a part of the requests (or nothing at all), even though the models continue processing in the background.
  3. Once background processing is complete, results or progress cannot be restored in the interface.

This creates difficulties in tracking tasks and requires manually deleting and resubmitting requests.

Steps to Reproduce:

  1. Start Open-WebUI.
  2. Load multiple models.
  3. Send simultaneous requests to all loaded models.
  4. Observe that only one request or no requests are displayed in the interface.

Expected Behavior:

  • The interface should correctly display the progress and results for all simultaneous requests.
  • Once processing is complete, the results of all requests should be visible.

Actual Behavior:

  • Only one request or none is displayed in the interface, despite requests being processed in the background.

Screenshots/Logs:
Interface screenshot
изображение_2024-11-27_160803605

nvtop screenshot
изображение_2024-11-27_160837925

System Information:

  • OS: Debian 12, Open-WebUI and ollama are in docker
  • Open-WebUI Version: v0.4.6 (from ghcr.io/open-webui/open-webui:main)
  • Ollama: 0.4.5 (from ollama/ollama:latest)
  • Hardware: NVidia RTX 3090

Additional Notes:
This issue may be related to a lack of synchronization between the model processes and the interface. It could also be caused by interface overload or the absence of a proper request management mechanism.

Originally created by @ittomsk on GitHub (Nov 27, 2024). **Description:** When sending simultaneous requests to multiple models, the interface fails to display the progress or results for all models. The issue manifests as follows: 1. The user sends multiple requests simultaneously (e.g., to 3 models). 2. The interface displays only a part of the requests (or nothing at all), even though the models continue processing in the background. 3. Once background processing is complete, results or progress cannot be restored in the interface. This creates difficulties in tracking tasks and requires manually deleting and resubmitting requests. **Steps to Reproduce:** 1. Start Open-WebUI. 2. Load multiple models. 3. Send simultaneous requests to all loaded models. 4. Observe that only one request or no requests are displayed in the interface. **Expected Behavior:** - The interface should correctly display the progress and results for all simultaneous requests. - Once processing is complete, the results of all requests should be visible. **Actual Behavior:** - Only one request or none is displayed in the interface, despite requests being processed in the background. **Screenshots/Logs:** Interface screenshot ![изображение_2024-11-27_160803605](https://github.com/user-attachments/assets/47c54398-d851-44f7-823d-5331e62a2c8e) nvtop screenshot ![изображение_2024-11-27_160837925](https://github.com/user-attachments/assets/5b96f63b-11fa-4e3b-a456-1d65dbb1f610) **System Information:** - OS: Debian 12, Open-WebUI and ollama are in docker - Open-WebUI Version: v0.4.6 (from ghcr.io/open-webui/open-webui:main) - Ollama: 0.4.5 (from ollama/ollama:latest) - Hardware: NVidia RTX 3090 **Additional Notes:** This issue may be related to a lack of synchronization between the model processes and the interface. It could also be caused by interface overload or the absence of a proper request management mechanism.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#2844