mirror of
https://github.com/open-webui/open-webui.git
synced 2026-07-16 06:03:26 -05:00
[GH-ISSUE #4190] Hope to improve the performance of Docker Ollama-CPU, especially for multi-threaded CPU optimization and high memory usage control #13528
No Assignees
Notifications
Due Date
No due date set.
Dependencies
No dependencies set.
Reference: github-starred/open-webui#13528
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @shenyan-008 on GitHub (Jul 29, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/4190
I am using Windows 10 docker Ollama-CPU. First of all, this is a great project. However, it is not very friendly to multi-threaded CPUs. It can only support 64 CPU threads at most. I have a CPU with 192 threads, but it causes a lot of performance waste when using this project. Can this project optimize multi-threaded CPUs? And the project's memory overhead is too huge. Suppose I actually only need to use 132GB of memory, but the actual memory usage is 200GB, which is equivalent to the maximum memory limit I gave under ".wslconfig"