Originally created by @zjjott on GitHub (Feb 18, 2025).
Feature Request
Support edge device deployment OPENAPI only(2 cpu core or less, 1G memory or less)
Is your feature request related to a problem? Please describe.
I found open-webui have many library request,such as tensorboard/pytorch/transformers,which is not necessary for OPENAI API.
When startup open-webui at those low-memory device,It'll out of memory
Describe the solution you'd like
Can we decouple third-party library dependencies between local deployment and API deployment,and support low-memory deployment?
Originally created by @zjjott on GitHub (Feb 18, 2025).
# Feature Request
Support edge device deployment OPENAPI only(2 cpu core or less, 1G memory or less)
**Is your feature request related to a problem? Please describe.**
I found open-webui have many library request,such as tensorboard/pytorch/transformers,which is not necessary for OPENAI API.
When startup open-webui at those low-memory device,It'll out of memory
**Describe the solution you'd like**
Can we decouple third-party library dependencies between local deployment and API deployment,and support low-memory deployment?
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Originally created by @zjjott on GitHub (Feb 18, 2025).
Feature Request
Support edge device deployment OPENAPI only(2 cpu core or less, 1G memory or less)
Is your feature request related to a problem? Please describe.
I found open-webui have many library request,such as tensorboard/pytorch/transformers,which is not necessary for OPENAI API.
When startup open-webui at those low-memory device,It'll out of memory
Describe the solution you'd like
Can we decouple third-party library dependencies between local deployment and API deployment,and support low-memory deployment?