[GH-ISSUE #1210] add RAG: cpu/cuda/mps as a config variable rather than hardcode #66999

New Issue

GiteaMirror · 2026-05-12T23:17:27-05:00

GiteaMirror commented

2026-05-12 23:17:27 -05:00

Originally created by @drawingthesun on GitHub (Mar 19, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/1210

File: backend/config.py has the following hardcoded variable:

RAG_EMBEDDING_MODEL_DEVICE_TYPE = os.environ.get(
    "RAG_EMBEDDING_MODEL_DEVICE_TYPE", "cpu"
)

I use open-webui locally without Docker, and whenever I do an update I have config.py replaced, however the hardcoded variable I have to change everytime to "mps" and I forget a lot of the time.

Originally created by @drawingthesun on GitHub (Mar 19, 2024). Original GitHub issue: https://github.com/open-webui/open-webui/issues/1210 File: `backend/config.py` has the following hardcoded variable: ```python RAG_EMBEDDING_MODEL_DEVICE_TYPE = os.environ.get( "RAG_EMBEDDING_MODEL_DEVICE_TYPE", "cpu" ) ``` I use open-webui locally without Docker, and whenever I do an update I have config.py replaced, however the hardcoded variable I have to change everytime to "mps" and I forget a lot of the time.

GiteaMirror closed this issue

2026-05-12 23:17:27 -05:00

GiteaMirror commented

2026-05-12 23:17:28 -05:00

@jannikstdl commented on GitHub (Mar 19, 2024):

Related #1165

@jannikstdl commented on GitHub (Mar 19, 2024): Related #1165

Sign in to join this conversation.

Branches Tags

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: github-starred/open-webui#66999