github-starred/open-webui
2
0
Fork 0
mirror of https://github.com/open-webui/open-webui.git synced 2026-05-08 12:58:11 -05:00
Code Issues 1.3k Packages Projects Releases 126 Wiki Activity

[GH-ISSUE #921] Add litellm to kubernetes path #12252

New Issue
Closed
opened 2026-04-19 19:08:09 -05:00 by GiteaMirror · 4 comments
GiteaMirror commented 2026-04-19 19:08:09 -05:00
Owner
Copy Link

Originally created by @jannikstdl on GitHub (Feb 26, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/921

We should add this to our k8s/helm and docker-compose yamls.

Maybe @duhow @braveokafor can help with this.

https://litellm.vercel.app/docs/proxy/deploy

Originally created by @jannikstdl on GitHub (Feb 26, 2024). Original GitHub issue: https://github.com/open-webui/open-webui/issues/921 We should add this to our k8s/helm and docker-compose yamls. Maybe @duhow @braveokafor can help with this. https://litellm.vercel.app/docs/proxy/deploy
GiteaMirror commented 2026-04-19 19:08:11 -05:00
Author
Owner
Copy Link

@duhow commented on GitHub (Feb 26, 2024):

I'm guessing you want to decouple services/dependencies from the whole open-webui image in separated services, or is there any other plan?
How do we want to scale that service?

<!-- gh-comment-id:1963625403 --> @duhow commented on GitHub (Feb 26, 2024): I'm guessing you want to decouple services/dependencies from the whole `open-webui` image in separated services, or is there any other plan? How do we want to scale that service?
GiteaMirror commented 2026-04-19 19:08:13 -05:00
Author
Owner
Copy Link

@tjbck commented on GitHub (Feb 26, 2024):

FYI, Our webui already ships with LiteLLM proxy built-in!

<!-- gh-comment-id:1963734131 --> @tjbck commented on GitHub (Feb 26, 2024): FYI, Our webui already ships with LiteLLM proxy built-in!
GiteaMirror commented 2026-04-19 19:08:13 -05:00
Author
Owner
Copy Link

@jannikstdl commented on GitHub (Feb 26, 2024):

Ok, so is works out of the box with the existing image?

Do i need to update test.json

for other providers?

<!-- gh-comment-id:1963804696 --> @jannikstdl commented on GitHub (Feb 26, 2024): Ok, so is works out of the box with the existing image? Do i need to update [test.json](https://github.com/open-webui/open-webui/blob/main/test.json) for other providers?
GiteaMirror commented 2026-04-19 19:08:14 -05:00
Author
Owner
Copy Link

@jannikstdl commented on GitHub (Feb 26, 2024):

Ok got it, I just need to read the new docs :D
https://docs.openwebui.com/tutorial/litellm

Maybe decouple litellm would nevertheless be a good idea.. but will close for noe

<!-- gh-comment-id:1963811773 --> @jannikstdl commented on GitHub (Feb 26, 2024): Ok got it, I just need to read the new docs :D https://docs.openwebui.com/tutorial/litellm Maybe decouple litellm would nevertheless be a good idea.. but will close for noe
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
confirmed
confirmed issue
core
documentation
enhancement
good first issue
help wanted
non-core
pull-request
Mirrored from GitHub Pull Request
 python
question
testing wanted
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#12252
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?