github-starred/open-webui
2
0
Fork 0
mirror of https://github.com/open-webui/open-webui.git synced 2026-03-11 00:04:08 -05:00
Code Issues 308 Packages Projects Releases 100 Wiki Activity

openai compatible API fails on other local interfaces #723

New Issue
Closed
opened 2025-11-11 14:29:52 -06:00 by GiteaMirror · 3 comments
GiteaMirror commented 2025-11-11 14:29:52 -06:00
Owner
Copy Link

Originally created by @BarfingLemurs on GitHub (Apr 24, 2024).

Is your feature request related to a problem? Please describe.

TabbyAPI and text-gen-webui are popular interfaces for run performant gpu quantizations, specifically the exl2 quantizations.

I tried running each, text-gen-webui with no API key, and tabbyAPI with its key.

I'm not able to see text-gen-webui models or get something working there, but for tabbyAPI I can see the available models, and can select the current one loaded. However, the response I get it always a single word:

https://imgur.com/a/9hjoRFh

Info

After login, go to Newchat > settings connections > show openai API http://192.168.1.4:5000/v1 & key

Standard cpu docker installation, then went to localhost:3000

tabbyAPI log: https://pastebin.com/KnBmZtp3

linux, Firefox browser

Originally created by @BarfingLemurs on GitHub (Apr 24, 2024). **Is your feature request related to a problem? Please describe.** TabbyAPI and text-gen-webui are popular interfaces for run performant gpu quantizations, specifically the exl2 quantizations. I tried running each, text-gen-webui with no API key, and tabbyAPI with its key. I'm not able to see text-gen-webui models or get something working there, but for tabbyAPI I can see the available models, and can select the current one loaded. However, the response I get it always a single word: https://imgur.com/a/9hjoRFh ### Info After login, go to Newchat > settings connections > show openai API http://192.168.1.4:5000/v1 & key Standard cpu docker installation, then went to localhost:3000 tabbyAPI log: https://pastebin.com/KnBmZtp3 linux, Firefox browser
GiteaMirror commented 2025-11-11 14:29:53 -06:00
Author
Owner
Copy Link

@tjbck commented on GitHub (Apr 24, 2024):

A

@tjbck commented on GitHub (Apr 24, 2024): A
GiteaMirror commented 2025-11-11 14:29:53 -06:00
Author
Owner
Copy Link

@tjbck commented on GitHub (Apr 24, 2024):

I'm just kidding 😂 That's strange, I'll take a look!

@tjbck commented on GitHub (Apr 24, 2024): I'm just kidding 😂 That's strange, I'll take a look!
GiteaMirror commented 2025-11-11 14:29:54 -06:00
Author
Owner
Copy Link

@justinh-rahb commented on GitHub (Apr 24, 2024):

OpenAI API endpoint configurations need to have an API key or it won't activate.

@justinh-rahb commented on GitHub (Apr 24, 2024): OpenAI API endpoint configurations need to have an API key or it won't activate.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
core
documentation
enhancement
good first issue
help wanted
non-core
pull-request
Mirrored from GitHub Pull Request
 python
question
testing wanted
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#723
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?