mirror of
https://github.com/open-webui/open-webui.git
synced 2026-05-06 19:08:59 -05:00
[GH-ISSUE #4243] Playground text completion queries to /v1/chat/completions instead of /v1/completions? #29071
No Assignees
Notifications
Due Date
No due date set.
Dependencies
No dependencies set.
Reference: github-starred/open-webui#29071
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @Chris-Tran-2023 on GitHub (Jul 31, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/4243
I am using Aphrodite-engine for hosting Mixtral-8x7b using exllamav2 quantization. I have connected to it via the OpenAI API connection in the settings. I was planning to use Open-WebUI for serving chat to multiple users, but also wanted to keep the completions/generation, like in text-generation-webUI's notebook mode. I thought the Playground should function similar, using the text completion switch. My expectation is this should query to /v1/completions, rather than /v1/chat/completions, but my log in aphrodite shows POST ot /v1/chat/completions. Is this intended behavior? Screenshots below