[GH-ISSUE #5842] Openai API broken with llama.cpp #101140

Closed
opened 2026-05-17 22:46:34 -05:00 by GiteaMirror · 0 comments
Owner

Originally created by @inversetrs on GitHub (Oct 1, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/5842

Bug Report

Installation Method

[Describe the method you used to install the project, e.g., git clone, Docker, pip, etc.]

Environment

  • **Open WebUI Version: git master

  • **Operating System: Linux

Confirmation:

  • [x ] I have read and followed all the instructions provided in the README.md.
  • [ x] I am on the latest version of both Open WebUI and Ollama.
  • I have included the browser console logs.
  • [ x] I have included the Docker container logs.
  • [ x] I have provided the exact steps to reproduce the bug in the "Steps to Reproduce" section below.

Expected Behavior:

Get available model in the interface

Actual Behavior:

Connects to openapi llama.cpp server, gets correct response, but the interface show no models available.

Description

Bug Summary:
It used to work a few weeks ago, something got lost in the latest commits.

Reproduction Details

Steps to Reproduce:
Starts lamma.cpp server, add data in the admin panel, connection sucessfull, get_all_models does not return an error, however, no model shows up in the interface.

Additional Information

localhost/v1/models returns the loaded model correctly.

Originally created by @inversetrs on GitHub (Oct 1, 2024). Original GitHub issue: https://github.com/open-webui/open-webui/issues/5842 # Bug Report ## Installation Method [Describe the method you used to install the project, e.g., git clone, Docker, pip, etc.] ## Environment - **Open WebUI Version: git master - **Operating System: Linux **Confirmation:** - [x ] I have read and followed all the instructions provided in the README.md. - [ x] I am on the latest version of both Open WebUI and Ollama. - [ ] I have included the browser console logs. - [ x] I have included the Docker container logs. - [ x] I have provided the exact steps to reproduce the bug in the "Steps to Reproduce" section below. ## Expected Behavior: Get available model in the interface ## Actual Behavior: Connects to openapi llama.cpp server, gets correct response, but the interface show no models available. ## Description **Bug Summary:** It used to work a few weeks ago, something got lost in the latest commits. ## Reproduction Details **Steps to Reproduce:** Starts lamma.cpp server, add data in the admin panel, connection sucessfull, get_all_models does not return an error, however, no model shows up in the interface. ## Additional Information localhost/v1/models returns the loaded model correctly.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#101140