github-starred/open-webui
2
0
Fork 0
mirror of https://github.com/open-webui/open-webui.git synced 2026-07-16 06:03:26 -05:00
Code Issues 2.4k Packages Projects Releases 129 Wiki Activity

[PR #24546] [CLOSED] fix: llamacpp load/unload indicator now detects loaded models via /slots #98755

New Issue
Closed
opened 2026-05-16 01:36:05 -05:00 by GiteaMirror · 0 comments
GiteaMirror commented 2026-05-16 01:36:05 -05:00
Owner
Copy Link

📋 Pull Request Information

Original PR: https://github.com/open-webui/open-webui/pull/24546
Author: @kimjune01
Created: 5/10/2026
Status: ❌ Closed

Base: dev ← Head: fix-llamacpp-load-indicator-24544

📝 Commits (10+)

📊 Changes

1 file changed (+75 additions, -2 deletions)

View changed files

📝 backend/open_webui/utils/models.py (+75 -2)

📄 Description

The current load indicator treats a model as loaded only when /api/tags includes expires_at, which is standard Ollama behavior. llama.cpp-compatible servers can keep models loaded in /slots, but their /api/tags response does not include expires_at, so open-webui shows those models as unloaded.

This change adds per-backend detection for /slots support. During model refresh, open-webui fetches /api/tags and, unless the backend is already known not to support it, probes /slots concurrently. A 200 response caches that backend as supporting /slots; a 404 caches it as not supporting /slots; transient failures such as timeouts or 5xx responses are logged but not cached.

The load indicator now treats a model as loaded when either:

  1. /api/tags includes expires_at
  2. the same backend's /slots response contains that model ID

For llama.cpp --models-preset, this matches preset names directly when the same identifier appears in both /api/tags and /slots. When prefix_id is configured, both raw and prefixed model IDs are checked.

This preserves Ollama behavior while correctly showing llama.cpp slot-loaded models as loaded, without repeatedly probing /slots on backends that return 404.

Fixes #24544.

Contributor License Agreement

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/open-webui/open-webui/pull/24546 **Author:** [@kimjune01](https://github.com/kimjune01) **Created:** 5/10/2026 **Status:** ❌ Closed **Base:** `dev` ← **Head:** `fix-llamacpp-load-indicator-24544` --- ### 📝 Commits (10+) - [`fe6783c`](https://github.com/open-webui/open-webui/commit/fe6783c16699911c7be17392596d579333fb110c) Merge pull request #19030 from open-webui/dev - [`fc05e0a`](https://github.com/open-webui/open-webui/commit/fc05e0a6c5d39da60b603b4d520f800d6e36f748) Merge pull request #19405 from open-webui/dev - [`e3faec6`](https://github.com/open-webui/open-webui/commit/e3faec62c58e3a83d89aa3df539feacefa125e0c) Merge pull request #19416 from open-webui/dev - [`9899293`](https://github.com/open-webui/open-webui/commit/9899293f050ad50ae12024cbebee7e018acd851e) Merge pull request #19448 from open-webui/dev - [`140605e`](https://github.com/open-webui/open-webui/commit/140605e660b8186a7d5c79fb3be6ffb147a2f498) Merge pull request #19462 from open-webui/dev - [`6f1486f`](https://github.com/open-webui/open-webui/commit/6f1486ffd0cb288d0e21f41845361924e0d742b3) Merge pull request #19466 from open-webui/dev - [`d95f533`](https://github.com/open-webui/open-webui/commit/d95f533214e3fe5beb5e41ec1f349940bc4c7043) Merge pull request #19729 from open-webui/dev - [`a727153`](https://github.com/open-webui/open-webui/commit/a7271532f8a38da46785afcaa7e65f9a45e7d753) 0.6.43 (#20093) - [`6adde20`](https://github.com/open-webui/open-webui/commit/6adde203cd292a9e3af9c64a2ae36b603fed096a) Merge pull request #20394 from open-webui/dev - [`f9b0534`](https://github.com/open-webui/open-webui/commit/f9b0534e0c442631d1cb7205169588b9b6204179) Merge pull request #20522 from open-webui/dev ### 📊 Changes **1 file changed** (+75 additions, -2 deletions) <details> <summary>View changed files</summary> 📝 `backend/open_webui/utils/models.py` (+75 -2) </details> ### 📄 Description The current load indicator treats a model as loaded only when `/api/tags` includes `expires_at`, which is standard Ollama behavior. llama.cpp-compatible servers can keep models loaded in `/slots`, but their `/api/tags` response does not include `expires_at`, so open-webui shows those models as unloaded. This change adds per-backend detection for `/slots` support. During model refresh, open-webui fetches `/api/tags` and, unless the backend is already known not to support it, probes `/slots` concurrently. A `200` response caches that backend as supporting `/slots`; a `404` caches it as not supporting `/slots`; transient failures such as timeouts or 5xx responses are logged but not cached. The load indicator now treats a model as loaded when either: 1. `/api/tags` includes `expires_at` 2. the same backend's `/slots` response contains that model ID For llama.cpp `--models-preset`, this matches preset names directly when the same identifier appears in both `/api/tags` and `/slots`. When `prefix_id` is configured, both raw and prefixed model IDs are checked. This preserves Ollama behavior while correctly showing llama.cpp slot-loaded models as loaded, without repeatedly probing `/slots` on backends that return `404`. Fixes #24544. ### Contributor License Agreement - [x] By submitting this pull request, I confirm that I have read and fully agree to the [Contributor License Agreement (CLA)](https://github.com/open-webui/open-webui/blob/main/CONTRIBUTOR_LICENSE_AGREEMENT), and I am providing my contributions under its terms. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
GiteaMirror added the pull-request label 2026-05-16 01:36:05 -05:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
confirmed
confirmed issue
core
documentation
enhancement
good first issue
help wanted
non-core
pull-request
Mirrored from GitHub Pull Request
 python
question
testing wanted
No Label pull-request
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#98755
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?