github-starred/open-webui
2
0
Fork 0
mirror of https://github.com/open-webui/open-webui.git synced 2026-05-07 11:28:35 -05:00
Code Issues 1.3k Packages Projects Releases 126 Wiki Activity

[GH-ISSUE #4348] Bug: v0.3.11 - Load models from OpenAI-compatible API without auth #29104

New Issue
Closed
opened 2026-04-25 03:33:21 -05:00 by GiteaMirror · 2 comments
GiteaMirror commented 2026-04-25 03:33:21 -05:00
Owner
Copy Link

Originally created by @av on GitHub (Aug 4, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/4348

Bug Report

Description

Bug Summary:
Open WebUI doesn't load models from OpenAI-compatible backends that do not require an API key

Steps to Reproduce:

  1. Configure Open WebUI with only an OpenAI connection that doesn't have an API key
{
  "openai": {
    "api_base_urls": [
      "http://litellm:4000/v1"
    ],
    "api_keys": [
      ""
    ],
    "enabled": true
  }
}
  1. Load Open WebUI
  2. Open the network browser dev tool
  3. Open the "Model List" dropdown

Expected Behavior:
GET /api/models - loads models from the endpoint

Actual Behavior:
GET /api/models - responds with an empty list

Environment

  • Open WebUI Version: [e.g., 0.3.11]

Reproduction Details

Confirmation:

  • I have read and followed all the instructions provided in the README.md.
  • I am on the latest version of both Open WebUI and Ollama.
  • I have included the browser console logs.
  • I have included the Docker container logs.

Logs and Screenshots

Note, that adjusting the config to:

{
  "openai": {
    "api_base_urls": [
      "http://litellm:4000/v1"
    ],
    "api_keys": [
      "sk-fake-api-key"
    ],
    "enabled": true
  }
}

And then the model list is populated correctly

Browser Console Logs:

Backend config: {status: true, name: 'Harbor (Open WebUI)', version: '0.3.10', default_locale: '', default_models: null, …}
0.04e6f1aa.js:1 user-count {count: 1}
0.04e6f1aa.js:1 usage {models: Array(0)}models: [][[Prototype]]: Object

Docker Container Logs:

Details 

harbor.webui  | INFO:config:GLOBAL_LOG_LEVEL: DEBUG
harbor.webui  | INFO:config:AUDIO_LOG_LEVEL: DEBUG
harbor.webui  | INFO:config:COMFYUI_LOG_LEVEL: DEBUG
harbor.webui  | INFO:config:CONFIG_LOG_LEVEL: DEBUG
harbor.webui  | INFO:config:DB_LOG_LEVEL: DEBUG
harbor.webui  | INFO:config:IMAGES_LOG_LEVEL: DEBUG
harbor.webui  | INFO:config:MAIN_LOG_LEVEL: DEBUG
harbor.webui  | INFO:config:MODELS_LOG_LEVEL: DEBUG
harbor.webui  | INFO:config:OLLAMA_LOG_LEVEL: DEBUG
harbor.webui  | INFO:config:OPENAI_LOG_LEVEL: DEBUG
harbor.webui  | INFO:config:RAG_LOG_LEVEL: DEBUG
harbor.webui  | INFO:config:WEBHOOK_LOG_LEVEL: DEBUG
harbor.webui  | INFO:config:'OPENAI_API_KEYS' loaded from config.json
harbor.webui  | INFO:config:'OPENAI_API_BASE_URLS' loaded from config.json
harbor.webui  | INFO:config:Embedding model set: sentence-transformers/all-MiniLM-L6-v2
harbor.webui  | DEBUG:chromadb.config:Starting component System
harbor.webui  | DEBUG:chromadb.config:Starting component Posthog
harbor.webui  | DEBUG:chromadb.config:Starting component OpenTelemetryClient
harbor.webui  | DEBUG:chromadb.config:Starting component SqliteDB
harbor.webui  | DEBUG:chromadb.config:Starting component QuotaEnforcer
harbor.webui  | DEBUG:chromadb.config:Starting component LocalSegmentManager
harbor.webui  | DEBUG:chromadb.config:Starting component SegmentAPI
harbor.webui  | INFO:apps.webui.internal.wrappers:Connected to SQLite database
harbor.webui  | INFO:apps.webui.internal.db:Starting migrations
harbor.webui  | DEBUG:peewee:('CREATE TABLE IF NOT EXISTS "migratehistory" ("id" INTEGER NOT NULL PRIMARY KEY, "name" VARCHAR(255) NOT NULL, "migrated_at" DATETIME NOT NULL)', [])
harbor.webui  | DEBUG:peewee:('SELECT "t1"."id", "t1"."name", "t1"."migrated_at" FROM "migratehistory" AS "t1" ORDER BY "t1"."id"', [])
harbor.webui  | INFO:apps.webui.internal.db:There is nothing to migrate
harbor.webui  | DEBUG:passlib.utils.compat:loaded lazy attr 'SafeConfigParser': <class 'configparser.ConfigParser'>
harbor.webui  | DEBUG:passlib.utils.compat:loaded lazy attr 'NativeStringIO': <class '_io.StringIO'>
harbor.webui  | DEBUG:passlib.utils.compat:loaded lazy attr 'BytesIO': <class '_io.BytesIO'>
harbor.webui  | INFO:apps.audio.main:whisper_device_type: cpu
harbor.webui  | WARNING:langchain_community.utils.user_agent:USER_AGENT environment variable not set, consider setting it to identify your requests.
harbor.webui  | DEBUG:apps.rag.utils:model: sentence-transformers/all-MiniLM-L6-v2
harbor.webui  | DEBUG:apps.rag.utils:snapshot_kwargs: {'cache_dir': '/app/backend/data/cache/embedding/models', 'local_files_only': True}
harbor.webui  | DEBUG:apps.rag.utils:model_repo_path: /app/backend/data/cache/embedding/models/models--sentence-transformers--all-MiniLM-L6-v2/snapshots/8b3219a92973c328a8e22fadcfa821b5dc75636a
harbor.webui  | INFO:sentence_transformers.SentenceTransformer:Load pretrained SentenceTransformer: /app/backend/data/cache/embedding/models/models--sentence-transformers--all-MiniLM-L6-v2/snapshots/8b3219a92973c328a8e22fadcfa821b5dc75636a
harbor.webui  | INFO:     Started server process [10]
harbor.webui  | INFO:     Waiting for application startup.
harbor.webui  | 
harbor.webui  |   ___                    __        __   _     _   _ ___ 
harbor.webui  |  / _ \ _ __   ___ _ __   \ \      / /__| |__ | | | |_ _|
harbor.webui  | | | | | '_ \ / _ \ '_ \   \ \ /\ / / _ \ '_ \| | | || | 
harbor.webui  | | |_| | |_) |  __/ | | |   \ V  V /  __/ |_) | |_| || | 
harbor.webui  |  \___/| .__/ \___|_| |_|    \_/\_/ \___|_.__/ \___/|___|
harbor.webui  |       |_|                                               
harbor.webui  | 
harbor.webui  |       
harbor.webui  | v0.3.10 - building the best open-source AI user interface.
harbor.webui  | 
harbor.webui  | https://github.com/open-webui/open-webui
harbor.webui  | 
harbor.webui  | INFO  [alembic.runtime.migration] Context impl SQLiteImpl.
harbor.webui  | INFO  [alembic.runtime.migration] Will assume non-transactional DDL.
harbor.webui  | INFO:     Application startup complete.
harbor.webui  | INFO:     Uvicorn running on http://0.0.0.0:8080 (Press CTRL+C to quit)
harbor.webui  | INFO  [apps.openai.main] get_all_models()
harbor.webui  | INFO  [apps.ollama.main] get_all_models()
harbor.webui  | ERROR [apps.ollama.main] Connection error: Cannot connect to host host.docker.internal:11434 ssl:default [Name or service not known]
harbor.webui  | DEBUG [main] Commit session after request
harbor.webui  | INFO:     172.31.0.1:34460 - "GET /ws/socket.io/?EIO=4&transport=polling&t=P4TUaWv HTTP/1.1" 200 OK
harbor.webui  | INFO  [apps.openai.main] get_all_models()
harbor.webui  | INFO  [apps.ollama.main] get_all_models()
harbor.webui  | INFO:     ('172.31.0.1', 34470) - "WebSocket /ws/socket.io/?EIO=4&transport=websocket&sid=WW9mrSVpYo33cNimAAAA" [accepted]
harbor.webui  | INFO:     connection open
harbor.webui  | INFO  [apps.openai.main] get_all_models()
harbor.webui  | INFO  [apps.ollama.main] get_all_models()
harbor.webui  | ERROR [apps.ollama.main] Connection error: Cannot connect to host host.docker.internal:11434 ssl:default [Name or service not known]
harbor.webui  | ERROR [apps.ollama.main] Connection error: Cannot connect to host host.docker.internal:11434 ssl:default [Name or service not known]
harbor.webui  | DEBUG [main] Commit session after request
harbor.webui  | user av(d4e2487c-acc8-4474-a682-d683b27dc2af) connected with session ID XNKFzbKCaT_JakCOAAAB
harbor.webui  | INFO:     172.31.0.1:34472 - "GET /ws/socket.io/?EIO=4&transport=polling&t=P4TUaY2&sid=WW9mrSVpYo33cNimAAAA HTTP/1.1" 200 OK
harbor.webui  | DEBUG [main] Commit session after request
harbor.webui  | INFO:     172.31.0.1:34460 - "POST /ws/socket.io/?EIO=4&transport=polling&t=P4TUaY1&sid=WW9mrSVpYo33cNimAAAA HTTP/1.1" 200 OK

Installation Method

Docker Compose installation

Originally created by @av on GitHub (Aug 4, 2024). Original GitHub issue: https://github.com/open-webui/open-webui/issues/4348 # Bug Report ## Description **Bug Summary:** Open WebUI doesn't load models from OpenAI-compatible backends that do not require an API key **Steps to Reproduce:** 1. Configure Open WebUI with only an OpenAI connection that doesn't have an API key ```json { "openai": { "api_base_urls": [ "http://litellm:4000/v1" ], "api_keys": [ "" ], "enabled": true } } ``` 2. Load Open WebUI 3. Open the network browser dev tool 4. Open the "Model List" dropdown **Expected Behavior:** `GET /api/models` - loads models from the endpoint **Actual Behavior:** `GET /api/models` - responds with an empty list ## Environment - **Open WebUI Version:** [e.g., 0.3.11] ## Reproduction Details **Confirmation:** - [x] I have read and followed all the instructions provided in the README.md. - [x] I am on the latest version of both Open WebUI and Ollama. - [x] I have included the browser console logs. - [x] I have included the Docker container logs. ## Logs and Screenshots Note, that adjusting the config to: ```json { "openai": { "api_base_urls": [ "http://litellm:4000/v1" ], "api_keys": [ "sk-fake-api-key" ], "enabled": true } } ``` And then the model list is populated correctly **Browser Console Logs:** ```bash Backend config: {status: true, name: 'Harbor (Open WebUI)', version: '0.3.10', default_locale: '', default_models: null, …} 0.04e6f1aa.js:1 user-count {count: 1} 0.04e6f1aa.js:1 usage {models: Array(0)}models: [][[Prototype]]: Object ``` **Docker Container Logs:** <details><summary>Details</summary> <p> ```bash harbor.webui | INFO:config:GLOBAL_LOG_LEVEL: DEBUG harbor.webui | INFO:config:AUDIO_LOG_LEVEL: DEBUG harbor.webui | INFO:config:COMFYUI_LOG_LEVEL: DEBUG harbor.webui | INFO:config:CONFIG_LOG_LEVEL: DEBUG harbor.webui | INFO:config:DB_LOG_LEVEL: DEBUG harbor.webui | INFO:config:IMAGES_LOG_LEVEL: DEBUG harbor.webui | INFO:config:MAIN_LOG_LEVEL: DEBUG harbor.webui | INFO:config:MODELS_LOG_LEVEL: DEBUG harbor.webui | INFO:config:OLLAMA_LOG_LEVEL: DEBUG harbor.webui | INFO:config:OPENAI_LOG_LEVEL: DEBUG harbor.webui | INFO:config:RAG_LOG_LEVEL: DEBUG harbor.webui | INFO:config:WEBHOOK_LOG_LEVEL: DEBUG harbor.webui | INFO:config:'OPENAI_API_KEYS' loaded from config.json harbor.webui | INFO:config:'OPENAI_API_BASE_URLS' loaded from config.json harbor.webui | INFO:config:Embedding model set: sentence-transformers/all-MiniLM-L6-v2 harbor.webui | DEBUG:chromadb.config:Starting component System harbor.webui | DEBUG:chromadb.config:Starting component Posthog harbor.webui | DEBUG:chromadb.config:Starting component OpenTelemetryClient harbor.webui | DEBUG:chromadb.config:Starting component SqliteDB harbor.webui | DEBUG:chromadb.config:Starting component QuotaEnforcer harbor.webui | DEBUG:chromadb.config:Starting component LocalSegmentManager harbor.webui | DEBUG:chromadb.config:Starting component SegmentAPI harbor.webui | INFO:apps.webui.internal.wrappers:Connected to SQLite database harbor.webui | INFO:apps.webui.internal.db:Starting migrations harbor.webui | DEBUG:peewee:('CREATE TABLE IF NOT EXISTS "migratehistory" ("id" INTEGER NOT NULL PRIMARY KEY, "name" VARCHAR(255) NOT NULL, "migrated_at" DATETIME NOT NULL)', []) harbor.webui | DEBUG:peewee:('SELECT "t1"."id", "t1"."name", "t1"."migrated_at" FROM "migratehistory" AS "t1" ORDER BY "t1"."id"', []) harbor.webui | INFO:apps.webui.internal.db:There is nothing to migrate harbor.webui | DEBUG:passlib.utils.compat:loaded lazy attr 'SafeConfigParser': <class 'configparser.ConfigParser'> harbor.webui | DEBUG:passlib.utils.compat:loaded lazy attr 'NativeStringIO': <class '_io.StringIO'> harbor.webui | DEBUG:passlib.utils.compat:loaded lazy attr 'BytesIO': <class '_io.BytesIO'> harbor.webui | INFO:apps.audio.main:whisper_device_type: cpu harbor.webui | WARNING:langchain_community.utils.user_agent:USER_AGENT environment variable not set, consider setting it to identify your requests. harbor.webui | DEBUG:apps.rag.utils:model: sentence-transformers/all-MiniLM-L6-v2 harbor.webui | DEBUG:apps.rag.utils:snapshot_kwargs: {'cache_dir': '/app/backend/data/cache/embedding/models', 'local_files_only': True} harbor.webui | DEBUG:apps.rag.utils:model_repo_path: /app/backend/data/cache/embedding/models/models--sentence-transformers--all-MiniLM-L6-v2/snapshots/8b3219a92973c328a8e22fadcfa821b5dc75636a harbor.webui | INFO:sentence_transformers.SentenceTransformer:Load pretrained SentenceTransformer: /app/backend/data/cache/embedding/models/models--sentence-transformers--all-MiniLM-L6-v2/snapshots/8b3219a92973c328a8e22fadcfa821b5dc75636a harbor.webui | INFO: Started server process [10] harbor.webui | INFO: Waiting for application startup. harbor.webui | harbor.webui | ___ __ __ _ _ _ ___ harbor.webui | / _ \ _ __ ___ _ __ \ \ / /__| |__ | | | |_ _| harbor.webui | | | | | '_ \ / _ \ '_ \ \ \ /\ / / _ \ '_ \| | | || | harbor.webui | | |_| | |_) | __/ | | | \ V V / __/ |_) | |_| || | harbor.webui | \___/| .__/ \___|_| |_| \_/\_/ \___|_.__/ \___/|___| harbor.webui | |_| harbor.webui | harbor.webui | harbor.webui | v0.3.10 - building the best open-source AI user interface. harbor.webui | harbor.webui | https://github.com/open-webui/open-webui harbor.webui | harbor.webui | INFO [alembic.runtime.migration] Context impl SQLiteImpl. harbor.webui | INFO [alembic.runtime.migration] Will assume non-transactional DDL. harbor.webui | INFO: Application startup complete. harbor.webui | INFO: Uvicorn running on http://0.0.0.0:8080 (Press CTRL+C to quit) harbor.webui | INFO [apps.openai.main] get_all_models() harbor.webui | INFO [apps.ollama.main] get_all_models() harbor.webui | ERROR [apps.ollama.main] Connection error: Cannot connect to host host.docker.internal:11434 ssl:default [Name or service not known] harbor.webui | DEBUG [main] Commit session after request harbor.webui | INFO: 172.31.0.1:34460 - "GET /ws/socket.io/?EIO=4&transport=polling&t=P4TUaWv HTTP/1.1" 200 OK harbor.webui | INFO [apps.openai.main] get_all_models() harbor.webui | INFO [apps.ollama.main] get_all_models() harbor.webui | INFO: ('172.31.0.1', 34470) - "WebSocket /ws/socket.io/?EIO=4&transport=websocket&sid=WW9mrSVpYo33cNimAAAA" [accepted] harbor.webui | INFO: connection open harbor.webui | INFO [apps.openai.main] get_all_models() harbor.webui | INFO [apps.ollama.main] get_all_models() harbor.webui | ERROR [apps.ollama.main] Connection error: Cannot connect to host host.docker.internal:11434 ssl:default [Name or service not known] harbor.webui | ERROR [apps.ollama.main] Connection error: Cannot connect to host host.docker.internal:11434 ssl:default [Name or service not known] harbor.webui | DEBUG [main] Commit session after request harbor.webui | user av(d4e2487c-acc8-4474-a682-d683b27dc2af) connected with session ID XNKFzbKCaT_JakCOAAAB harbor.webui | INFO: 172.31.0.1:34472 - "GET /ws/socket.io/?EIO=4&transport=polling&t=P4TUaY2&sid=WW9mrSVpYo33cNimAAAA HTTP/1.1" 200 OK harbor.webui | DEBUG [main] Commit session after request harbor.webui | INFO: 172.31.0.1:34460 - "POST /ws/socket.io/?EIO=4&transport=polling&t=P4TUaY1&sid=WW9mrSVpYo33cNimAAAA HTTP/1.1" 200 OK ``` </p> </details> ## Installation Method Docker Compose installation
GiteaMirror commented 2026-04-25 03:33:22 -05:00
Author
Owner
Copy Link

@tjbck commented on GitHub (Aug 4, 2024):

This is an expected behaviour!

<!-- gh-comment-id:2267539630 --> @tjbck commented on GitHub (Aug 4, 2024): This is an expected behaviour!
GiteaMirror commented 2026-04-25 03:33:23 -05:00
Author
Owner
Copy Link

@av commented on GitHub (Aug 4, 2024):

Understood, thank you for taking a look!

<!-- gh-comment-id:2267550719 --> @av commented on GitHub (Aug 4, 2024): Understood, thank you for taking a look!
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
confirmed
confirmed issue
core
documentation
enhancement
good first issue
help wanted
non-core
pull-request
Mirrored from GitHub Pull Request
 python
question
testing wanted
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#29104
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?