[GH-ISSUE #1012] Connect, pull & delete models working, but cannot select model to chat #50963

New Issue

Closed

opened 2026-05-05 11:39:33 -05:00 by GiteaMirror · 5 comments

GiteaMirror commented 2026-05-05 11:39:33 -05:00

Owner

Copy Link

Originally created by @suderman on GitHub (Mar 3, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/1012

Bug Report

Description

Bug Summary:
I can connect to Ollama, pull and delete models, but I cannot select a model.

Steps to Reproduce:

1. Ollama is running in background via systemd service (NixOS). Open WebUI is running in docker container on same system.
2. Login to Open WebUI
3. Settings > Connections > Ollama Base URL is already set to http://host.docker.internal:11434 and clicking button displays: "Server connection verified"
4. Settings > Models > Pull a model from Ollama.com > phi:latest and clicking the button displays: "Model 'phi:latest' has been successfully downloaded."
5. New Chat > Select a model > phi:latest > and clicking "Set as default" displays: "Default model updated"
6. Type "hello" into input field and hit enter displays two errors: "Ollama: model is required" and "Uh-oh! There was an issue connecting to Ollama."

Expected Behavior:
Ollama to greet to say hello back.

Actual Behavior:
Error connecting to Ollama. Appears the UI is not setting and/or providing a selected model to the backend.

Environment

• NixOS 23.11
• Firefox 122.0.1

Reproduction Details

Confirmation:

• I have read and followed all the instructions provided in the README.md.
• I have reviewed the troubleshooting.md document.
• I have included the browser console logs.
• I have included the Docker container logs.

Logs and Screenshots

Browser Console Logs:

Docker Container Logs:

INFO:     10.1.0.4:0 - "GET / HTTP/1.1" 304 Not Modified
INFO:     10.1.0.4:0 - "GET /api/config HTTP/1.1" 200 OK
INFO:     10.1.0.4:0 - "GET /api/v1/auths/ HTTP/1.1" 200 OK
INFO:     10.1.0.4:0 - "GET /ollama/api/api/tags HTTP/1.1" 200 OK
https://api.openai.com/v1/models 
INFO:     10.1.0.4:0 - "GET /openai/api/models HTTP/1.1" 401 Unauthorized
id='b088ff91-2bf6-401c-9e30-44a37c6d3a8c' name='Jon Suderman' email='jon@suderman.net' role='admin' profile_image_url='https://www.gravatar.com/avatar/b30502e9e12fe8ffda4ea22e1a0888b339cc44e4e1f528c8b6094aa1264f62e2?d=mp' timestamp=1709417342
INFO:     10.1.0.4:0 - "GET /litellm/api/v1/models HTTP/1.1" 200 OK
INFO:     10.1.0.4:0 - "GET /api/v1/modelfiles/ HTTP/1.1" 200 OK
INFO:     10.1.0.4:0 - "GET /api/v1/prompts/ HTTP/1.1" 200 OK
INFO:     10.1.0.4:0 - "GET /api/v1/documents/ HTTP/1.1" 200 OK
INFO:     10.1.0.4:0 - "GET /api/v1/chats/tags/all HTTP/1.1" 200 OK
INFO:     10.1.0.4:0 - "GET /api/changelog HTTP/1.1" 200 OK
INFO:     10.1.0.4:0 - "GET /api/v1/chats/ HTTP/1.1" 200 OK
INFO:     10.1.0.4:0 - "GET /ollama/api/api/tags HTTP/1.1" 200 OK
https://api.openai.com/v1/models 
INFO:     10.1.0.4:0 - "GET /openai/api/models HTTP/1.1" 401 Unauthorized
id='b088ff91-2bf6-401c-9e30-44a37c6d3a8c' name='Jon Suderman' email='jon@suderman.net' role='admin' profile_image_url='https://www.gravatar.com/avatar/b30502e9e12fe8ffda4ea22e1a0888b339cc44e4e1f528c8b6094aa1264f62e2?d=mp' timestamp=1709417342
INFO:     10.1.0.4:0 - "GET /litellm/api/v1/models HTTP/1.1" 200 OK
INFO:     10.1.0.4:0 - "POST /api/v1/configs/default/models HTTP/1.1" 200 OK
INFO:     10.1.0.4:0 - "POST /api/v1/chats/new HTTP/1.1" 200 OK
INFO:     10.1.0.4:0 - "GET /api/v1/chats/ HTTP/1.1" 200 OK
INFO:     10.1.0.4:0 - "POST /ollama/api/api/chat HTTP/1.1" 500 Internal Server Error
INFO:     10.1.0.4:0 - "POST /ollama/api/api/generate HTTP/1.1" 500 Internal Server Error

Screenshots (if applicable):

Installation Method

I'm using the ollama service found in NixOS unstable here as part of a custom module that runs the ghcr.io/open-webui/open-webui image in a docker container. Here's my custom nixos module:

{ config, lib, pkgs, this, inputs, ... }: 

let 

  cfg = config.modules.ollama;
  inherit (builtins) toString;
  inherit (lib) mkIf mkOption mkBefore types;
  inherit (config.modules) traefik;
  inherit (this.lib) destabilize;

  # https://github.com/open-webui/open-webui
  tag = "main";
  dataDir = "/var/lib/ollama";
  port = 11434;
  webPort = 8080;

in {

  imports = 

    # Unstable upstream nixos module
    # https://github.com/NixOS/nixpkgs/blob/nixos-unstable/nixos/modules/services/misc/ollama.nix
    ( destabilize inputs.nixpkgs-unstable "services/misc/ollama.nix" );

  options.modules.ollama = {
    enable = lib.options.mkEnableOption "ollama"; 
  };

  config = mkIf cfg.enable {

    # Ensure data directory exists with expected ownership
    file."${dataDir}/webui" = { 
      type = "dir"; 
      mode = 775; 
      user = "ollama";
      group = "ollama";
    };

    # Enable ollama and listen on all addresses
    services.ollama = {
      enable = true;
      package = pkgs.unstable.ollama;
      listenAddress = "0.0.0.0:${toString port}";
    };

    # Server back-end
    virtualisation.oci-containers.containers.open-webui = {
      image = "ghcr.io/open-webui/open-webui:${tag}";

      # Map volumes to host
      volumes = [ 
        "${dataDir}/webui:/app/backend/data"
      ];

      environment = {
        WEBUI_SECRET_KEY = "vrE43JBRQHd6hc7sucdJvJV1FJjd5O4Rn2hf63jd8hnhG3feTajkA";
      };

      # Traefik labels
      extraOptions = traefik.labels [ "ai" webPort ]

      # Networking
      ++ [ "--add-host=host.docker.internal:host-gateway" ];

    };

    # Open up the firewall for ollama
    networking.firewall.allowedTCPPorts = [ port ];

    # Also serve ollama on reverse proxy
    modules.traefik = {
      enable = true;
      routers.ollama = "http://127.0.0.1:${toString port}";
    };

  };

}

Additional Information

I don't think it's a connection issue because I can communicate with ollama via curl from within the container. First I attach to the container and install curl:

docker exec -it open-webui bash 
apt-get update && apt-get install curl

And then I'm able to run curl host.docker.internal:11434/api/generate and say hello to with the following results:

root@366b18f61d6c:/app/backend# curl host.docker.internal:11434/api/generate -d '{ "model": "phi", "prompt": "hello" }'
{"model":"phi","created_at":"2024-03-03T17:56:25.134576211Z","response":" Hello","done":false}
{"model":"phi","created_at":"2024-03-03T17:56:25.214508503Z","response":",","done":false}
{"model":"phi","created_at":"2024-03-03T17:56:25.257896588Z","response":" how","done":false}
{"model":"phi","created_at":"2024-03-03T17:56:25.301435919Z","response":" can","done":false}
{"model":"phi","created_at":"2024-03-03T17:56:25.344804708Z","response":" I","done":false}
{"model":"phi","created_at":"2024-03-03T17:56:25.387875603Z","response":" assist","done":false}
{"model":"phi","created_at":"2024-03-03T17:56:25.43104759Z","response":" you","done":false}
{"model":"phi","created_at":"2024-03-03T17:56:25.474697863Z","response":" today","done":false}
{"model":"phi","created_at":"2024-03-03T17:56:25.523738373Z","response":"?","done":false}
{"model":"phi","created_at":"2024-03-03T17:56:25.567499029Z","response":"\n","done":false}
{"model":"phi","created_at":"2024-03-03T17:56:25.654656954Z","response":"","done":true,"context":[11964,25,317,8537,1022,257,11040,2836,290,281,11666,4430,8796,13,383,8796,3607,7613,7429,284,262,2836,338,2683,13,198,12982,25,23748,198,48902,25,18435,11,703,460,314,3342,345,1909,30,198],"total_duration":7640325193,"load_duration":754523608,"prompt_eval_count":32,"prompt_eval_duration":6365256000,"eval_count":12,"eval_duration":520109000}

Originally created by @suderman on GitHub (Mar 3, 2024). Original GitHub issue: https://github.com/open-webui/open-webui/issues/1012 # Bug Report ## Description **Bug Summary:** I can connect to Ollama, pull and delete models, but I cannot select a model. **Steps to Reproduce:** 1. Ollama is running in background via systemd service (NixOS). Open WebUI is running in docker container on same system. 2. Login to Open WebUI 3. Settings > Connections > Ollama Base URL is already set to `http://host.docker.internal:11434` and clicking button displays: _"Server connection verified"_ 4. Settings > Models > Pull a model from Ollama.com > `phi:latest` and clicking the button displays: _"Model 'phi:latest' has been successfully downloaded."_ 5. New Chat > Select a model > `phi:latest` > and clicking "Set as default" displays: _"Default model updated"_ 6. Type "hello" into input field and hit enter displays two errors: _"Ollama: model is required"_ and _"Uh-oh! There was an issue connecting to Ollama."_ **Expected Behavior:** Ollama to greet to say hello back. **Actual Behavior:** Error connecting to Ollama. Appears the UI is not setting and/or providing a selected model to the backend. ## Environment - NixOS 23.11 - Firefox 122.0.1 ## Reproduction Details **Confirmation:** - [x] I have read and followed all the instructions provided in the README.md. - [x] I have reviewed the troubleshooting.md document. - [x] I have included the browser console logs. - [x] I have included the Docker container logs. ## Logs and Screenshots **Browser Console Logs:**  **Docker Container Logs:** ``` INFO: 10.1.0.4:0 - "GET / HTTP/1.1" 304 Not Modified INFO: 10.1.0.4:0 - "GET /api/config HTTP/1.1" 200 OK INFO: 10.1.0.4:0 - "GET /api/v1/auths/ HTTP/1.1" 200 OK INFO: 10.1.0.4:0 - "GET /ollama/api/api/tags HTTP/1.1" 200 OK https://api.openai.com/v1/models INFO: 10.1.0.4:0 - "GET /openai/api/models HTTP/1.1" 401 Unauthorized id='b088ff91-2bf6-401c-9e30-44a37c6d3a8c' name='Jon Suderman' email='jon@suderman.net' role='admin' profile_image_url='https://www.gravatar.com/avatar/b30502e9e12fe8ffda4ea22e1a0888b339cc44e4e1f528c8b6094aa1264f62e2?d=mp' timestamp=1709417342 INFO: 10.1.0.4:0 - "GET /litellm/api/v1/models HTTP/1.1" 200 OK INFO: 10.1.0.4:0 - "GET /api/v1/modelfiles/ HTTP/1.1" 200 OK INFO: 10.1.0.4:0 - "GET /api/v1/prompts/ HTTP/1.1" 200 OK INFO: 10.1.0.4:0 - "GET /api/v1/documents/ HTTP/1.1" 200 OK INFO: 10.1.0.4:0 - "GET /api/v1/chats/tags/all HTTP/1.1" 200 OK INFO: 10.1.0.4:0 - "GET /api/changelog HTTP/1.1" 200 OK INFO: 10.1.0.4:0 - "GET /api/v1/chats/ HTTP/1.1" 200 OK INFO: 10.1.0.4:0 - "GET /ollama/api/api/tags HTTP/1.1" 200 OK https://api.openai.com/v1/models INFO: 10.1.0.4:0 - "GET /openai/api/models HTTP/1.1" 401 Unauthorized id='b088ff91-2bf6-401c-9e30-44a37c6d3a8c' name='Jon Suderman' email='jon@suderman.net' role='admin' profile_image_url='https://www.gravatar.com/avatar/b30502e9e12fe8ffda4ea22e1a0888b339cc44e4e1f528c8b6094aa1264f62e2?d=mp' timestamp=1709417342 INFO: 10.1.0.4:0 - "GET /litellm/api/v1/models HTTP/1.1" 200 OK INFO: 10.1.0.4:0 - "POST /api/v1/configs/default/models HTTP/1.1" 200 OK INFO: 10.1.0.4:0 - "POST /api/v1/chats/new HTTP/1.1" 200 OK INFO: 10.1.0.4:0 - "GET /api/v1/chats/ HTTP/1.1" 200 OK INFO: 10.1.0.4:0 - "POST /ollama/api/api/chat HTTP/1.1" 500 Internal Server Error INFO: 10.1.0.4:0 - "POST /ollama/api/api/generate HTTP/1.1" 500 Internal Server Error ``` **Screenshots (if applicable):**  ## Installation Method I'm using the ollama service found in NixOS unstable [here](https://search.nixos.org/options?channel=unstable&show=ollama&query=ollama) as part of a custom module that runs the [ghcr.io/open-webui/open-webui](https://github.com/open-webui/open-webui/releases) image in a docker container. Here's my custom nixos module: ```nix { config, lib, pkgs, this, inputs, ... }: let cfg = config.modules.ollama; inherit (builtins) toString; inherit (lib) mkIf mkOption mkBefore types; inherit (config.modules) traefik; inherit (this.lib) destabilize; # https://github.com/open-webui/open-webui tag = "main"; dataDir = "/var/lib/ollama"; port = 11434; webPort = 8080; in { imports = # Unstable upstream nixos module # https://github.com/NixOS/nixpkgs/blob/nixos-unstable/nixos/modules/services/misc/ollama.nix ( destabilize inputs.nixpkgs-unstable "services/misc/ollama.nix" ); options.modules.ollama = { enable = lib.options.mkEnableOption "ollama"; }; config = mkIf cfg.enable { # Ensure data directory exists with expected ownership file."${dataDir}/webui" = { type = "dir"; mode = 775; user = "ollama"; group = "ollama"; }; # Enable ollama and listen on all addresses services.ollama = { enable = true; package = pkgs.unstable.ollama; listenAddress = "0.0.0.0:${toString port}"; }; # Server back-end virtualisation.oci-containers.containers.open-webui = { image = "ghcr.io/open-webui/open-webui:${tag}"; # Map volumes to host volumes = [ "${dataDir}/webui:/app/backend/data" ]; environment = { WEBUI_SECRET_KEY = "vrE43JBRQHd6hc7sucdJvJV1FJjd5O4Rn2hf63jd8hnhG3feTajkA"; }; # Traefik labels extraOptions = traefik.labels [ "ai" webPort ] # Networking ++ [ "--add-host=host.docker.internal:host-gateway" ]; }; # Open up the firewall for ollama networking.firewall.allowedTCPPorts = [ port ]; # Also serve ollama on reverse proxy modules.traefik = { enable = true; routers.ollama = "http://127.0.0.1:${toString port}"; }; }; } ``` ## Additional Information I don't think it's a connection issue because I can communicate with ollama via curl from within the container. First I attach to the container and install curl: ```bash docker exec -it open-webui bash apt-get update && apt-get install curl ``` And then I'm able to run `curl host.docker.internal:11434/api/generate` and say hello to with the following results: ```bash root@366b18f61d6c:/app/backend# curl host.docker.internal:11434/api/generate -d '{ "model": "phi", "prompt": "hello" }' {"model":"phi","created_at":"2024-03-03T17:56:25.134576211Z","response":" Hello","done":false} {"model":"phi","created_at":"2024-03-03T17:56:25.214508503Z","response":",","done":false} {"model":"phi","created_at":"2024-03-03T17:56:25.257896588Z","response":" how","done":false} {"model":"phi","created_at":"2024-03-03T17:56:25.301435919Z","response":" can","done":false} {"model":"phi","created_at":"2024-03-03T17:56:25.344804708Z","response":" I","done":false} {"model":"phi","created_at":"2024-03-03T17:56:25.387875603Z","response":" assist","done":false} {"model":"phi","created_at":"2024-03-03T17:56:25.43104759Z","response":" you","done":false} {"model":"phi","created_at":"2024-03-03T17:56:25.474697863Z","response":" today","done":false} {"model":"phi","created_at":"2024-03-03T17:56:25.523738373Z","response":"?","done":false} {"model":"phi","created_at":"2024-03-03T17:56:25.567499029Z","response":"\n","done":false} {"model":"phi","created_at":"2024-03-03T17:56:25.654656954Z","response":"","done":true,"context":[11964,25,317,8537,1022,257,11040,2836,290,281,11666,4430,8796,13,383,8796,3607,7613,7429,284,262,2836,338,2683,13,198,12982,25,23748,198,48902,25,18435,11,703,460,314,3342,345,1909,30,198],"total_duration":7640325193,"load_duration":754523608,"prompt_eval_count":32,"prompt_eval_duration":6365256000,"eval_count":12,"eval_duration":520109000} ```

GiteaMirror closed this issue 2026-05-05 11:39:33 -05:00

GiteaMirror commented 2026-05-05 11:39:35 -05:00

Author

Owner

Copy Link

@tjbck commented on GitHub (Mar 3, 2024):

Unable to reproduce, could you share your screenshot of the network tab with the chat request highlighted?

<!-- gh-comment-id:1975279238 --> @tjbck commented on GitHub (Mar 3, 2024): Unable to reproduce, could you share your screenshot of the network tab with the chat request highlighted? 

GiteaMirror commented 2026-05-05 11:39:35 -05:00

Author

Owner

Copy Link

@suderman commented on GitHub (Mar 3, 2024):

Firefox:

Chromium:

<!-- gh-comment-id:1975309902 --> @suderman commented on GitHub (Mar 3, 2024): Firefox:  Chromium:  

GiteaMirror commented 2026-05-05 11:39:36 -05:00

Author

Owner

Copy Link

@suderman commented on GitHub (Mar 3, 2024):

Is each model <option> in the <select> box supposed to have empty value attributes? Also, after choosing one, the select box no longer responds and doesn't respond to clicks.

<!-- gh-comment-id:1975319448 --> @suderman commented on GitHub (Mar 3, 2024): Is each model `<option>` in the `<select>` box supposed to have empty value attributes? Also, after choosing one, the select box no longer responds and doesn't respond to clicks. 

GiteaMirror commented 2026-05-05 11:39:37 -05:00

Author

Owner

Copy Link

@tjbck commented on GitHub (Mar 3, 2024):

Here's what they should look like.

<!-- gh-comment-id:1975322528 --> @tjbck commented on GitHub (Mar 3, 2024):  Here's what they should look like.

GiteaMirror commented 2026-05-05 11:39:38 -05:00

Author

Owner

Copy Link

@suderman commented on GitHub (Mar 3, 2024):

I figured out the problem: my ollama was out of date. I upgraded from 0.1.17 to 0.1.27 and now it's all good. Sorry for the hassle!

<!-- gh-comment-id:1975397771 --> @suderman commented on GitHub (Mar 3, 2024): I figured out the problem: my ollama was out of date. I upgraded from [0.1.17](https://github.com/ollama/ollama/releases/tag/v0.1.17) to [0.1.27](https://github.com/ollama/ollama/releases/tag/v0.1.27) and now it's all good. Sorry for the hassle!

Sign in to join this conversation.

No Branch/Tag Specified

Branches Tags

main

dev

v0.10.2

v0.10.1

v0.10.0

v0.9.6

v0.9.5

v0.9.4

v0.9.3

v0.9.2

v0.9.1

v0.9.0

v0.8.12

v0.8.11

v0.8.10

v0.8.9

v0.8.8

v0.8.7

v0.8.6

v0.8.5

v0.8.4

v0.8.3

v0.8.2

v0.8.1

v0.8.0

v0.7.2

v0.7.1

v0.7.0

v0.6.43

v0.6.42

v0.6.41

v0.6.40

v0.6.39

v0.6.38

v0.6.37

v0.6.36

v0.6.35

v0.6.34

v0.6.33

v0.6.32

v0.6.31

v0.6.30

v0.6.29

v0.6.28

v0.6.27

v0.6.26

v0.6.25

v0.6.24

v0.6.23

v0.6.22

v0.6.21

v0.6.20

v0.6.19

v0.6.18

v0.6.17

v0.6.16

v0.6.15

v0.6.14

v0.6.13

v0.6.12

v0.6.11

v0.6.10

v0.6.9

v0.6.8

v0.6.7

v0.6.6

v0.6.5

v0.6.4

v0.6.3

v0.6.2

v0.6.1

v0.6.0

v0.5.20

v0.5.19

v0.5.18

v0.5.17

v0.5.16

v0.5.15

v0.5.14

v0.5.13

v0.5.12

v0.5.11

v0.5.10

v0.5.9

v0.5.8

v0.5.7

v0.5.6

v0.5.5

v0.5.4

v0.5.3

v0.5.2

v0.5.1

v0.5.0

v0.4.8

v0.4.7

v0.4.6

v0.4.5

v0.4.4

v0.4.3

v0.4.2

v0.4.1

v0.4.0

v0.3.35

v0.3.34

v0.3.33

v0.3.32

v0.3.31

v0.3.30

v0.3.29

v0.3.28

v0.3.27

v0.3.26

v0.3.25

v0.3.24

v0.3.23

v0.3.22

v0.3.21

v0.3.20

v0.3.19

v0.3.18

v0.3.17

v0.3.16

v0.3.15

v0.3.14

v0.3.13

v0.3.12

v0.3.11

v0.3.10

v0.3.9

v0.3.8

v0.3.7

v0.3.6

v0.3.5

v0.3.4

v0.3.3

v0.3.2

v0.3.1

v0.3.0

v0.2.5

v0.2.4

v0.2.3

v0.2.2

v0.2.1

v0.2.0

v0.1.125

v0.1.124

v0.1.123

v0.1.122

v0.1.121

v0.1.120

v0.1.119

v0.1.118

v0.1.117

v0.1.116

v0.1.115

v0.1.114

v0.1.113

v0.1.112

v0.1.111

v0.1.110

v0.1.109

v0.1.108

v0.1.107

v0.1.106

v0.1.105

v0.1.104

v0.1.103

v0.1.102

Labels

Clear labels

bug

confirmed

confirmed issue

core

documentation

enhancement

good first issue

help wanted

non-core

pull-request

Mirrored from GitHub Pull Request

python

question

testing wanted

No Label

Milestone

No items

No Milestone

Projects

Clear projects

No project

Assignees

Clear assignees

GiteaMirror ninjasurge

No Assignees

1 Participants

Notifications

Subscribe

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: github-starred/open-webui#50963