github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-05-22 13:42:25 -05:00
Code Issues 16.9k Packages Projects Releases 122 Wiki Activity

[GH-ISSUE #9211] Ollama Docker: Error: something went wrong, please see the ollama server logs for details #6003

New Issue
Closed
opened 2026-04-12 17:21:11 -05:00 by GiteaMirror · 4 comments
GiteaMirror commented 2026-04-12 17:21:11 -05:00
Owner
Copy Link

Originally created by @balajirajan87 on GitHub (Feb 19, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/9211

What is the issue?

i had installed the latest ollama docker image by following the instructions in this page: https://hub.docker.com/r/ollama/ollama

Docker got installed. i am also able to log inside the docker into the root/ folder.

but within the docker when i execute ollama pull command i am getting the below error:

docker exec -it ollama ollama run llama3

Error: something went wrong, please see the ollama server logs for details

Relevant log output

bra6cob@COB-C-013XA | internet: ok+docker:~$ sudo apt-get install -y nvidia-container-toolkit
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
nvidia-container-toolkit is already the newest version (1.17.4-1).
The following packages were automatically installed and are no longer required:
  htop libnl-3-200 libnl-genl-3-200
Use 'sudo apt autoremove' to remove them.
0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
bra6cob@COB-C-013XA | internet: ok+docker:~$ sudo nvidia-ctk runtime configure --runtime=docker
INFO[0000] Loading config from /etc/docker/daemon.json
INFO[0000] Wrote updated config to /etc/docker/daemon.json
INFO[0000] It is recommended that docker daemon be restarted.
bra6cob@COB-C-013XA | internet: ok+docker:~$ sudo systemctl restart docker
bra6cob@COB-C-013XA | internet: ok+docker:~$ docker run -d --gpus=all -v ollama:/root/.ollama -p 11434:11434 --name ollama ollama/ollama
Unable to find image 'ollama/ollama:latest' locally
latest: Pulling from ollama/ollama
d9802f032d67: Pull complete
161508c220d5: Pull complete
6b78c8d09c74: Pull complete
e0c387d586cc: Pull complete
Digest: sha256:82956f40bb1f307c77f7a8c3ed91c7a37e072ed757ff143e34210a7b991b9480
Status: Downloaded newer image for ollama/ollama:latest
70ea912dd2b18be5da8d4fbd9fd0ca4a2cff7c96da1e75149545084a36776fc4
bra6cob@COB-C-013XA | internet: ok+docker:~$ docker exec -it ollama ollama run llama3
Error: something went wrong, please see the ollama server logs for details
bra6cob@COB-C-013XA | internet: ok+docker:~$ echo $no_proxy
localhost,127.0.0.1,127.*,172.*,192.168.*,10.*,169.254.169.254,de.bosch.com,apac.bosch.com,emea.bosch.com,us.bosch.com,rb-artifactory.bosch.com,bosch.tech,sourcecode01.de.bosch.com,sourcecode.socialcoding.bosch.com,bcr-de01.inside.bosch.cloud,.bosch-iot-cloud.com,sourcecode06.dev.bosch.com
bra6cob@COB-C-013XA | internet: ok+docker:~$ docker exec -it ollama /bin/bash
root@70ea912dd2b1:/# ollama -v
Warning: could not connect to a running Ollama instance
Warning: client version is 0.5.11
root@70ea912dd2b1:/# ollama pull llama3.2
Error: something went wrong, please see the ollama server logs for details
root@70ea912dd2b1:/#

OS

Linux

GPU

Nvidia

CPU

No response

Ollama version

0.5.11

Originally created by @balajirajan87 on GitHub (Feb 19, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/9211 ### What is the issue? i had installed the latest ollama docker image by following the instructions in this page: https://hub.docker.com/r/ollama/ollama Docker got installed. i am also able to log inside the docker into the root/ folder. but within the docker when i execute ollama pull command i am getting the below error: `docker exec -it ollama ollama run llama3` Error: something went wrong, please see the ollama server logs for details ### Relevant log output ```shell bra6cob@COB-C-013XA | internet: ok+docker:~$ sudo apt-get install -y nvidia-container-toolkit Reading package lists... Done Building dependency tree... Done Reading state information... Done nvidia-container-toolkit is already the newest version (1.17.4-1). The following packages were automatically installed and are no longer required: htop libnl-3-200 libnl-genl-3-200 Use 'sudo apt autoremove' to remove them. 0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded. bra6cob@COB-C-013XA | internet: ok+docker:~$ sudo nvidia-ctk runtime configure --runtime=docker INFO[0000] Loading config from /etc/docker/daemon.json INFO[0000] Wrote updated config to /etc/docker/daemon.json INFO[0000] It is recommended that docker daemon be restarted. bra6cob@COB-C-013XA | internet: ok+docker:~$ sudo systemctl restart docker bra6cob@COB-C-013XA | internet: ok+docker:~$ docker run -d --gpus=all -v ollama:/root/.ollama -p 11434:11434 --name ollama ollama/ollama Unable to find image 'ollama/ollama:latest' locally latest: Pulling from ollama/ollama d9802f032d67: Pull complete 161508c220d5: Pull complete 6b78c8d09c74: Pull complete e0c387d586cc: Pull complete Digest: sha256:82956f40bb1f307c77f7a8c3ed91c7a37e072ed757ff143e34210a7b991b9480 Status: Downloaded newer image for ollama/ollama:latest 70ea912dd2b18be5da8d4fbd9fd0ca4a2cff7c96da1e75149545084a36776fc4 bra6cob@COB-C-013XA | internet: ok+docker:~$ docker exec -it ollama ollama run llama3 Error: something went wrong, please see the ollama server logs for details bra6cob@COB-C-013XA | internet: ok+docker:~$ echo $no_proxy localhost,127.0.0.1,127.*,172.*,192.168.*,10.*,169.254.169.254,de.bosch.com,apac.bosch.com,emea.bosch.com,us.bosch.com,rb-artifactory.bosch.com,bosch.tech,sourcecode01.de.bosch.com,sourcecode.socialcoding.bosch.com,bcr-de01.inside.bosch.cloud,.bosch-iot-cloud.com,sourcecode06.dev.bosch.com bra6cob@COB-C-013XA | internet: ok+docker:~$ docker exec -it ollama /bin/bash root@70ea912dd2b1:/# ollama -v Warning: could not connect to a running Ollama instance Warning: client version is 0.5.11 root@70ea912dd2b1:/# ollama pull llama3.2 Error: something went wrong, please see the ollama server logs for details root@70ea912dd2b1:/# ``` ### OS Linux ### GPU Nvidia ### CPU _No response_ ### Ollama version 0.5.11
GiteaMirror added the dockerbug labels 2026-04-12 17:21:11 -05:00
GiteaMirror commented 2026-04-12 17:21:12 -05:00
Author
Owner
Copy Link

@rick-github commented on GitHub (Feb 19, 2025):

What's the output of the following commands:

docker exec ollama ps ax

docker logs ollama
<!-- gh-comment-id:2667976076 --> @rick-github commented on GitHub (Feb 19, 2025): What's the output of the following commands: ``` docker exec ollama ps ax ``` ``` docker logs ollama ```
GiteaMirror commented 2026-04-12 17:21:13 -05:00
Author
Owner
Copy Link

@balajirajan87 commented on GitHub (Feb 19, 2025):

below are the outputs:

docker exec ollama ps ax

bra6cob@COB-C-013XA | internet: ok+docker:~$ docker exec ollama ps ax
PID TTY STAT TIME COMMAND
1 ? Ssl 0:00 /bin/ollama serve
22 ? Rs 0:00 ps ax

docker logs ollama

bra6cob@COB-C-013XA | internet: ok+docker:~$ docker logs ollama
2025/02/19 09:08:48 routes.go:1186: INFO server config env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY:http://172.25.224.1:3129 HTTP_PROXY:http://172.25.224.1:3129 NO_PROXY: OLLAMA_DEBUG:false OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://0.0.0.0:11434 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE: OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/root/.ollama/models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:0 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://*] OLLAMA_SCHED_SPREAD:false ROCR_VISIBLE_DEVICES: http_proxy:http://172.25.224.1:3129 https_proxy:http://172.25.224.1:3129 no_proxy:]"
time=2025-02-19T09:08:48.576Z level=INFO source=images.go:432 msg="total blobs: 0"
time=2025-02-19T09:08:48.576Z level=INFO source=images.go:439 msg="total unused blobs removed: 0"
time=2025-02-19T09:08:48.576Z level=INFO source=routes.go:1237 msg="Listening on [::]:11434 (version 0.5.11)"
time=2025-02-19T09:08:48.577Z level=INFO source=gpu.go:217 msg="looking for compatible GPUs"
time=2025-02-19T09:08:48.771Z level=INFO source=types.go:130 msg="inference compute" id=GPU-18524935-2e7f-090c-3b66-77bfdc8f882f library=cuda variant=v12 compute=8.6 driver=12.5 name="NVIDIA RTX A3000 12GB Laptop GPU" total="12.0 GiB" available="11.0 GiB"

<!-- gh-comment-id:2668009520 --> @balajirajan87 commented on GitHub (Feb 19, 2025): below are the outputs: `docker exec ollama ps ax` bra6cob@COB-C-013XA | internet: ok+docker:~$ docker exec ollama ps ax PID TTY STAT TIME COMMAND 1 ? Ssl 0:00 /bin/ollama serve 22 ? Rs 0:00 ps ax `docker logs ollama` bra6cob@COB-C-013XA | internet: ok+docker:~$ docker logs ollama 2025/02/19 09:08:48 routes.go:1186: INFO server config env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY:http://172.25.224.1:3129 HTTP_PROXY:http://172.25.224.1:3129 NO_PROXY: OLLAMA_DEBUG:false OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://0.0.0.0:11434 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE: OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/root/.ollama/models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:0 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://*] OLLAMA_SCHED_SPREAD:false ROCR_VISIBLE_DEVICES: http_proxy:http://172.25.224.1:3129 https_proxy:http://172.25.224.1:3129 no_proxy:]" time=2025-02-19T09:08:48.576Z level=INFO source=images.go:432 msg="total blobs: 0" time=2025-02-19T09:08:48.576Z level=INFO source=images.go:439 msg="total unused blobs removed: 0" time=2025-02-19T09:08:48.576Z level=INFO source=routes.go:1237 msg="Listening on [::]:11434 (version 0.5.11)" time=2025-02-19T09:08:48.577Z level=INFO source=gpu.go:217 msg="looking for compatible GPUs" time=2025-02-19T09:08:48.771Z level=INFO source=types.go:130 msg="inference compute" id=GPU-18524935-2e7f-090c-3b66-77bfdc8f882f library=cuda variant=v12 compute=8.6 driver=12.5 name="NVIDIA RTX A3000 12GB Laptop GPU" total="12.0 GiB" available="11.0 GiB"
GiteaMirror commented 2026-04-12 17:21:13 -05:00
Author
Owner
Copy Link

@rick-github commented on GitHub (Feb 19, 2025):

You have a proxy set inside the container. Unset HTTP_PROXY and http_proxy, or set no_proxy.

<!-- gh-comment-id:2668031851 --> @rick-github commented on GitHub (Feb 19, 2025): You have a proxy set inside the container. Unset `HTTP_PROXY` and `http_proxy`, or set `no_proxy`.
GiteaMirror commented 2026-04-12 17:21:13 -05:00
Author
Owner
Copy Link

@balajirajan87 commented on GitHub (Feb 19, 2025):

superb..

i just unset the HTTP_PROXY, http_proxy, HTTPS_PROXY, and https_proxy and now things are working.

Thanks a lot for your help ..

bra6cob@COB-C-013XA | internet: ok+docker:~$ docker exec -it ollama /bin/bash
root@5d6613ce36a4:/# echo $http_proxy
http://172.25.224.1:3129
root@5d6613ce36a4:/# echo $https_proxy
http://172.25.224.1:3129
root@5d6613ce36a4:/# echo $no_proxy

root@5d6613ce36a4:/# env | grep -i proxy
https_proxy=http://172.25.224.1:3129
HTTPS_PROXY=http://172.25.224.1:3129
HTTP_PROXY=http://172.25.224.1:3129
http_proxy=http://172.25.224.1:3129
root@5d6613ce36a4:/# unset http_proxy
root@5d6613ce36a4:/# unset HTTP_PROXY
root@5d6613ce36a4:/# unset HTTPS_PROXY
root@5d6613ce36a4:/# unset https_proxy
root@5d6613ce36a4:/# env | grep -i proxy
root@5d6613ce36a4:/# ollama pull llama3.2
pulling manifest
pulling dde5aa3fc5ff... 100% ▕███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████▏ 2.0 GB
pulling 966de95ca8a6... 100% ▕███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████▏ 1.4 KB
pulling fcc5a6bec9da... 100% ▕███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████▏ 7.7 KB
pulling a70ff7e570d9... 100% ▕███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████▏ 6.0 KB
pulling 56bb8bd477a5... 100% ▕███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████▏ 96 B
pulling 34bb5ab01051... 100% ▕███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████▏ 561 B
verifying sha256 digest
writing manifest
success

<!-- gh-comment-id:2668059504 --> @balajirajan87 commented on GitHub (Feb 19, 2025): superb.. i just unset the HTTP_PROXY, http_proxy, HTTPS_PROXY, and https_proxy and now things are working. Thanks a lot for your help .. bra6cob@COB-C-013XA | internet: ok+docker:~$ docker exec -it ollama /bin/bash root@5d6613ce36a4:/# echo $http_proxy http://172.25.224.1:3129 root@5d6613ce36a4:/# echo $https_proxy http://172.25.224.1:3129 root@5d6613ce36a4:/# echo $no_proxy root@5d6613ce36a4:/# env | grep -i proxy https_proxy=http://172.25.224.1:3129 HTTPS_PROXY=http://172.25.224.1:3129 HTTP_PROXY=http://172.25.224.1:3129 http_proxy=http://172.25.224.1:3129 root@5d6613ce36a4:/# unset http_proxy root@5d6613ce36a4:/# unset HTTP_PROXY root@5d6613ce36a4:/# unset HTTPS_PROXY root@5d6613ce36a4:/# unset https_proxy root@5d6613ce36a4:/# env | grep -i proxy root@5d6613ce36a4:/# ollama pull llama3.2 pulling manifest pulling dde5aa3fc5ff... 100% ▕███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████▏ 2.0 GB pulling 966de95ca8a6... 100% ▕███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████▏ 1.4 KB pulling fcc5a6bec9da... 100% ▕███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████▏ 7.7 KB pulling a70ff7e570d9... 100% ▕███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████▏ 6.0 KB pulling 56bb8bd477a5... 100% ▕███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████▏ 96 B pulling 34bb5ab01051... 100% ▕███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████▏ 561 B verifying sha256 digest writing manifest success
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
 python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
No Label bug docker
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#6003
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?