github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-05-07 16:40:08 -05:00
Code Issues 14.5k Packages Projects Releases 120 Wiki Activity

[GH-ISSUE #5437] 502 Bad Gateway #49914

New Issue
Closed
opened 2026-04-28 13:23:42 -05:00 by GiteaMirror · 3 comments
GiteaMirror commented 2026-04-28 13:23:42 -05:00
Owner
Copy Link

Originally created by @jacktang on GitHub (Jul 2, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/5437

What is the issue?

Hello,

I installed ollama and pull models, but I can't access the endpoint. It always returns 502 bad gateway error

$ wget http://localhost:11434
--2024-07-02 11:01:17--  http://localhost:11434/
Connecting to 10.0.5.8:30890... connected.
Proxy request sent, awaiting response... 502 Bad Gateway
2024-07-02 11:01:17 ERROR 502: Bad Gateway.

I also checked the server log

-- Logs begin at Sun 2024-06-23 16:41:51 CDT, end at Tue 2024-07-02 10:57:11 CDT. --
Jul 02 10:03:39 dev-MS-7D25 systemd[1]: Started Ollama Service.
Jul 02 10:03:39 dev-MS-7D25 ollama[3813757]: Couldn't find '/usr/share/ollama/.ollama/id_ed25519'. Generating new private key.
Jul 02 10:03:39 dev-MS-7D25 ollama[3813757]: Your new public key is:
Jul 02 10:03:39 dev-MS-7D25 ollama[3813757]: ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIjqR5td3RHcOoXOMD3oE18JYaOWI2CAZh30fyU213B9
Jul 02 10:03:39 dev-MS-7D25 ollama[3813757]: 2024/07/02 10:03:39 routes.go:1064: INFO server config env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: OL>
Jul 02 10:03:39 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:03:39.049-05:00 level=INFO source=images.go:730 msg="total blobs: 0"
Jul 02 10:03:39 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:03:39.049-05:00 level=INFO source=images.go:737 msg="total unused blobs removed: 0"
Jul 02 10:03:39 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:03:39.049-05:00 level=INFO source=routes.go:1111 msg="Listening on 127.0.0.1:11434 (version 0.1.48)"
Jul 02 10:03:39 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:03:39.049-05:00 level=INFO source=payload.go:30 msg="extracting embedded files" dir=/tmp/ollama3128667190/runners
Jul 02 10:03:40 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:03:40.623-05:00 level=INFO source=payload.go:44 msg="Dynamic LLM libraries [cpu_avx2 cuda_v11 rocm_v60101 cpu cpu_avx]"
Jul 02 10:03:40 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:03:40.732-05:00 level=INFO source=types.go:98 msg="inference compute" id=GPU-8af1e031-b435-37c4-9cda-3f8db6d5ed54 library=cuda compute=8>
Jul 02 10:05:07 dev-MS-7D25 ollama[3813757]: [GIN] 2024/07/02 - 10:05:07 | 200 |      61.718µs |       127.0.0.1 | HEAD     "/"
Jul 02 10:05:10 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:05:10.114-05:00 level=INFO source=download.go:136 msg="downloading 6a0746a1ec1a in 47 100 MB part(s)"
Jul 02 10:05:37 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:05:37.115-05:00 level=INFO source=download.go:251 msg="6a0746a1ec1a part 12 stalled; retrying. If this persists, press ctrl-c to exit, t>
Jul 02 10:06:50 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:06:50.115-05:00 level=INFO source=download.go:251 msg="6a0746a1ec1a part 30 stalled; retrying. If this persists, press ctrl-c to exit, t>
Jul 02 10:07:08 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:07:08.115-05:00 level=INFO source=download.go:251 msg="6a0746a1ec1a part 40 stalled; retrying. If this persists, press ctrl-c to exit, t>
Jul 02 10:07:09 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:07:09.312-05:00 level=INFO source=download.go:178 msg="6a0746a1ec1a part 21 attempt 0 failed: unexpected EOF, retrying in 1s"
Jul 02 10:07:13 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:07:13.115-05:00 level=INFO source=download.go:251 msg="6a0746a1ec1a part 14 stalled; retrying. If this persists, press ctrl-c to exit, t>
Jul 02 10:07:14 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:07:14.312-05:00 level=INFO source=download.go:251 msg="6a0746a1ec1a part 21 stalled; retrying. If this persists, press ctrl-c to exit, t>
Jul 02 10:07:18 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:07:18.679-05:00 level=INFO source=download.go:178 msg="6a0746a1ec1a part 0 attempt 0 failed: unexpected EOF, retrying in 1s"
Jul 02 10:07:20 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:07:20.680-05:00 level=INFO source=download.go:251 msg="6a0746a1ec1a part 0 stalled; retrying. If this persists, press ctrl-c to exit, th>
Jul 02 10:07:33 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:07:33.690-05:00 level=INFO source=download.go:178 msg="6a0746a1ec1a part 13 attempt 0 failed: unexpected EOF, retrying in 1s"
Jul 02 10:08:15 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:08:15.314-05:00 level=INFO source=download.go:251 msg="6a0746a1ec1a part 21 stalled; retrying. If this persists, press ctrl-c to exit, t>
Jul 02 10:08:20 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:08:20.043-05:00 level=INFO source=download.go:178 msg="6a0746a1ec1a part 10 attempt 0 failed: unexpected EOF, retrying in 1s"
Jul 02 10:08:22 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:08:22.044-05:00 level=INFO source=download.go:251 msg="6a0746a1ec1a part 10 stalled; retrying. If this persists, press ctrl-c to exit, t>
Jul 02 10:08:38 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:08:38.903-05:00 level=INFO source=download.go:178 msg="6a0746a1ec1a part 35 attempt 0 failed: unexpected EOF, retrying in 1s"
Jul 02 10:08:50 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:08:50.549-05:00 level=INFO source=download.go:178 msg="6a0746a1ec1a part 14 attempt 0 failed: unexpected EOF, retrying in 1s"
Jul 02 10:09:54 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:09:54.227-05:00 level=INFO source=download.go:178 msg="6a0746a1ec1a part 9 attempt 0 failed: unexpected EOF, retrying in 1s"
Jul 02 10:10:46 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:10:46.195-05:00 level=INFO source=download.go:178 msg="6a0746a1ec1a part 1 attempt 0 failed: unexpected EOF, retrying in 1s"
Jul 02 10:10:57 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:10:57.841-05:00 level=INFO source=download.go:178 msg="6a0746a1ec1a part 23 attempt 0 failed: unexpected EOF, retrying in 1s"
Jul 02 10:11:01 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:11:01.784-05:00 level=INFO source=download.go:178 msg="6a0746a1ec1a part 11 attempt 0 failed: unexpected EOF, retrying in 1s"
Jul 02 10:11:03 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:11:03.488-05:00 level=INFO source=download.go:178 msg="6a0746a1ec1a part 22 attempt 0 failed: unexpected EOF, retrying in 1s"
Jul 02 10:11:11 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:11:11.116-05:00 level=INFO source=download.go:251 msg="6a0746a1ec1a part 12 stalled; retrying. If this persists, press ctrl-c to exit, t>
Jul 02 10:13:12 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:13:12.970-05:00 level=INFO source=download.go:178 msg="6a0746a1ec1a part 18 attempt 0 failed: unexpected EOF, retrying in 1s"
Jul 02 10:13:27 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:13:27.065-05:00 level=INFO source=download.go:136 msg="downloading 4fa551d4f938 in 1 12 KB part(s)"
Jul 02 10:13:30 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:13:30.160-05:00 level=INFO source=download.go:136 msg="downloading 8ab4849b038c in 1 254 B part(s)"
Jul 02 10:13:33 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:13:33.501-05:00 level=INFO source=download.go:136 msg="downloading 577073ffcc6c in 1 110 B part(s)"

The message unexpected EOF means the model is not completed pulled?

OS

Linux

GPU

Nvidia

CPU

Intel

Ollama version

0.1.48

Originally created by @jacktang on GitHub (Jul 2, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/5437 ### What is the issue? Hello, I installed ollama and pull models, but I can't access the endpoint. It always returns 502 bad gateway error ``` $ wget http://localhost:11434 --2024-07-02 11:01:17-- http://localhost:11434/ Connecting to 10.0.5.8:30890... connected. Proxy request sent, awaiting response... 502 Bad Gateway 2024-07-02 11:01:17 ERROR 502: Bad Gateway. ``` I also checked the server log ``` -- Logs begin at Sun 2024-06-23 16:41:51 CDT, end at Tue 2024-07-02 10:57:11 CDT. -- Jul 02 10:03:39 dev-MS-7D25 systemd[1]: Started Ollama Service. Jul 02 10:03:39 dev-MS-7D25 ollama[3813757]: Couldn't find '/usr/share/ollama/.ollama/id_ed25519'. Generating new private key. Jul 02 10:03:39 dev-MS-7D25 ollama[3813757]: Your new public key is: Jul 02 10:03:39 dev-MS-7D25 ollama[3813757]: ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIjqR5td3RHcOoXOMD3oE18JYaOWI2CAZh30fyU213B9 Jul 02 10:03:39 dev-MS-7D25 ollama[3813757]: 2024/07/02 10:03:39 routes.go:1064: INFO server config env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: OL> Jul 02 10:03:39 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:03:39.049-05:00 level=INFO source=images.go:730 msg="total blobs: 0" Jul 02 10:03:39 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:03:39.049-05:00 level=INFO source=images.go:737 msg="total unused blobs removed: 0" Jul 02 10:03:39 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:03:39.049-05:00 level=INFO source=routes.go:1111 msg="Listening on 127.0.0.1:11434 (version 0.1.48)" Jul 02 10:03:39 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:03:39.049-05:00 level=INFO source=payload.go:30 msg="extracting embedded files" dir=/tmp/ollama3128667190/runners Jul 02 10:03:40 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:03:40.623-05:00 level=INFO source=payload.go:44 msg="Dynamic LLM libraries [cpu_avx2 cuda_v11 rocm_v60101 cpu cpu_avx]" Jul 02 10:03:40 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:03:40.732-05:00 level=INFO source=types.go:98 msg="inference compute" id=GPU-8af1e031-b435-37c4-9cda-3f8db6d5ed54 library=cuda compute=8> Jul 02 10:05:07 dev-MS-7D25 ollama[3813757]: [GIN] 2024/07/02 - 10:05:07 | 200 | 61.718µs | 127.0.0.1 | HEAD "/" Jul 02 10:05:10 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:05:10.114-05:00 level=INFO source=download.go:136 msg="downloading 6a0746a1ec1a in 47 100 MB part(s)" Jul 02 10:05:37 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:05:37.115-05:00 level=INFO source=download.go:251 msg="6a0746a1ec1a part 12 stalled; retrying. If this persists, press ctrl-c to exit, t> Jul 02 10:06:50 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:06:50.115-05:00 level=INFO source=download.go:251 msg="6a0746a1ec1a part 30 stalled; retrying. If this persists, press ctrl-c to exit, t> Jul 02 10:07:08 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:07:08.115-05:00 level=INFO source=download.go:251 msg="6a0746a1ec1a part 40 stalled; retrying. If this persists, press ctrl-c to exit, t> Jul 02 10:07:09 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:07:09.312-05:00 level=INFO source=download.go:178 msg="6a0746a1ec1a part 21 attempt 0 failed: unexpected EOF, retrying in 1s" Jul 02 10:07:13 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:07:13.115-05:00 level=INFO source=download.go:251 msg="6a0746a1ec1a part 14 stalled; retrying. If this persists, press ctrl-c to exit, t> Jul 02 10:07:14 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:07:14.312-05:00 level=INFO source=download.go:251 msg="6a0746a1ec1a part 21 stalled; retrying. If this persists, press ctrl-c to exit, t> Jul 02 10:07:18 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:07:18.679-05:00 level=INFO source=download.go:178 msg="6a0746a1ec1a part 0 attempt 0 failed: unexpected EOF, retrying in 1s" Jul 02 10:07:20 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:07:20.680-05:00 level=INFO source=download.go:251 msg="6a0746a1ec1a part 0 stalled; retrying. If this persists, press ctrl-c to exit, th> Jul 02 10:07:33 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:07:33.690-05:00 level=INFO source=download.go:178 msg="6a0746a1ec1a part 13 attempt 0 failed: unexpected EOF, retrying in 1s" Jul 02 10:08:15 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:08:15.314-05:00 level=INFO source=download.go:251 msg="6a0746a1ec1a part 21 stalled; retrying. If this persists, press ctrl-c to exit, t> Jul 02 10:08:20 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:08:20.043-05:00 level=INFO source=download.go:178 msg="6a0746a1ec1a part 10 attempt 0 failed: unexpected EOF, retrying in 1s" Jul 02 10:08:22 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:08:22.044-05:00 level=INFO source=download.go:251 msg="6a0746a1ec1a part 10 stalled; retrying. If this persists, press ctrl-c to exit, t> Jul 02 10:08:38 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:08:38.903-05:00 level=INFO source=download.go:178 msg="6a0746a1ec1a part 35 attempt 0 failed: unexpected EOF, retrying in 1s" Jul 02 10:08:50 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:08:50.549-05:00 level=INFO source=download.go:178 msg="6a0746a1ec1a part 14 attempt 0 failed: unexpected EOF, retrying in 1s" Jul 02 10:09:54 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:09:54.227-05:00 level=INFO source=download.go:178 msg="6a0746a1ec1a part 9 attempt 0 failed: unexpected EOF, retrying in 1s" Jul 02 10:10:46 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:10:46.195-05:00 level=INFO source=download.go:178 msg="6a0746a1ec1a part 1 attempt 0 failed: unexpected EOF, retrying in 1s" Jul 02 10:10:57 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:10:57.841-05:00 level=INFO source=download.go:178 msg="6a0746a1ec1a part 23 attempt 0 failed: unexpected EOF, retrying in 1s" Jul 02 10:11:01 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:11:01.784-05:00 level=INFO source=download.go:178 msg="6a0746a1ec1a part 11 attempt 0 failed: unexpected EOF, retrying in 1s" Jul 02 10:11:03 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:11:03.488-05:00 level=INFO source=download.go:178 msg="6a0746a1ec1a part 22 attempt 0 failed: unexpected EOF, retrying in 1s" Jul 02 10:11:11 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:11:11.116-05:00 level=INFO source=download.go:251 msg="6a0746a1ec1a part 12 stalled; retrying. If this persists, press ctrl-c to exit, t> Jul 02 10:13:12 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:13:12.970-05:00 level=INFO source=download.go:178 msg="6a0746a1ec1a part 18 attempt 0 failed: unexpected EOF, retrying in 1s" Jul 02 10:13:27 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:13:27.065-05:00 level=INFO source=download.go:136 msg="downloading 4fa551d4f938 in 1 12 KB part(s)" Jul 02 10:13:30 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:13:30.160-05:00 level=INFO source=download.go:136 msg="downloading 8ab4849b038c in 1 254 B part(s)" Jul 02 10:13:33 dev-MS-7D25 ollama[3813757]: time=2024-07-02T10:13:33.501-05:00 level=INFO source=download.go:136 msg="downloading 577073ffcc6c in 1 110 B part(s)" ``` The message `unexpected EOF` means the model is not completed pulled? ### OS Linux ### GPU Nvidia ### CPU Intel ### Ollama version 0.1.48
GiteaMirror added the bug label 2026-04-28 13:23:42 -05:00
GiteaMirror commented 2026-04-28 13:23:46 -05:00
Author
Owner
Copy Link

@rick-github commented on GitHub (Jul 2, 2024):

It looks like you have proxies configured. Try this:

wget --no-proxy -qO - http://localhost:11434

or

unset http_proxy https_proxy
wget -qO - http://localhost:11434
<!-- gh-comment-id:2203881457 --> @rick-github commented on GitHub (Jul 2, 2024): It looks like you have proxies configured. Try this: ``` wget --no-proxy -qO - http://localhost:11434 ``` or ``` unset http_proxy https_proxy wget -qO - http://localhost:11434 ```
GiteaMirror commented 2026-04-28 13:23:49 -05:00
Author
Owner
Copy Link

@rick-github commented on GitHub (Jul 2, 2024):

Regarding the failed download, if you run ollama pull llama3 it should verify the layer blobs and re-pull any that failed.

<!-- gh-comment-id:2203895659 --> @rick-github commented on GitHub (Jul 2, 2024): Regarding the failed download, if you run `ollama pull llama3` it should verify the layer blobs and re-pull any that failed.
GiteaMirror commented 2026-04-28 13:23:51 -05:00
Author
Owner
Copy Link

@jacktang commented on GitHub (Jul 3, 2024):

@rick-github Cool, you're right, I ignored the proxy.

<!-- gh-comment-id:2204818706 --> @jacktang commented on GitHub (Jul 3, 2024): @rick-github Cool, you're right, I ignored the proxy.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
 python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
No Label bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#49914
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?