[GH-ISSUE #8384] Unable to acess ollama model hosted on a raspberry pi 5 from an other device #51892

Closed
opened 2026-04-28 21:09:55 -05:00 by GiteaMirror · 12 comments
Owner

Originally created by @Simonko-912 on GitHub (Jan 11, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/8384

What is the issue?

When i access the ai model from the raspberry pi it works but when i try it with the correct ip and port i cant conect.
(page assist error)
Unable to connect to Ollama 🦙
I tryed changeing the firewall setings still didnt work
raspberry pi model
cat: /sys/firmware/devicetree/model: No such file or directory
linux version
Linux version 6.6.62+rpt-rpi-v8 (serge@raspberrypi.com) (gcc-12 (Debian 12.2.0-14) 12.2.0, GNU ld (GNU Binutils for Debian) 2.40) #1 SMP PREEMPT Debian 1:6.6.62-1+rpt1 (2024-11-25)
sorry for my english im not a native speaker

OS

Linux

GPU

Other

CPU

Other

Ollama version

0.5.4

Originally created by @Simonko-912 on GitHub (Jan 11, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/8384 ### What is the issue? When i access the ai model from the raspberry pi it works but when i try it with the correct ip and port i cant conect. (page assist error) Unable to connect to Ollama 🦙 I tryed changeing the firewall setings still didnt work raspberry pi model cat: /sys/firmware/devicetree/model: No such file or directory linux version Linux version 6.6.62+rpt-rpi-v8 (serge@raspberrypi.com) (gcc-12 (Debian 12.2.0-14) 12.2.0, GNU ld (GNU Binutils for Debian) 2.40) #1 SMP PREEMPT Debian 1:6.6.62-1+rpt1 (2024-11-25) sorry for my english im not a native speaker ### OS Linux ### GPU Other ### CPU Other ### Ollama version 0.5.4
GiteaMirror added the needs more infobug labels 2026-04-28 21:09:55 -05:00
Author
Owner

@rick-github commented on GitHub (Jan 11, 2025):

What is the output of systemctl cat ollama?

<!-- gh-comment-id:2585195418 --> @rick-github commented on GitHub (Jan 11, 2025): What is the output of `systemctl cat ollama`?
Author
Owner

@Simonko-912 commented on GitHub (Jan 11, 2025):

[Unit]
Description=Ollama Service
After=network-online.target

[Service]
OLLAMA_HOST=0.0.0.0:11434
ExecStart=/usr/bin/ollama serve
User=ollama
Group=ollama
Restart=always
RestartSec=3
Environment="PATH=$PATH"

[Install]
WantedBy=default.target

<!-- gh-comment-id:2585197531 --> @Simonko-912 commented on GitHub (Jan 11, 2025): [Unit] Description=Ollama Service After=network-online.target [Service] OLLAMA_HOST=0.0.0.0:11434 ExecStart=/usr/bin/ollama serve User=ollama Group=ollama Restart=always RestartSec=3 Environment="PATH=$PATH" [Install] WantedBy=default.target
Author
Owner

@rick-github commented on GitHub (Jan 11, 2025):

Environment="OLLAMA_HOST=0.0.0.0:11434"
<!-- gh-comment-id:2585198032 --> @rick-github commented on GitHub (Jan 11, 2025): ``` Environment="OLLAMA_HOST=0.0.0.0:11434" ```
Author
Owner

@Simonko-912 commented on GitHub (Jan 11, 2025):

forgot to tell i have lot of errors when downloading

cceb part 4 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection."
time=2025-01-11T11:35:49.743+01:00 level=INFO source=download.go:370 msg="deb26e54cceb part 14 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection."
time=2025-01-11T11:35:49.743+01:00 level=INFO source=download.go:370 msg="deb26e54cceb part 8 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection."
time=2025-01-11T11:35:49.743+01:00 level=INFO source=download.go:370 msg="deb26e54cceb part 7 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection."
time=2025-01-11T11:35:49.744+01:00 level=INFO source=download.go:370 msg="deb26e54cceb part 6 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection."
time=2025-01-11T11:35:49.745+01:00 level=INFO source=download.go:370 msg="deb26e54cceb part 12 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection."

and downloading resets

<!-- gh-comment-id:2585198291 --> @Simonko-912 commented on GitHub (Jan 11, 2025): forgot to tell i have lot of errors when downloading cceb part 4 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2025-01-11T11:35:49.743+01:00 level=INFO source=download.go:370 msg="deb26e54cceb part 14 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2025-01-11T11:35:49.743+01:00 level=INFO source=download.go:370 msg="deb26e54cceb part 8 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2025-01-11T11:35:49.743+01:00 level=INFO source=download.go:370 msg="deb26e54cceb part 7 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2025-01-11T11:35:49.744+01:00 level=INFO source=download.go:370 msg="deb26e54cceb part 6 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." time=2025-01-11T11:35:49.745+01:00 level=INFO source=download.go:370 msg="deb26e54cceb part 12 stalled; retrying. If this persists, press ctrl-c to exit, then 'ollama pull' to find a faster connection." and downloading resets
Author
Owner

@rick-github commented on GitHub (Jan 11, 2025):

find a faster connection

Your connection to the ollama model library is causing delays in the download.

<!-- gh-comment-id:2585199169 --> @rick-github commented on GitHub (Jan 11, 2025): > find a faster connection Your connection to the ollama model library is causing delays in the download.
Author
Owner

@Simonko-912 commented on GitHub (Jan 11, 2025):

how to fix it? this didnt hapen to me before

<!-- gh-comment-id:2585200193 --> @Simonko-912 commented on GitHub (Jan 11, 2025): how to fix it? this didnt hapen to me before
Author
Owner

@rick-github commented on GitHub (Jan 11, 2025):

press ctrl-c to exit, then 'ollama pull' to find a faster connection.

It may be a temporary issue, wait for a little bit and try again.

<!-- gh-comment-id:2585201148 --> @rick-github commented on GitHub (Jan 11, 2025): > press ctrl-c to exit, then 'ollama pull' to find a faster connection. It may be a temporary issue, wait for a little bit and try again.
Author
Owner

@Simonko-912 commented on GitHub (Jan 11, 2025):

so maybe the snow can be the issue.... ok thanks

<!-- gh-comment-id:2585201362 --> @Simonko-912 commented on GitHub (Jan 11, 2025): so maybe the snow can be the issue.... ok thanks
Author
Owner

@pdevine commented on GitHub (Jan 12, 2025):

@Simonko-912 can you curl http://x.x.x.x:11434 where x.x.x.x is the IP address of the raspberry pi? If it says Ollama is running then everything should be OK. If it doesn't it's most likely a problem with your firewall configuration.

<!-- gh-comment-id:2585499839 --> @pdevine commented on GitHub (Jan 12, 2025): @Simonko-912 can you `curl http://x.x.x.x:11434` where x.x.x.x is the IP address of the raspberry pi? If it says `Ollama is running` then everything should be OK. If it doesn't it's most likely a problem with your firewall configuration.
Author
Owner

@phil123456 commented on GitHub (Jan 23, 2025):

after restarting the service, I still get connection refused from outside

<!-- gh-comment-id:2610986621 --> @phil123456 commented on GitHub (Jan 23, 2025): after restarting the service, I still get connection refused from outside
Author
Owner

@rick-github commented on GitHub (Jan 23, 2025):

Do the server logs show it's listening on the right address?

<!-- gh-comment-id:2610992216 --> @rick-github commented on GitHub (Jan 23, 2025): Do the server logs show it's listening on the right address?
Author
Owner

@phil123456 commented on GitHub (Jan 23, 2025):

I had to install ufw and allow ports, also do the service config modification as above

<!-- gh-comment-id:2611065684 --> @phil123456 commented on GitHub (Jan 23, 2025): I had to install ufw and allow ports, also do the service config modification as above
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#51892