github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-07-17 05:36:16 -05:00
Code Issues 16.9k Packages Projects Releases 122 Wiki Activity

[GH-ISSUE #2829] Use cloudflared Tunnels to publish ollama service ports, with clients returning with no messages #48231

New Issue
Open
opened 2026-04-28 07:16:52 -05:00 by GiteaMirror · 4 comments
GiteaMirror commented 2026-04-28 07:16:52 -05:00
Owner
Copy Link

Originally created by @online2311 on GitHub (Feb 29, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/2829

The cloudflared Tunnels are used to publish the ollama service port, and the client uses the enchanted-llm app for the dialogue, with no messages returned. But without cloudflared Tunnels, everything works fine. Is ollama using streaming dialogue using websocket?

Originally created by @online2311 on GitHub (Feb 29, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/2829 The cloudflared Tunnels are used to publish the ollama service port, and the client uses the enchanted-llm app for the dialogue, with no messages returned. But without cloudflared Tunnels, everything works fine. Is ollama using streaming dialogue using websocket?
GiteaMirror added the question label 2026-04-28 07:16:52 -05:00
GiteaMirror commented 2026-04-28 07:16:57 -05:00
Author
Owner
Copy Link

@sanlega commented on GitHub (Mar 31, 2024):

Did you use localhost/127.0.0.1 or did you exposed the 0.0.0.0 local ip of your machine in the OLLAMA_HOST env variable?

For me adding OLLAMA_HOST="0.0.0.0:PORT" setting a desired port, in my case 5000 worked fine.

I took a bit of time to notice that i was exposing only the localhost no to my machines ip and the redirection wasn't working.

In the cloudflare config for the tunnel i had to set the rule to HTTP. Now it works fine but i still need to query the api with HTTPS instead of HTTP.

<!-- gh-comment-id:2028848375 --> @sanlega commented on GitHub (Mar 31, 2024): Did you use localhost/127.0.0.1 or did you exposed the 0.0.0.0 local ip of your machine in the OLLAMA_HOST env variable? For me adding OLLAMA_HOST="0.0.0.0:PORT" setting a desired port, in my case 5000 worked fine. I took a bit of time to notice that i was exposing only the localhost no to my machines ip and the redirection wasn't working. In the cloudflare config for the tunnel i had to set the rule to HTTP. Now it works fine but i still need to query the api with HTTPS instead of HTTP.
GiteaMirror commented 2026-04-28 07:16:58 -05:00
Author
Owner
Copy Link

@thedavc commented on GitHub (Apr 17, 2024):

What settings did you use in cloudflare? I'm encountering the 524 error.

<!-- gh-comment-id:2060557448 --> @thedavc commented on GitHub (Apr 17, 2024): What settings did you use in cloudflare? I'm encountering the 524 error.
GiteaMirror commented 2026-04-28 07:16:59 -05:00
Author
Owner
Copy Link

@sanlega commented on GitHub (Apr 17, 2024):

As commented up there I just served it on 0.0.0.0 and using the PORT 5000

<!-- gh-comment-id:2060632122 --> @sanlega commented on GitHub (Apr 17, 2024): As commented up there I just served it on 0.0.0.0 and using the PORT 5000
GiteaMirror commented 2026-04-28 07:17:00 -05:00
Author
Owner
Copy Link

@online2311 commented on GitHub (Apr 25, 2024):

Use a normal, temporary solution after passing the litellm proxy.

<!-- gh-comment-id:2076239444 --> @online2311 commented on GitHub (Apr 25, 2024): Use a normal, temporary solution after passing the litellm proxy.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
 python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
No Label question
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#48231
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?