[GH-ISSUE #909] Error: unexpected end of JSON input #26201

Closed
opened 2026-04-22 02:15:33 -05:00 by GiteaMirror · 5 comments
Owner

Originally created by @mchiang0610 on GitHub (Oct 26, 2023).
Original GitHub issue: https://github.com/ollama/ollama/issues/909

I was testing using fly.io on an A100 40GB in ORD region:

curl -X POST https://REDACTED.fly.dev/api/pull -d '{"name": "llama2:13b"}'
{"error":"unexpected end of JSON input"}

In the logs:

2023-10-26T04:01:54.300 app[REDACTED] ord [info] [GIN] 2023/10/26 - 04:01:54 | 200 | 314.1µs | 174.xxx.xxx.xxx | POST "/api/pull"
Originally created by @mchiang0610 on GitHub (Oct 26, 2023). Original GitHub issue: https://github.com/ollama/ollama/issues/909 I was testing using fly.io on an A100 40GB in ORD region: ``` curl -X POST https://REDACTED.fly.dev/api/pull -d '{"name": "llama2:13b"}' {"error":"unexpected end of JSON input"} ``` In the logs: ``` 2023-10-26T04:01:54.300 app[REDACTED] ord [info] [GIN] 2023/10/26 - 04:01:54 | 200 | 314.1µs | 174.xxx.xxx.xxx | POST "/api/pull" ```
GiteaMirror added the good first issuebug labels 2026-04-22 02:15:33 -05:00
Author
Owner

@brodante commented on GitHub (Nov 9, 2023):

hey can I work on this issue? It's going to be my first ever open source contribution!

<!-- gh-comment-id:1803215224 --> @brodante commented on GitHub (Nov 9, 2023): hey can I work on this issue? It's going to be my first ever open source contribution!
Author
Owner

@dwk601 commented on GitHub (Jan 2, 2024):

Can I participate to the issue?

<!-- gh-comment-id:1874568402 --> @dwk601 commented on GitHub (Jan 2, 2024): Can I participate to the issue?
Author
Owner

@leobenkel commented on GitHub (Jan 4, 2024):

I am experiencing this issue and I do not know how to figure out what was the broken payload. Is there a way to increase logging on the docker ollama side? The log only says

[GIN] 2024/01/04 - 10:44:59 | 500 |     943.633µs |      0.0.0.0 | POST     "/api/generate"
<!-- gh-comment-id:1876886325 --> @leobenkel commented on GitHub (Jan 4, 2024): I am experiencing this issue and I do not know how to figure out what was the broken payload. Is there a way to increase logging on the docker ollama side? The log only says ``` [GIN] 2024/01/04 - 10:44:59 | 500 | 943.633µs | 0.0.0.0 | POST "/api/generate" ```
Author
Owner

@cjhetzle commented on GitHub (Feb 28, 2024):

Is this still an issue? I am unable to replicate the issue locally.

<!-- gh-comment-id:1968049246 --> @cjhetzle commented on GitHub (Feb 28, 2024): Is this still an issue? I am unable to replicate the issue locally.
Author
Owner

@BruceMacD commented on GitHub (Mar 11, 2024):

Good call @cjhetzle, this is no longer an issue as we have since updated how we run models.

<!-- gh-comment-id:1989232833 --> @BruceMacD commented on GitHub (Mar 11, 2024): Good call @cjhetzle, this is no longer an issue as we have since updated how we run models.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#26201