[GH-ISSUE #12697] Ollama cant load cloud models #54938

Closed
opened 2026-04-29 08:02:44 -05:00 by GiteaMirror · 0 comments
Owner

Originally created by @1TSnakers on GitHub (Oct 19, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/12697

Originally assigned to: @pdevine on GitHub.

What is the issue?

When doing POST /api/chat with the input:

{
"model": "gpt-oss:20b-cloud",
"keep_alive": 0,
"messages": []
}

It gives a 500 error. This doesn't really matter since its a cloud model and isnt loaded in RAM, but for error trapping purposes, it should just recognize that it is a cloud model and give a 200 code.

Relevant log output

2025/10/19 17:08:56 [Recovery] 2025/10/19 - 17:08:56 panic recovered:
runtime error: index out of range [0] with length 0
C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/panic.go:115 (0x7ff62285fc93)
C:/a/ollama/ollama/server/routes.go:1820 (0x7ff62350b66a)
C:/Users/runneradmin/go/pkg/mod/github.com/gin-gonic/gin@v1.10.0/context.go:185 (0x7ff622f8788a)
C:/a/ollama/ollama/server/routes.go:1370 (0x7ff623505bf4)
C:/Users/runneradmin/go/pkg/mod/github.com/gin-gonic/gin@v1.10.0/context.go:185 (0x7ff622f956ae)
C:/Users/runneradmin/go/pkg/mod/github.com/gin-gonic/gin@v1.10.0/recovery.go:102 (0x7ff622f9569b)
C:/Users/runneradmin/go/pkg/mod/github.com/gin-gonic/gin@v1.10.0/context.go:185 (0x7ff622f947e4)
C:/Users/runneradmin/go/pkg/mod/github.com/gin-gonic/gin@v1.10.0/logger.go:249 (0x7ff622f947cb)
C:/Users/runneradmin/go/pkg/mod/github.com/gin-gonic/gin@v1.10.0/context.go:185 (0x7ff622f93c31)
C:/Users/runneradmin/go/pkg/mod/github.com/gin-gonic/gin@v1.10.0/gin.go:633 (0x7ff622f936c0)
C:/Users/runneradmin/go/pkg/mod/github.com/gin-gonic/gin@v1.10.0/gin.go:589 (0x7ff622f931e9)
C:/hostedtoolcache/windows/go/1.24.0/x64/src/net/http/server.go:2822 (0x7ff622ba6b03)
C:/hostedtoolcache/windows/go/1.24.0/x64/src/net/http/server.go:3301 (0x7ff622bc458d)
C:/hostedtoolcache/windows/go/1.24.0/x64/src/net/http/server.go:2102 (0x7ff622ba3104)
C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 (0x7ff62289dac0)

[GIN] 2025/10/19 - 17:08:56 | 500 |      2.3575ms |       127.0.0.1 | POST     "/api/chat"

OS

Windows

GPU

Nvidia

CPU

Intel

Ollama version

0.12.5

Originally created by @1TSnakers on GitHub (Oct 19, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/12697 Originally assigned to: @pdevine on GitHub. ### What is the issue? When doing `POST /api/chat` with the input: ```json { "model": "gpt-oss:20b-cloud", "keep_alive": 0, "messages": [] } ``` It gives a 500 error. This doesn't really matter since its a cloud model and isnt loaded in RAM, but for error trapping purposes, it should just recognize that it is a cloud model and give a 200 code. ### Relevant log output ```shell 2025/10/19 17:08:56 [Recovery] 2025/10/19 - 17:08:56 panic recovered: runtime error: index out of range [0] with length 0 C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/panic.go:115 (0x7ff62285fc93) C:/a/ollama/ollama/server/routes.go:1820 (0x7ff62350b66a) C:/Users/runneradmin/go/pkg/mod/github.com/gin-gonic/gin@v1.10.0/context.go:185 (0x7ff622f8788a) C:/a/ollama/ollama/server/routes.go:1370 (0x7ff623505bf4) C:/Users/runneradmin/go/pkg/mod/github.com/gin-gonic/gin@v1.10.0/context.go:185 (0x7ff622f956ae) C:/Users/runneradmin/go/pkg/mod/github.com/gin-gonic/gin@v1.10.0/recovery.go:102 (0x7ff622f9569b) C:/Users/runneradmin/go/pkg/mod/github.com/gin-gonic/gin@v1.10.0/context.go:185 (0x7ff622f947e4) C:/Users/runneradmin/go/pkg/mod/github.com/gin-gonic/gin@v1.10.0/logger.go:249 (0x7ff622f947cb) C:/Users/runneradmin/go/pkg/mod/github.com/gin-gonic/gin@v1.10.0/context.go:185 (0x7ff622f93c31) C:/Users/runneradmin/go/pkg/mod/github.com/gin-gonic/gin@v1.10.0/gin.go:633 (0x7ff622f936c0) C:/Users/runneradmin/go/pkg/mod/github.com/gin-gonic/gin@v1.10.0/gin.go:589 (0x7ff622f931e9) C:/hostedtoolcache/windows/go/1.24.0/x64/src/net/http/server.go:2822 (0x7ff622ba6b03) C:/hostedtoolcache/windows/go/1.24.0/x64/src/net/http/server.go:3301 (0x7ff622bc458d) C:/hostedtoolcache/windows/go/1.24.0/x64/src/net/http/server.go:2102 (0x7ff622ba3104) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 (0x7ff62289dac0) [GIN] 2025/10/19 - 17:08:56 | 500 | 2.3575ms | 127.0.0.1 | POST "/api/chat" ``` ### OS Windows ### GPU Nvidia ### CPU Intel ### Ollama version 0.12.5
GiteaMirror added the bug label 2026-04-29 08:02:44 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#54938