[GH-ISSUE #9716] server panic when run gemma-3-27b-it-GGUF #52861

Closed
opened 2026-04-29 01:13:30 -05:00 by GiteaMirror · 0 comments
Owner

Originally created by @Sisphyus on GitHub (Mar 13, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/9716

What is the issue?

model: hf.co/unsloth/gemma-3-27b-it-GGUF:Q4_K_M

Relevant log output

[GIN] 2025/03/13 - 15:53:23 | 500 |  216.479399ms |       127.0.0.1 | POST     "/v1/chat/completions"
time=2025-03-13T15:53:24.713+08:00 level=INFO source=server.go:3634 msg="http: panic serving 127.0.0.1:34336: runtime error: integer divide by zero\ngoroutine 1321 [running]:\nnet/http.(*conn).serve.func1()\n\tnet/http/server.go:1947 +0xbe\npanic({0x5635f73af260?, 0x5635f7ca81c0?})\n\truntime/panic.go:787 +0x132\ngithub.com/ollama/ollama/model/models/gemma3.(*VisionModel).Forward(0xc0cf0e2870?, {0x5635f7506c00?, 0xc0cf0e2870?}, {0x5635f750f210?, 0xc0033aa630?})\n\tgithub.com/ollama/ollama/model/models/gemma3/model_vision.go:88 +0x399\ngithub.com/ollama/ollama/model/models/gemma3.(*Model).EncodeMultimodal(0xc000798070, {0x5635f7506c00, 0xc0cf0e2870}, {0xc12338c000, 0x227ec, 0x227ee})\n\tgithub.com/ollama/ollama/model/models/gemma3/model.go:106 +0x18e\ngithub.com/ollama/ollama/runner/ollamarunner.(*Server).inputs(0xc000034d80, {0x5635f7506c00, 0xc0cf0e2870}, {0xc000318320, 0xa0}, {0xc0cf0e2840, 0x1, 0xc0035d5650?})\n\tgithub.com/ollama/ollama/runner/ollamarunner/runner.go:191 +0x3d2\ngithub.com/ollama/ollama/runner/ollamarunner.(*Server).NewSequence(0xc000034d80, {0xc000318320, 0xa0}, {0xc0cf0e2840, 0x1, 0x1}, {0x8000, {0xc01ec6a3a0, 0x2, 0x2}, ...})\n\tgithub.com/ollama/ollama/runner/ollamarunner/runner.go:103 +0xd5\ngithub.com/ollama/ollama/runner/ollamarunner.(*Server).completion(0xc000034d80, {0x5635f74fd4f8, 0xc0cf0f6000}, 0xc003397b80)\n\tgithub.com/ollama/ollama/runner/ollamarunner/runner.go:602 +0x54f\nnet/http.HandlerFunc.ServeHTTP(0xc000762780?, {0x5635f74fd4f8?, 0xc0cf0f6000?}, 0xc0035d5b60?)\n\tnet/http/server.go:2294 +0x29\nnet/http.(*ServeMux).ServeHTTP(0x5635f61ca125?, {0x5635f74fd4f8, 0xc0cf0f6000}, 0xc003397b80)\n\tnet/http/server.go:2822 +0x1c4\nnet/http.serverHandler.ServeHTTP({0x5635f74f9b10?}, {0x5635f74fd4f8?, 0xc0cf0f6000?}, 0x1?)\n\tnet/http/server.go:3301 +0x8e\nnet/http.(*conn).serve(0xc001bfc3f0, {0x5635f74ff5a8, 0xc00078db90})\n\tnet/http/server.go:2102 +0x625\ncreated by net/http.(*Server).Serve in goroutine 1\n\tnet/http/server.go:3454 +0x485"

OS

Linux

GPU

Nvidia

CPU

Intel

Ollama version

0.6.0

Originally created by @Sisphyus on GitHub (Mar 13, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/9716 ### What is the issue? model: hf.co/unsloth/gemma-3-27b-it-GGUF:Q4_K_M ### Relevant log output ```shell [GIN] 2025/03/13 - 15:53:23 | 500 | 216.479399ms | 127.0.0.1 | POST "/v1/chat/completions" time=2025-03-13T15:53:24.713+08:00 level=INFO source=server.go:3634 msg="http: panic serving 127.0.0.1:34336: runtime error: integer divide by zero\ngoroutine 1321 [running]:\nnet/http.(*conn).serve.func1()\n\tnet/http/server.go:1947 +0xbe\npanic({0x5635f73af260?, 0x5635f7ca81c0?})\n\truntime/panic.go:787 +0x132\ngithub.com/ollama/ollama/model/models/gemma3.(*VisionModel).Forward(0xc0cf0e2870?, {0x5635f7506c00?, 0xc0cf0e2870?}, {0x5635f750f210?, 0xc0033aa630?})\n\tgithub.com/ollama/ollama/model/models/gemma3/model_vision.go:88 +0x399\ngithub.com/ollama/ollama/model/models/gemma3.(*Model).EncodeMultimodal(0xc000798070, {0x5635f7506c00, 0xc0cf0e2870}, {0xc12338c000, 0x227ec, 0x227ee})\n\tgithub.com/ollama/ollama/model/models/gemma3/model.go:106 +0x18e\ngithub.com/ollama/ollama/runner/ollamarunner.(*Server).inputs(0xc000034d80, {0x5635f7506c00, 0xc0cf0e2870}, {0xc000318320, 0xa0}, {0xc0cf0e2840, 0x1, 0xc0035d5650?})\n\tgithub.com/ollama/ollama/runner/ollamarunner/runner.go:191 +0x3d2\ngithub.com/ollama/ollama/runner/ollamarunner.(*Server).NewSequence(0xc000034d80, {0xc000318320, 0xa0}, {0xc0cf0e2840, 0x1, 0x1}, {0x8000, {0xc01ec6a3a0, 0x2, 0x2}, ...})\n\tgithub.com/ollama/ollama/runner/ollamarunner/runner.go:103 +0xd5\ngithub.com/ollama/ollama/runner/ollamarunner.(*Server).completion(0xc000034d80, {0x5635f74fd4f8, 0xc0cf0f6000}, 0xc003397b80)\n\tgithub.com/ollama/ollama/runner/ollamarunner/runner.go:602 +0x54f\nnet/http.HandlerFunc.ServeHTTP(0xc000762780?, {0x5635f74fd4f8?, 0xc0cf0f6000?}, 0xc0035d5b60?)\n\tnet/http/server.go:2294 +0x29\nnet/http.(*ServeMux).ServeHTTP(0x5635f61ca125?, {0x5635f74fd4f8, 0xc0cf0f6000}, 0xc003397b80)\n\tnet/http/server.go:2822 +0x1c4\nnet/http.serverHandler.ServeHTTP({0x5635f74f9b10?}, {0x5635f74fd4f8?, 0xc0cf0f6000?}, 0x1?)\n\tnet/http/server.go:3301 +0x8e\nnet/http.(*conn).serve(0xc001bfc3f0, {0x5635f74ff5a8, 0xc00078db90})\n\tnet/http/server.go:2102 +0x625\ncreated by net/http.(*Server).Serve in goroutine 1\n\tnet/http/server.go:3454 +0x485" ``` ### OS Linux ### GPU Nvidia ### CPU Intel ### Ollama version 0.6.0
GiteaMirror added the bug label 2026-04-29 01:13:30 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#52861