[GH-ISSUE #14718] panic: failed to sample token #35275

Open
opened 2026-04-22 19:40:12 -05:00 by GiteaMirror · 0 comments
Owner

Originally created by @ng0177 on GitHub (Mar 8, 2026).
Original GitHub issue: https://github.com/ollama/ollama/issues/14718

What is the issue?

Interestingly, no problems are encountered on an almost identical MSI Laptop but the present one gives below error.

Relevant log output

sudo systemctl status ollama
● ollama.service - Server for local large language models
     Loaded: loaded (/etc/systemd/system/ollama.service; enabled; preset: ignored)
     Active: active (running) since Sun 2026-03-08 11:24:06 CET; 5min ago
 Invocation: 5a47e212b4e04c15ab6df791437be417
   Main PID: 1288 (.ollama-wrapped)
         IP: 37.4K in, 181.4K out
         IO: 3.4G read, 7.1M written
      Tasks: 22 (limit: 18392)
     Memory: 3.5G (peak: 4.7G)
        CPU: 31.095s
     CGroup: /system.slice/ollama.service
             └─1288 /nix/store/mf0nd1azczdzqkmihjllagcfq51ayi4l-ollama-0.12.11/bin/ollama serve

Mär 08 11:28:15 nixos ollama[1288]: time=2026-03-08T11:28:15.194+01:00 level=INFO source=server.go:1332 msg="llama runner started in 11.99 seconds"
Mär 08 11:28:25 nixos ollama[1288]: panic: failed to sample token
Mär 08 11:28:25 nixos ollama[1288]: goroutine 937 [running]:
Mär 08 11:28:25 nixos ollama[1288]: github.com/ollama/ollama/runner/ollamarunner.(*Server).computeBatch(0xc000240f00, {0x0, {0x63a2b0, 0xc00014a280}, {0x646b68, 0xc00157ef48}, {0xc000714380, 0xd, 0x10}, {{0x646b68, ...}, ...}, ...})
Mär 08 11:28:25 nixos ollama[1288]:         github.com/ollama/ollama/runner/ollamarunner/runner.go:763 +0x1aa7
Mär 08 11:28:25 nixos ollama[1288]: created by github.com/ollama/ollama/runner/ollamarunner.(*Server).run in goroutine 51
Mär 08 11:28:25 nixos ollama[1288]:         github.com/ollama/ollama/runner/ollamarunner/runner.go:458 +0x2cd
Mär 08 11:28:25 nixos ollama[1288]: time=2026-03-08T11:28:25.321+01:00 level=ERROR source=server.go:1539 msg="post predict" error="Post \"http://127.0.0.1:35495/completion\": EOF"

OS

Linux

GPU

AMD

CPU

Intel

Ollama version

0.12.11

Originally created by @ng0177 on GitHub (Mar 8, 2026). Original GitHub issue: https://github.com/ollama/ollama/issues/14718 ### What is the issue? Interestingly, no problems are encountered on an almost identical MSI Laptop but the present one gives below error. ### Relevant log output ```shell sudo systemctl status ollama ● ollama.service - Server for local large language models Loaded: loaded (/etc/systemd/system/ollama.service; enabled; preset: ignored) Active: active (running) since Sun 2026-03-08 11:24:06 CET; 5min ago Invocation: 5a47e212b4e04c15ab6df791437be417 Main PID: 1288 (.ollama-wrapped) IP: 37.4K in, 181.4K out IO: 3.4G read, 7.1M written Tasks: 22 (limit: 18392) Memory: 3.5G (peak: 4.7G) CPU: 31.095s CGroup: /system.slice/ollama.service └─1288 /nix/store/mf0nd1azczdzqkmihjllagcfq51ayi4l-ollama-0.12.11/bin/ollama serve Mär 08 11:28:15 nixos ollama[1288]: time=2026-03-08T11:28:15.194+01:00 level=INFO source=server.go:1332 msg="llama runner started in 11.99 seconds" Mär 08 11:28:25 nixos ollama[1288]: panic: failed to sample token Mär 08 11:28:25 nixos ollama[1288]: goroutine 937 [running]: Mär 08 11:28:25 nixos ollama[1288]: github.com/ollama/ollama/runner/ollamarunner.(*Server).computeBatch(0xc000240f00, {0x0, {0x63a2b0, 0xc00014a280}, {0x646b68, 0xc00157ef48}, {0xc000714380, 0xd, 0x10}, {{0x646b68, ...}, ...}, ...}) Mär 08 11:28:25 nixos ollama[1288]: github.com/ollama/ollama/runner/ollamarunner/runner.go:763 +0x1aa7 Mär 08 11:28:25 nixos ollama[1288]: created by github.com/ollama/ollama/runner/ollamarunner.(*Server).run in goroutine 51 Mär 08 11:28:25 nixos ollama[1288]: github.com/ollama/ollama/runner/ollamarunner/runner.go:458 +0x2cd Mär 08 11:28:25 nixos ollama[1288]: time=2026-03-08T11:28:25.321+01:00 level=ERROR source=server.go:1539 msg="post predict" error="Post \"http://127.0.0.1:35495/completion\": EOF" ``` ### OS Linux ### GPU AMD ### CPU Intel ### Ollama version 0.12.11
GiteaMirror added the bug label 2026-04-22 19:40:12 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#35275