[GH-ISSUE #9009] Error: llama runner process has terminated: GGML_ASSERT(hparams.n_expert <= LLAMA_MAX_EXPERTS) failed #5856

Closed
opened 2026-04-12 17:11:40 -05:00 by GiteaMirror · 4 comments
Owner

Originally created by @zhurunhua on GitHub (Feb 11, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/9009

What is the issue?

I try to run deepseek-r1-671b-q4-K_M on 8*A800
How to resolve this problem

Image Image

Relevant log output


OS

Linux

GPU

Nvidia

CPU

AMD

Ollama version

0.5.1

Originally created by @zhurunhua on GitHub (Feb 11, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/9009 ### What is the issue? I try to run deepseek-r1-671b-q4-K_M on 8*A800 How to resolve this problem <img width="782" alt="Image" src="https://github.com/user-attachments/assets/41332a31-cf1a-4984-8d21-054dc95b3e00" /> <img width="880" alt="Image" src="https://github.com/user-attachments/assets/69b21c29-c7a8-478b-add8-ec296a23b508" /> ### Relevant log output ```shell ``` ### OS Linux ### GPU Nvidia ### CPU AMD ### Ollama version 0.5.1
GiteaMirror added the bug label 2026-04-12 17:11:40 -05:00
Author
Owner

@rick-github commented on GitHub (Feb 11, 2025):

Try upgrading ollama.

<!-- gh-comment-id:2650236642 --> @rick-github commented on GitHub (Feb 11, 2025): Try [upgrading](https://github.com/ollama/ollama/blob/main/docs/faq.md#how-can-i-upgrade-ollama) ollama.
Author
Owner

@zhurunhua commented on GitHub (Feb 11, 2025):

Thanks

<!-- gh-comment-id:2650597935 --> @zhurunhua commented on GitHub (Feb 11, 2025): Thanks
Author
Owner

@moroboshiai commented on GitHub (Feb 11, 2025):

Thanks

Have you solved this problem?

<!-- gh-comment-id:2651264209 --> @moroboshiai commented on GitHub (Feb 11, 2025): > Thanks Have you solved this problem?
Author
Owner

@zhurunhua commented on GitHub (Feb 12, 2025):

Thanks

Have you solved this problem?

Yes~ solved by using latest version

<!-- gh-comment-id:2652561848 --> @zhurunhua commented on GitHub (Feb 12, 2025): > > Thanks > > Have you solved this problem? Yes~ solved by using latest version
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#5856