[GH-ISSUE #8366] deepseek v3 #5367

Closed
opened 2026-04-12 16:34:47 -05:00 by GiteaMirror · 3 comments
Owner

Originally created by @Morrigan-Ship on GitHub (Jan 9, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/8366

Originally created by @Morrigan-Ship on GitHub (Jan 9, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/8366
GiteaMirror added the model label 2026-04-12 16:34:47 -05:00
Author
Owner

@jjparady commented on GitHub (Jan 9, 2025):

I would also like this. In the meantime, when adding it manually I am running into an error. Not sure if this is an appropriate place for this but it seemed relevant.

When trying to run Deepseek V3 after creating the model file I get this:

Ollama run deepseek
Error: llama runner process has terminated: GGML_ASSERT(hparams.n_expert <= LLAMA_MAX_EXPERTS) failed

The llama.cpp file that sets the LLAMA_
MAX_EXPERTS value specifies that it was changed to 256 or something for deepseek v3 specifically so why am I running into this error?

<!-- gh-comment-id:2580962999 --> @jjparady commented on GitHub (Jan 9, 2025): I would also like this. In the meantime, when adding it manually I am running into an error. Not sure if this is an appropriate place for this but it seemed relevant. When trying to run Deepseek V3 after creating the model file I get this: Ollama run deepseek Error: llama runner process has terminated: GGML_ASSERT(hparams.n_expert <= LLAMA_MAX_EXPERTS) failed The llama.cpp file that sets the LLAMA_ MAX_EXPERTS value specifies that it was changed to 256 or something for deepseek v3 specifically so why am I running into this error?
Author
Owner

@kevnk commented on GitHub (Jan 10, 2025):

Duplicate of #8249

<!-- gh-comment-id:2583012674 --> @kevnk commented on GitHub (Jan 10, 2025): Duplicate of #8249
Author
Owner

@jmorganca commented on GitHub (Jan 10, 2025):

Closing for https://github.com/ollama/ollama/issues/8249

<!-- gh-comment-id:2584551182 --> @jmorganca commented on GitHub (Jan 10, 2025): Closing for https://github.com/ollama/ollama/issues/8249
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#5367