[GH-ISSUE #1457] How to add MOE model Mistral 8x7B #47293

Closed
opened 2026-04-28 03:31:13 -05:00 by GiteaMirror · 2 comments
Owner

Originally created by @SabareeshGC on GitHub (Dec 11, 2023).
Original GitHub issue: https://github.com/ollama/ollama/issues/1457

Originally assigned to: @jmorganca on GitHub.

Here is the model not sure how to add it to ollama
https://huggingface.co/mattshumer/mistral-8x7b-chat

Originally created by @SabareeshGC on GitHub (Dec 11, 2023). Original GitHub issue: https://github.com/ollama/ollama/issues/1457 Originally assigned to: @jmorganca on GitHub. Here is the model not sure how to add it to ollama https://huggingface.co/mattshumer/mistral-8x7b-chat
GiteaMirror added the feature request label 2026-04-28 03:31:13 -05:00
Author
Owner

@easp commented on GitHub (Dec 11, 2023):

It'll need to be supported by llama.cpp first, and then Ollama will have to update to use a version of llama.cpp that supports it.

<!-- gh-comment-id:1849354781 --> @easp commented on GitHub (Dec 11, 2023): It'll need to be supported by llama.cpp first, and then Ollama will have to update to use a version of llama.cpp that supports it.
Author
Owner

@SabareeshGC commented on GitHub (Dec 11, 2023):

i believe this pr should enable support to llama.cpp https://github.com/ggerganov/llama.cpp/pull/4406

<!-- gh-comment-id:1851008474 --> @SabareeshGC commented on GitHub (Dec 11, 2023): i believe this pr should enable support to llama.cpp https://github.com/ggerganov/llama.cpp/pull/4406
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#47293