[GH-ISSUE #3635] jetmoe-8b #2241

Open
opened 2026-04-12 12:30:59 -05:00 by GiteaMirror · 1 comment
Owner

Originally created by @Axenide on GitHub (Apr 14, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/3635

What model would you like?

JetMoE is a Mixture of Experts model that reaches Llama2 performance while having only 2.2B parameters active. I think this has a lot of potential for low end devices and will be good to have it in the Ollama library.
https://huggingface.co/jetmoe/jetmoe-8b
https://huggingface.co/jetmoe/jetmoe-8b-chat
https://huggingface.co/jetmoe/jetmoe-8b-sft

Originally created by @Axenide on GitHub (Apr 14, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/3635 ### What model would you like? JetMoE is a Mixture of Experts model that reaches Llama2 performance while having only 2.2B parameters active. I think this has a lot of potential for low end devices and will be good to have it in the Ollama library. https://huggingface.co/jetmoe/jetmoe-8b https://huggingface.co/jetmoe/jetmoe-8b-chat https://huggingface.co/jetmoe/jetmoe-8b-sft
GiteaMirror added the model label 2026-04-12 12:30:59 -05:00
Author
Owner

@hydroid7 commented on GitHub (Apr 16, 2024):

I think this depends on https://github.com/ggerganov/llama.cpp/issues/6499

<!-- gh-comment-id:2058417390 --> @hydroid7 commented on GitHub (Apr 16, 2024): I think this depends on https://github.com/ggerganov/llama.cpp/issues/6499
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#2241