[GH-ISSUE #6722] MiniCPM3 support #29994

Open
opened 2026-04-22 09:24:00 -05:00 by GiteaMirror · 4 comments
Owner

Originally created by @IuvenisSapiens on GitHub (Sep 10, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/6722

MiniCPM3-4B is the 3rd generation of MiniCPM series. The overall performance of MiniCPM3-4B surpasses Phi-3.5-mini-Instruct and GPT-3.5-Turbo-0125, being comparable with many recent 7B~9B models.

Originally created by @IuvenisSapiens on GitHub (Sep 10, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/6722 [MiniCPM3-4B](https://huggingface.co/openbmb/MiniCPM3-4B) is the 3rd generation of MiniCPM series. The overall performance of MiniCPM3-4B surpasses Phi-3.5-mini-Instruct and GPT-3.5-Turbo-0125, being comparable with many recent 7B~9B models.
GiteaMirror added the model label 2026-04-22 09:24:00 -05:00
Author
Owner

@rick-github commented on GitHub (Sep 10, 2024):

https://github.com/ggerganov/llama.cpp/pull/9322

<!-- gh-comment-id:2340036510 --> @rick-github commented on GitHub (Sep 10, 2024): https://github.com/ggerganov/llama.cpp/pull/9322
Author
Owner

@heshunme commented on GitHub (Oct 17, 2024):

@jmorganca Hi, the llama.cpp repository has already merged that pull request https://github.com/ggerganov/llama.cpp/pull/9322 on Sep 16.
May I ask when the update will be reflected in the Ollama project?

<!-- gh-comment-id:2419352384 --> @heshunme commented on GitHub (Oct 17, 2024): @jmorganca Hi, the llama.cpp repository has already merged that pull request https://github.com/ggerganov/llama.cpp/pull/9322 on Sep 16. May I ask when the update will be reflected in the Ollama project?
Author
Owner

@rick-github commented on GitHub (Dec 2, 2024):

ollama supports this model now, it just needs to be imported. the chat template is long and complicated, re-using the one from minicpm-v works but doesn't support tools.

$ ollama run minicpm3:4b-fp16 hello
Hi, I am a MiniCPM series model, developed by Modelbest and OpenBMB. For more information, please visit https://github.com/OpenBMB/
<!-- gh-comment-id:2513139515 --> @rick-github commented on GitHub (Dec 2, 2024): ollama supports this model now, it just needs to be imported. the chat template is long and complicated, re-using the one from minicpm-v works but doesn't support tools. ```console $ ollama run minicpm3:4b-fp16 hello Hi, I am a MiniCPM series model, developed by Modelbest and OpenBMB. For more information, please visit https://github.com/OpenBMB/ ```
Author
Owner

@nicognaW commented on GitHub (Dec 4, 2024):

ollama supports this model now, it just needs to be imported. the chat template is long and complicated, re-using the one from minicpm-v works but doesn't support tools.

$ ollama run minicpm3:4b-fp16 hello
Hi, I am a MiniCPM series model, developed by Modelbest and OpenBMB. For more information, please visit https://github.com/OpenBMB/

I know that there are some community versions for this model, but I couldn't get the official minicpm3.

❯ ollama run minicpm3:4b-fp16 hello
pulling manifest
Error: pull model manifest: file does not exist

~
❯ ollama --version
ollama version is 0.4.7
<!-- gh-comment-id:2516165959 --> @nicognaW commented on GitHub (Dec 4, 2024): > ollama supports this model now, it just needs to be imported. the chat template is long and complicated, re-using the one from minicpm-v works but doesn't support tools. > > ``` > $ ollama run minicpm3:4b-fp16 hello > Hi, I am a MiniCPM series model, developed by Modelbest and OpenBMB. For more information, please visit https://github.com/OpenBMB/ > ``` I know that there are some community versions for this model, but I couldn't get [the official `minicpm3`](https://ollama.com/library/minicpm3). ``` ❯ ollama run minicpm3:4b-fp16 hello pulling manifest Error: pull model manifest: file does not exist ~ ❯ ollama --version ollama version is 0.4.7 ```
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#29994