[GH-ISSUE #4606] MiniCPM-Llama3-V 2.5 #49404

Closed
opened 2026-04-28 11:42:32 -05:00 by GiteaMirror · 9 comments
Owner

Originally created by @ycyy on GitHub (May 24, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/4606

https://github.com/OpenBMB/MiniCPM-V

[2024.05.24] We release the MiniCPM-Llama3-V 2.5 gguf, which supports llama.cpp inference and provides a 6~8 token/s smooth decoding on mobile phones. Try it now!

Originally created by @ycyy on GitHub (May 24, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/4606 [https://github.com/OpenBMB/MiniCPM-V](MiniCPM-V) > [2024.05.24] We release the [MiniCPM-Llama3-V 2.5 gguf](https://huggingface.co/openbmb/MiniCPM-Llama3-V-2_5-gguf), which supports [llama.cpp](https://github.com/OpenBMB/MiniCPM-V#inference-with-llamacpp) inference and provides a 6~8 token/s smooth decoding on mobile phones. Try it now!
GiteaMirror added the model label 2026-04-28 11:42:32 -05:00
Author
Owner

@Cuiunbo commented on GitHub (May 24, 2024):

+1

<!-- gh-comment-id:2129030228 --> @Cuiunbo commented on GitHub (May 24, 2024): +1
Author
Owner

@coxfrederic commented on GitHub (May 24, 2024):

Would be awesome to get this into Ollama!

<!-- gh-comment-id:2129320296 --> @coxfrederic commented on GitHub (May 24, 2024): Would be awesome to get this into Ollama!
Author
Owner

@Fertony commented on GitHub (May 25, 2024):

+1

<!-- gh-comment-id:2130693486 --> @Fertony commented on GitHub (May 25, 2024): +1
Author
Owner

@Cuiunbo commented on GitHub (May 25, 2024):

https://github.com/OpenBMB/ollama Here is the fork for MiniCPM-Llama3-V 2.5
@ycyy @Fertony @coxfrederic

<!-- gh-comment-id:2131009783 --> @Cuiunbo commented on GitHub (May 25, 2024): https://github.com/OpenBMB/ollama Here is the fork for MiniCPM-Llama3-V 2.5 @ycyy @Fertony @coxfrederic
Author
Owner

@lingyezhixing commented on GitHub (May 30, 2024):

This is the strongest visual model I've ever seen, and I'm really looking forward to using it on the ollama.

<!-- gh-comment-id:2138866027 --> @lingyezhixing commented on GitHub (May 30, 2024): This is the strongest visual model I've ever seen, and I'm really looking forward to using it on the ollama.
Author
Owner

@microflyer commented on GitHub (Jun 6, 2024):

It would be great if more vision models are supported. e.g. MiniCPM, Cogvlm2 and phi-3 vision.

<!-- gh-comment-id:2152080505 --> @microflyer commented on GitHub (Jun 6, 2024): It would be great if more vision models are supported. e.g. MiniCPM, Cogvlm2 and phi-3 vision.
Author
Owner

@kotaxyz commented on GitHub (Jun 7, 2024):

+1

<!-- gh-comment-id:2154373883 --> @kotaxyz commented on GitHub (Jun 7, 2024): +1
Author
Owner

@Leroy-X commented on GitHub (Jun 9, 2024):

+1

<!-- gh-comment-id:2156401457 --> @Leroy-X commented on GitHub (Jun 9, 2024): +1
Author
Owner

@jmorganca commented on GitHub (Jun 9, 2024):

Thanks for the issue! Closing for https://github.com/ollama/ollama/issues/4900

<!-- gh-comment-id:2156703377 --> @jmorganca commented on GitHub (Jun 9, 2024): Thanks for the issue! Closing for https://github.com/ollama/ollama/issues/4900
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#49404