[GH-ISSUE #7179] rhymes-ai/Aria #51070

Open
opened 2026-04-28 18:14:57 -05:00 by GiteaMirror · 4 comments
Owner

Originally created by @AlgorithmicKing737 on GitHub (Oct 12, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/7179

This multimodal model outperforms both LLaMA 3.2 (11B Vision) and PixTral 12B. According to the Hugging Face page, it has 25.3 billion parameters and can be loaded onto a single A100 (80GB) GPU with bfloat16 precision. In my tests, it got the result of an image right, where LLaMA 3.2 (72B) failed.

Originally created by @AlgorithmicKing737 on GitHub (Oct 12, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/7179 This multimodal model outperforms both LLaMA 3.2 (11B Vision) and PixTral 12B. According to the Hugging Face page, it has 25.3 billion parameters and can be loaded onto a single A100 (80GB) GPU with bfloat16 precision. In my tests, it got the result of an image right, where LLaMA 3.2 (72B) failed.
GiteaMirror added the model label 2026-04-28 18:14:58 -05:00
Author
Owner

@AlgorithmicKing737 commented on GitHub (Oct 15, 2024):

@rick-github sorry for ping but no one has replied to my post in 3 days

<!-- gh-comment-id:2412604508 --> @AlgorithmicKing737 commented on GitHub (Oct 15, 2024): @rick-github sorry for ping but no one has replied to my post in 3 days
Author
Owner

@AlgorithmicKing737 commented on GitHub (Oct 15, 2024):

@dhiltgen

<!-- gh-comment-id:2412606504 --> @AlgorithmicKing737 commented on GitHub (Oct 15, 2024): @dhiltgen
Author
Owner

@rick-github commented on GitHub (Oct 15, 2024):

Needs support in llama.cpp: https://github.com/ggerganov/llama.cpp/discussions/9845

<!-- gh-comment-id:2413820111 --> @rick-github commented on GitHub (Oct 15, 2024): Needs support in llama.cpp: https://github.com/ggerganov/llama.cpp/discussions/9845
Author
Owner

@alipyth commented on GitHub (Oct 24, 2024):

Please add this model on ollama

<!-- gh-comment-id:2436276891 --> @alipyth commented on GitHub (Oct 24, 2024): Please add this model on ollama
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#51070