[GH-ISSUE #6896] Model request: Ovis1.6-Gemma2-9B small vision model #50875

Open
opened 2026-04-28 17:18:53 -05:00 by GiteaMirror · 1 comment
Owner

Originally created by @Jonseed on GitHub (Sep 20, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/6896

Performance: With just 10B parameters, Ovis1.6-Gemma2-9B leads the OpenCompass benchmark among open-source MLLMs within 30B parameters.

FBw_icZic56Dm1XyzJaxA

Originally created by @Jonseed on GitHub (Sep 20, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/6896 Performance: With just 10B parameters, [Ovis1.6-Gemma2-9B](https://huggingface.co/AIDC-AI/Ovis1.6-Gemma2-9B) leads the OpenCompass benchmark among open-source MLLMs within 30B parameters. ![FBw_icZic56Dm1XyzJaxA](https://github.com/user-attachments/assets/859d1f99-8ab6-46ae-81e3-9294d97a34d8)
GiteaMirror added the model label 2026-04-28 17:18:53 -05:00
Author
Owner

@Jonseed commented on GitHub (Nov 4, 2024):

There are now official 4-bit versions available:

https://huggingface.co/AIDC-AI/Ovis1.6-Gemma2-9B-GPTQ-Int4

https://huggingface.co/AIDC-AI/Ovis1.6-Llama3.2-3B-GPTQ-Int4

<!-- gh-comment-id:2454774668 --> @Jonseed commented on GitHub (Nov 4, 2024): There are now official 4-bit versions available: https://huggingface.co/AIDC-AI/Ovis1.6-Gemma2-9B-GPTQ-Int4 https://huggingface.co/AIDC-AI/Ovis1.6-Llama3.2-3B-GPTQ-Int4
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#50875