[GH-ISSUE #8901] Support IBM granite-vision-3.1-2b #5770

Closed
opened 2026-04-12 17:06:09 -05:00 by GiteaMirror · 4 comments
Owner

Originally created by @NeroHin on GitHub (Feb 7, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/8901

IBM released Granite-Vision-3.1-2B, a small vision LM
HuggingFace: https://huggingface.co/ibm-granite/granite-vision-3.1-2b-preview

Originally created by @NeroHin on GitHub (Feb 7, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/8901 IBM released Granite-Vision-3.1-2B, a small vision LM HuggingFace: https://huggingface.co/ibm-granite/granite-vision-3.1-2b-preview
GiteaMirror added the model label 2026-04-12 17:06:09 -05:00
Author
Owner

@alex-jw-brooks commented on GitHub (Feb 10, 2025):

Hey, I am currently actively working on support for granite vision models in llama cpp / ollama 😄

You can find the PR for llama cpp support here (be warned, still WIP) https://github.com/ggerganov/llama.cpp/pull/11794 - Some of the changes here may also useful for GGUF conversions for other llava next models that are based on siglip.

I will be experimenting with bringing the changes into my ollama fork soon, and will hopefully add support for this model in the very near future 🤞

<!-- gh-comment-id:2648757486 --> @alex-jw-brooks commented on GitHub (Feb 10, 2025): Hey, I am currently actively working on support for granite vision models in llama cpp / ollama 😄 You can find the PR for llama cpp support here (be warned, still WIP) https://github.com/ggerganov/llama.cpp/pull/11794 - Some of the changes here may also useful for GGUF conversions for other llava next models that are based on siglip. I will be experimenting with bringing the changes into my ollama fork soon, and will hopefully add support for this model in the very near future 🤞
Author
Owner

@NeroHin commented on GitHub (Feb 12, 2025):

@alex-jw-brooks Hi Alex, this is a warm greeting from IBM Taiwan. It's great to see IBMer making outstanding contributions in various open source project. Looking forward to hearing good news from you!

<!-- gh-comment-id:2652595969 --> @NeroHin commented on GitHub (Feb 12, 2025): @alex-jw-brooks Hi Alex, this is a warm greeting from IBM Taiwan. It's great to see IBMer making outstanding contributions in various open source project. Looking forward to hearing good news from you!
Author
Owner

@alex-jw-brooks commented on GitHub (Feb 13, 2025):

Nice to meet you also @NeroHin! 😄

I've opened a PR with a llama cpp patch for running granite vision models here 🙂

<!-- gh-comment-id:2657071068 --> @alex-jw-brooks commented on GitHub (Feb 13, 2025): Nice to meet you also @NeroHin! 😄 I've opened a PR with a llama cpp patch for running granite vision models [here](https://github.com/ollama/ollama/pull/9071) 🙂
Author
Owner

@rick-github commented on GitHub (Mar 4, 2025):

https://ollama.com/library/granite3.2-vision

<!-- gh-comment-id:2698921386 --> @rick-github commented on GitHub (Mar 4, 2025): https://ollama.com/library/granite3.2-vision
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#5770