[GH-ISSUE #9710] Support for Vision models and Jina CLIP v2: Multilingual Multimodal Embeddings for Texts and Images #84028

Open
opened 2026-05-09 19:45:08 -05:00 by GiteaMirror · 0 comments
Owner

Originally created by @YarvixPA on GitHub (Mar 13, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/9710

Please consider other vision models and Jina CLIP v2: Multilingual Multimodal Embeddings for Texts and Images

I know you are continuously working on implementing multimodal models. I also know it's not an "easy" job, but there are already several published models with vision models.

Qwen 2.5 VL
Aya Vision
(among others...)

6 days ago, Jina AI published an embedding model for texts and images on HuggingFace. Implementing it in Ollama would be useful for image embedding.

https://huggingface.co/jinaai/jina-clip-v2

Please consider implementing more vision models as soon as possible and providing multiple quantization levels. Gemma 3 only offers Q4 or FP16... I'm interested in Q6_K_L (in my case). Perhaps other users are interested in other levels. I tried using the quantized version of Bartowski, but it doesn't have the vision capability (or at least it didn't work for me).

Originally created by @YarvixPA on GitHub (Mar 13, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/9710 **Please consider other vision models and Jina CLIP v2: Multilingual Multimodal Embeddings for Texts and Images** I know you are continuously working on implementing multimodal models. I also know it's not an "easy" job, but there are already several published models with vision models. Qwen 2.5 VL Aya Vision (among others...) 6 days ago, Jina AI published an embedding model for texts and images on HuggingFace. Implementing it in Ollama would be useful for image embedding. https://huggingface.co/jinaai/jina-clip-v2 Please consider implementing more vision models as soon as possible and providing multiple quantization levels. Gemma 3 only offers Q4 or FP16... I'm interested in Q6_K_L (in my case). Perhaps other users are interested in other levels. I tried using the quantized version of Bartowski, but it doesn't have the vision capability (or at least it didn't work for me).
GiteaMirror added the model label 2026-05-09 19:45:08 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#84028