[GH-ISSUE #6564] add Qwen2-VL/Qwen2.5-VL #4131

Closed
opened 2026-04-12 15:01:40 -05:00 by GiteaMirror · 148 comments
Owner

Originally created by @FelisDwan on GitHub (Aug 30, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/6564

SOTA light weight vision model
https://github.com/QwenLM/Qwen2-VL

llama.cpp issue #9246

Originally created by @FelisDwan on GitHub (Aug 30, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/6564 SOTA light weight vision model [https://github.com/QwenLM/Qwen2-VL](https://github.com/QwenLM/Qwen2-VL) llama.cpp issue [#9246](https://github.com/ggerganov/llama.cpp/issues/9246)
GiteaMirror added the model label 2026-04-12 15:01:40 -05:00
Author
Owner

@crzroot commented on GitHub (Aug 30, 2024):

Support joining this model

<!-- gh-comment-id:2320379647 --> @crzroot commented on GitHub (Aug 30, 2024): Support joining this model
Author
Owner

@XDesktopSoft commented on GitHub (Sep 1, 2024):

+1

<!-- gh-comment-id:2323130792 --> @XDesktopSoft commented on GitHub (Sep 1, 2024): +1
Author
Owner

@SP4595 commented on GitHub (Sep 1, 2024):

support +1

<!-- gh-comment-id:2323151469 --> @SP4595 commented on GitHub (Sep 1, 2024): support +1
Author
Owner

@Halfknow commented on GitHub (Sep 1, 2024):

hope to support

<!-- gh-comment-id:2323159335 --> @Halfknow commented on GitHub (Sep 1, 2024): hope to support
Author
Owner

@BBBOND commented on GitHub (Sep 1, 2024):

+1

<!-- gh-comment-id:2323387016 --> @BBBOND commented on GitHub (Sep 1, 2024): +1
Author
Owner

@lojik-ng commented on GitHub (Sep 1, 2024):

+1

<!-- gh-comment-id:2323540227 --> @lojik-ng commented on GitHub (Sep 1, 2024): +1
Author
Owner

@elyzionz commented on GitHub (Sep 2, 2024):

+1

<!-- gh-comment-id:2323855781 --> @elyzionz commented on GitHub (Sep 2, 2024): +1
Author
Owner

@zyfewq commented on GitHub (Sep 2, 2024):

+1

<!-- gh-comment-id:2323960713 --> @zyfewq commented on GitHub (Sep 2, 2024): +1
Author
Owner

@pmddds commented on GitHub (Sep 2, 2024):

+1

<!-- gh-comment-id:2323994429 --> @pmddds commented on GitHub (Sep 2, 2024): +1
Author
Owner

@zwqjoy commented on GitHub (Sep 2, 2024):

hope to support

<!-- gh-comment-id:2323995954 --> @zwqjoy commented on GitHub (Sep 2, 2024): hope to support
Author
Owner

@stephonye commented on GitHub (Sep 3, 2024):

*** I am really looking forward to this model being used in Ollama ***

<!-- gh-comment-id:2325857578 --> @stephonye commented on GitHub (Sep 3, 2024): *** I am really looking forward to this model being used in Ollama ***
Author
Owner

@kalkishnu commented on GitHub (Sep 3, 2024):

yes pls.

<!-- gh-comment-id:2327543477 --> @kalkishnu commented on GitHub (Sep 3, 2024): yes pls.
Author
Owner

@dannykhoo commented on GitHub (Sep 3, 2024):

support +1

<!-- gh-comment-id:2327630386 --> @dannykhoo commented on GitHub (Sep 3, 2024): support +1
Author
Owner

@AlanceLau commented on GitHub (Sep 4, 2024):

support +1

<!-- gh-comment-id:2327723454 --> @AlanceLau commented on GitHub (Sep 4, 2024): support +1
Author
Owner

@AlanceLau commented on GitHub (Sep 4, 2024):

support +1

<!-- gh-comment-id:2327723848 --> @AlanceLau commented on GitHub (Sep 4, 2024): support +1
Author
Owner

@zhaoqi571436204 commented on GitHub (Sep 4, 2024):

+1

<!-- gh-comment-id:2327770595 --> @zhaoqi571436204 commented on GitHub (Sep 4, 2024): +1
Author
Owner

@Alex-gy commented on GitHub (Sep 4, 2024):

+1 Please

<!-- gh-comment-id:2327965245 --> @Alex-gy commented on GitHub (Sep 4, 2024): +1 Please
Author
Owner

@arkerwu commented on GitHub (Sep 4, 2024):

+1

<!-- gh-comment-id:2328295899 --> @arkerwu commented on GitHub (Sep 4, 2024): +1
Author
Owner

@enryteam commented on GitHub (Sep 4, 2024):

+1

<!-- gh-comment-id:2328353791 --> @enryteam commented on GitHub (Sep 4, 2024): +1
Author
Owner

@cwbjyy commented on GitHub (Sep 4, 2024):

+1

<!-- gh-comment-id:2328569276 --> @cwbjyy commented on GitHub (Sep 4, 2024): +1
Author
Owner

@a1558878 commented on GitHub (Sep 4, 2024):

hope to support

<!-- gh-comment-id:2329369580 --> @a1558878 commented on GitHub (Sep 4, 2024): hope to support
Author
Owner

@ddpasa commented on GitHub (Sep 4, 2024):

Benchmarks look very strong, please support this model.

<!-- gh-comment-id:2329501735 --> @ddpasa commented on GitHub (Sep 4, 2024): Benchmarks look very strong, please support this model.
Author
Owner

@shivanshkaushikk commented on GitHub (Sep 4, 2024):

+1

<!-- gh-comment-id:2329717625 --> @shivanshkaushikk commented on GitHub (Sep 4, 2024): +1
Author
Owner

@Erionis commented on GitHub (Sep 5, 2024):

+1

<!-- gh-comment-id:2331063793 --> @Erionis commented on GitHub (Sep 5, 2024): +1
Author
Owner

@Milor123 commented on GitHub (Sep 5, 2024):

+1 ❤️

<!-- gh-comment-id:2331300033 --> @Milor123 commented on GitHub (Sep 5, 2024): +1 ❤️
Author
Owner

@zenoverflow commented on GitHub (Sep 5, 2024):

+1

<!-- gh-comment-id:2332065270 --> @zenoverflow commented on GitHub (Sep 5, 2024): +1
Author
Owner

@yblis commented on GitHub (Sep 6, 2024):

+1

<!-- gh-comment-id:2333345890 --> @yblis commented on GitHub (Sep 6, 2024): +1
Author
Owner

@alivekevin commented on GitHub (Sep 8, 2024):

+1

<!-- gh-comment-id:2336525174 --> @alivekevin commented on GitHub (Sep 8, 2024): +1
Author
Owner

@Reknine commented on GitHub (Sep 8, 2024):

+1

<!-- gh-comment-id:2336657949 --> @Reknine commented on GitHub (Sep 8, 2024): +1
Author
Owner

@0dram commented on GitHub (Sep 8, 2024):

+1

<!-- gh-comment-id:2336787115 --> @0dram commented on GitHub (Sep 8, 2024): +1
Author
Owner

@mosoai commented on GitHub (Sep 9, 2024):

+1

<!-- gh-comment-id:2338299385 --> @mosoai commented on GitHub (Sep 9, 2024): +1
Author
Owner

@trackcan commented on GitHub (Sep 10, 2024):

+1

<!-- gh-comment-id:2339521179 --> @trackcan commented on GitHub (Sep 10, 2024): +1
Author
Owner

@Axenide commented on GitHub (Sep 10, 2024):

+1

<!-- gh-comment-id:2341842230 --> @Axenide commented on GitHub (Sep 10, 2024): +1
Author
Owner

@PredyDaddy commented on GitHub (Sep 12, 2024):

+1

<!-- gh-comment-id:2345697076 --> @PredyDaddy commented on GitHub (Sep 12, 2024): +1
Author
Owner

@lyfuci commented on GitHub (Sep 13, 2024):

+1
I tested this model locally, and the results impressed me greatly.

<!-- gh-comment-id:2348331472 --> @lyfuci commented on GitHub (Sep 13, 2024): +1 I tested this model locally, and the results impressed me greatly.
Author
Owner

@haddyadnan commented on GitHub (Sep 13, 2024):

+1

<!-- gh-comment-id:2348506254 --> @haddyadnan commented on GitHub (Sep 13, 2024): +1
Author
Owner

@sebastianhorwege commented on GitHub (Sep 13, 2024):

+1

<!-- gh-comment-id:2348517612 --> @sebastianhorwege commented on GitHub (Sep 13, 2024): +1
Author
Owner

@Tarakzai commented on GitHub (Sep 13, 2024):

+1

<!-- gh-comment-id:2348592754 --> @Tarakzai commented on GitHub (Sep 13, 2024): +1
Author
Owner

@jasper-ooster commented on GitHub (Sep 13, 2024):

+1

<!-- gh-comment-id:2348592966 --> @jasper-ooster commented on GitHub (Sep 13, 2024): +1
Author
Owner

@bunnyfu commented on GitHub (Sep 13, 2024):

Here to support :)

<!-- gh-comment-id:2350002394 --> @bunnyfu commented on GitHub (Sep 13, 2024): Here to support :)
Author
Owner

@jeremy-windsor commented on GitHub (Sep 13, 2024):

+1 this model was able to read recipes that other models failed at and i was using openai to ocr with.

<!-- gh-comment-id:2350012104 --> @jeremy-windsor commented on GitHub (Sep 13, 2024): +1 this model was able to read recipes that other models failed at and i was using openai to ocr with.
Author
Owner

@tomyjany commented on GitHub (Sep 15, 2024):

here to support :) soon there will be the 72B version

<!-- gh-comment-id:2351627983 --> @tomyjany commented on GitHub (Sep 15, 2024): here to support :) soon there will be the 72B version
Author
Owner

@devsanbid commented on GitHub (Sep 16, 2024):

+1

<!-- gh-comment-id:2353596231 --> @devsanbid commented on GitHub (Sep 16, 2024): +1
Author
Owner

@shreyvish5678 commented on GitHub (Sep 17, 2024):

when will this be added? I've been looking to use it

<!-- gh-comment-id:2357060550 --> @shreyvish5678 commented on GitHub (Sep 17, 2024): when will this be added? I've been looking to use it
Author
Owner

@khwengXU commented on GitHub (Sep 18, 2024):

+1

<!-- gh-comment-id:2357411762 --> @khwengXU commented on GitHub (Sep 18, 2024): +1
Author
Owner

@huaji23 commented on GitHub (Sep 18, 2024):

+1

<!-- gh-comment-id:2357436401 --> @huaji23 commented on GitHub (Sep 18, 2024): +1
Author
Owner

@ankykong commented on GitHub (Sep 18, 2024):

+1

<!-- gh-comment-id:2359361401 --> @ankykong commented on GitHub (Sep 18, 2024): +1
Author
Owner

@iwannabewater commented on GitHub (Sep 19, 2024):

hope to add qwen2-vl soon, thank you all guys!

<!-- gh-comment-id:2360409573 --> @iwannabewater commented on GitHub (Sep 19, 2024): hope to add qwen2-vl soon, thank you all guys!
Author
Owner

@ep5000 commented on GitHub (Sep 22, 2024):

+1

<!-- gh-comment-id:2365384205 --> @ep5000 commented on GitHub (Sep 22, 2024): +1
Author
Owner

@wangyuc commented on GitHub (Sep 24, 2024):

+1

<!-- gh-comment-id:2370482236 --> @wangyuc commented on GitHub (Sep 24, 2024): +1
Author
Owner

@FickleLife commented on GitHub (Sep 26, 2024):

+1 !!!

<!-- gh-comment-id:2376138072 --> @FickleLife commented on GitHub (Sep 26, 2024): +1 !!!
Author
Owner

@zhaoyang0618 commented on GitHub (Sep 27, 2024):

+1!!!

<!-- gh-comment-id:2378339607 --> @zhaoyang0618 commented on GitHub (Sep 27, 2024): +1!!!
Author
Owner

@erinsrc commented on GitHub (Sep 27, 2024):

+1 Please!

<!-- gh-comment-id:2379696009 --> @erinsrc commented on GitHub (Sep 27, 2024): +1 Please!
Author
Owner

@zhaolj commented on GitHub (Sep 30, 2024):

+1 !!!

<!-- gh-comment-id:2381832039 --> @zhaolj commented on GitHub (Sep 30, 2024): +1 !!!
Author
Owner

@somnifex commented on GitHub (Oct 1, 2024):

+1

<!-- gh-comment-id:2384708151 --> @somnifex commented on GitHub (Oct 1, 2024): +1
Author
Owner

@Jakolo121 commented on GitHub (Oct 4, 2024):

+1

<!-- gh-comment-id:2393800234 --> @Jakolo121 commented on GitHub (Oct 4, 2024): +1
Author
Owner

@xiasi0 commented on GitHub (Oct 7, 2024):

+1 pls

<!-- gh-comment-id:2397433878 --> @xiasi0 commented on GitHub (Oct 7, 2024): +1 pls
Author
Owner

@diandian2023 commented on GitHub (Oct 9, 2024):

+1 Please!

<!-- gh-comment-id:2401365015 --> @diandian2023 commented on GitHub (Oct 9, 2024): +1 Please!
Author
Owner

@zhiwehu commented on GitHub (Oct 9, 2024):

++1

<!-- gh-comment-id:2402880323 --> @zhiwehu commented on GitHub (Oct 9, 2024): ++1
Author
Owner

@regoo commented on GitHub (Oct 12, 2024):

+++!

<!-- gh-comment-id:2408323165 --> @regoo commented on GitHub (Oct 12, 2024): +++!
Author
Owner

@misteral commented on GitHub (Oct 15, 2024):

+1

<!-- gh-comment-id:2413737163 --> @misteral commented on GitHub (Oct 15, 2024): +1
Author
Owner

@bughoho commented on GitHub (Oct 19, 2024):

+++++

<!-- gh-comment-id:2423624070 --> @bughoho commented on GitHub (Oct 19, 2024): +++++
Author
Owner

@supperdsj commented on GitHub (Oct 21, 2024):

+++++++++

<!-- gh-comment-id:2425902150 --> @supperdsj commented on GitHub (Oct 21, 2024): +++++++++
Author
Owner

@somnifex commented on GitHub (Oct 21, 2024):

Hey guys, let's stop the +1 or +++ activities, this is a "mail disaster" for each subscriber, just liking the existing replies is enough

<!-- gh-comment-id:2426465188 --> @somnifex commented on GitHub (Oct 21, 2024): Hey guys, let's stop the +1 or +++ activities, this is a "mail disaster" for each subscriber, just liking the existing replies is enough
Author
Owner

@zirak-ai commented on GitHub (Oct 24, 2024):

+++1

<!-- gh-comment-id:2434099200 --> @zirak-ai commented on GitHub (Oct 24, 2024): +++1
Author
Owner

@yak0 commented on GitHub (Oct 24, 2024):

++++1

<!-- gh-comment-id:2435535080 --> @yak0 commented on GitHub (Oct 24, 2024): ++++1
Author
Owner

@netixc commented on GitHub (Nov 2, 2024):

+1

<!-- gh-comment-id:2452939118 --> @netixc commented on GitHub (Nov 2, 2024): +1
Author
Owner

@eignerfr commented on GitHub (Nov 2, 2024):

+1

<!-- gh-comment-id:2453223634 --> @eignerfr commented on GitHub (Nov 2, 2024): +1
Author
Owner

@damianpdr commented on GitHub (Nov 3, 2024):

+1

<!-- gh-comment-id:2453597674 --> @damianpdr commented on GitHub (Nov 3, 2024): +1
Author
Owner

@love01211 commented on GitHub (Nov 14, 2024):

+1

<!-- gh-comment-id:2475136406 --> @love01211 commented on GitHub (Nov 14, 2024): +1
Author
Owner

@ammoti commented on GitHub (Nov 16, 2024):

one more +1

<!-- gh-comment-id:2480349208 --> @ammoti commented on GitHub (Nov 16, 2024): one more +1
Author
Owner

@Rakhsan commented on GitHub (Nov 18, 2024):

+1

<!-- gh-comment-id:2481976487 --> @Rakhsan commented on GitHub (Nov 18, 2024): +1
Author
Owner

@vardaan123 commented on GitHub (Nov 18, 2024):

+1

<!-- gh-comment-id:2483590402 --> @vardaan123 commented on GitHub (Nov 18, 2024): +1
Author
Owner

@fovendor commented on GitHub (Nov 19, 2024):

+1

<!-- gh-comment-id:2485819008 --> @fovendor commented on GitHub (Nov 19, 2024): +1
Author
Owner

@xmlvrl commented on GitHub (Nov 22, 2024):

hope to support

<!-- gh-comment-id:2493240681 --> @xmlvrl commented on GitHub (Nov 22, 2024): hope to support
Author
Owner

@sam8890 commented on GitHub (Nov 25, 2024):

+++++1

<!-- gh-comment-id:2496465239 --> @sam8890 commented on GitHub (Nov 25, 2024): +++++1
Author
Owner

@cczw2010 commented on GitHub (Nov 25, 2024):

+1 please

<!-- gh-comment-id:2498036729 --> @cczw2010 commented on GitHub (Nov 25, 2024): +1 please
Author
Owner

@Rakhsan commented on GitHub (Nov 25, 2024):

Ultra +1 this model is really good at function calling and it has a lot of potential

<!-- gh-comment-id:2498038889 --> @Rakhsan commented on GitHub (Nov 25, 2024): Ultra +1 this model is really good at function calling and it has a lot of potential
Author
Owner

@gmarkantonatos commented on GitHub (Nov 25, 2024):

+1 The model is great!

<!-- gh-comment-id:2498307175 --> @gmarkantonatos commented on GitHub (Nov 25, 2024): +1 The model is great!
Author
Owner

@yossifibrahem commented on GitHub (Nov 25, 2024):

Add my voice with you

<!-- gh-comment-id:2499276074 --> @yossifibrahem commented on GitHub (Nov 25, 2024): Add my voice with you
Author
Owner

@jochne commented on GitHub (Dec 1, 2024):

+1
plz

<!-- gh-comment-id:2509642553 --> @jochne commented on GitHub (Dec 1, 2024): +1 plz
Author
Owner

@LuWei6896 commented on GitHub (Dec 9, 2024):

++++++++1

<!-- gh-comment-id:2527315597 --> @LuWei6896 commented on GitHub (Dec 9, 2024): ++++++++1
Author
Owner

@Linnore commented on GitHub (Dec 12, 2024):

+1

<!-- gh-comment-id:2538346144 --> @Linnore commented on GitHub (Dec 12, 2024): +1
Author
Owner

@Rakhsan commented on GitHub (Dec 12, 2024):

+10^10 man pls man ollama main dev pls

<!-- gh-comment-id:2539608568 --> @Rakhsan commented on GitHub (Dec 12, 2024): +10^10 man pls man ollama main dev pls
Author
Owner

@yyqqing commented on GitHub (Dec 18, 2024):

+1

<!-- gh-comment-id:2550412948 --> @yyqqing commented on GitHub (Dec 18, 2024): +1
Author
Owner

@voyager0003 commented on GitHub (Dec 18, 2024):

Qwen2-VL work better than llama3.2-vision 11B for pictures contain Chinese Character, so just add it plz

<!-- gh-comment-id:2550770262 --> @voyager0003 commented on GitHub (Dec 18, 2024): Qwen2-VL work better than llama3.2-vision 11B for pictures contain Chinese Character, so just add it plz
Author
Owner

@Syazvinski commented on GitHub (Dec 18, 2024):

Ollama is based on Llama.cpp and guff models, qwen VL is not compatible with llama.cpp as it uses a different archetechure because of its vision. it wont be added anytime soon likley.

<!-- gh-comment-id:2551422480 --> @Syazvinski commented on GitHub (Dec 18, 2024): Ollama is based on Llama.cpp and guff models, qwen VL is not compatible with llama.cpp as it uses a different archetechure because of its vision. it wont be added anytime soon likley.
Author
Owner

@ddpasa commented on GitHub (Dec 18, 2024):

Ollama is based on Llama.cpp and guff models, qwen VL is not compatible with llama.cpp as it uses a different archetechure because of its vision. it wont be added anytime soon likley.

llama.cpp support qwen-vl now: https://github.com/ggerganov/llama.cpp/pull/10361

<!-- gh-comment-id:2551431049 --> @ddpasa commented on GitHub (Dec 18, 2024): > Ollama is based on Llama.cpp and guff models, qwen VL is not compatible with llama.cpp as it uses a different archetechure because of its vision. it wont be added anytime soon likley. llama.cpp support qwen-vl now: https://github.com/ggerganov/llama.cpp/pull/10361
Author
Owner

@ep5000 commented on GitHub (Dec 18, 2024):

I haven't followed this video in detail but it implies that Llama.cpp can run Qwen2VL: https://youtu.be/iNcqEkZH4io?si=4-wpTdbKhhEdk3JV

<!-- gh-comment-id:2551556521 --> @ep5000 commented on GitHub (Dec 18, 2024): I haven't followed this video in detail but it implies that Llama.cpp can run Qwen2VL: https://youtu.be/iNcqEkZH4io?si=4-wpTdbKhhEdk3JV
Author
Owner
<!-- gh-comment-id:2552485747 --> @chigkim commented on GitHub (Dec 18, 2024): Yes, llama.cpp supports qwen2-vl now. https://huggingface.co/bartowski/Qwen2-VL-72B-Instruct-GGUF https://huggingface.co/bartowski/Qwen2-VL-7B-Instruct-GGUF https://huggingface.co/bartowski/Qwen2-VL-2B-Instruct-GGUF
Author
Owner

@akfheaven commented on GitHub (Dec 19, 2024):

+1

<!-- gh-comment-id:2552821412 --> @akfheaven commented on GitHub (Dec 19, 2024): +1
Author
Owner

@Jovines commented on GitHub (Dec 20, 2024):

hope to support

<!-- gh-comment-id:2556094468 --> @Jovines commented on GitHub (Dec 20, 2024): hope to support
Author
Owner

@feishenebay commented on GitHub (Dec 23, 2024):

+1

<!-- gh-comment-id:2558977189 --> @feishenebay commented on GitHub (Dec 23, 2024): +1
Author
Owner

@fighter3005 commented on GitHub (Dec 23, 2024):

I experimented with vllm, but Qwen2 vl on ollama would be just awesome. (with multiple image support).

<!-- gh-comment-id:2559508795 --> @fighter3005 commented on GitHub (Dec 23, 2024): I experimented with vllm, but Qwen2 vl on ollama would be just awesome. (with multiple image support).
Author
Owner

@bingbing6 commented on GitHub (Dec 24, 2024):

Can we use Qwen2-VL now? It's the best visual model, after all

<!-- gh-comment-id:2560680615 --> @bingbing6 commented on GitHub (Dec 24, 2024): Can we use Qwen2-VL now? It's the best visual model, after all
Author
Owner

@Cheesper commented on GitHub (Dec 24, 2024):

Yes, llama.cpp supports qwen2-vl now.

They stupidly droped multimodal from llama-server 9 month ago, so no online VLM, only local

<!-- gh-comment-id:2561045232 --> @Cheesper commented on GitHub (Dec 24, 2024): > Yes, llama.cpp supports qwen2-vl now. > They stupidly droped multimodal from llama-server 9 month ago, so no online VLM, only local
Author
Owner

@billysb commented on GitHub (Dec 26, 2024):

This model would be so perfect for the kind of thing I'm working on with tool calls. Support for this model would be very useful.

<!-- gh-comment-id:2562873605 --> @billysb commented on GitHub (Dec 26, 2024): This model would be so perfect for the kind of thing I'm working on with tool calls. Support for this model would be very useful.
Author
Owner

@JustLikeThis101 commented on GitHub (Dec 27, 2024):

Does anyone know if there is currently a team supporting the use of the qwen2-VL model on Ollama?

<!-- gh-comment-id:2563257879 --> @JustLikeThis101 commented on GitHub (Dec 27, 2024): Does anyone know if there is currently a team supporting the use of the qwen2-VL model on Ollama?
Author
Owner

@xihuai18 commented on GitHub (Dec 27, 2024):

8c9fb8eb73
will this commit mean supporting qwen vl

<!-- gh-comment-id:2563815092 --> @xihuai18 commented on GitHub (Dec 27, 2024): https://github.com/ollama/ollama/commit/8c9fb8eb73afc220e8bf99772572096b6498b748 will this commit mean supporting qwen vl
Author
Owner

@Wooonster commented on GitHub (Jan 15, 2025):

+1

<!-- gh-comment-id:2592188927 --> @Wooonster commented on GitHub (Jan 15, 2025): +1
Author
Owner

@franz101 commented on GitHub (Jan 27, 2025):

Curios, would work just pulling it from huggingface?

<!-- gh-comment-id:2616680480 --> @franz101 commented on GitHub (Jan 27, 2025): Curios, would work just pulling it from huggingface?
Author
Owner

@MIC-BO commented on GitHub (Jan 30, 2025):

support +1

<!-- gh-comment-id:2623498496 --> @MIC-BO commented on GitHub (Jan 30, 2025): support +1
Author
Owner

@pdevine commented on GitHub (Jan 30, 2025):

I posted this in #8620, but just so it doesn't get lost:

TLDR; we're working on this, it's going to take a while

Long version: we tried getting this working w/ llama.cpp but it was very hacked together and we couldn't get reasonable quality out of it. We could have shipped that version but I don't think anyone would have been particularly happy. We are looking to get it working w/ the new engine, but we're still a ways away from getting the new engine out (I could give a timeline for that, but it's invariably going to be wrong).

<!-- gh-comment-id:2625352806 --> @pdevine commented on GitHub (Jan 30, 2025): I posted this in #8620, but just so it doesn't get lost: TLDR; we're working on this, it's going to take a while Long version: we tried getting this working w/ llama.cpp but it was very hacked together and we couldn't get reasonable quality out of it. We could have shipped that version but I don't think anyone would have been particularly happy. We are looking to get it working w/ the new engine, but we're still a ways away from getting the new engine out (I could give a timeline for that, but it's invariably going to be wrong).
Author
Owner

@MoRocety commented on GitHub (Jan 30, 2025):

cheers!

<!-- gh-comment-id:2625410532 --> @MoRocety commented on GitHub (Jan 30, 2025): cheers!
Author
Owner

@nguyenhongson1902 commented on GitHub (Jan 31, 2025):

can't wait to see this model w/ ollama

<!-- gh-comment-id:2626306328 --> @nguyenhongson1902 commented on GitHub (Jan 31, 2025): can't wait to see this model w/ ollama
Author
Owner

@tobalo commented on GitHub (Feb 2, 2025):

+1 thank you and kudos to all the team. Llama team keep being the western champions of open source AI!

<!-- gh-comment-id:2629492738 --> @tobalo commented on GitHub (Feb 2, 2025): +1 thank you and kudos to all the team. Llama team keep being the western champions of open source AI!
Author
Owner

@EddyChen commented on GitHub (Feb 7, 2025):

support +1

<!-- gh-comment-id:2642029975 --> @EddyChen commented on GitHub (Feb 7, 2025): support +1
Author
Owner

@sxsnwangrenfei commented on GitHub (Feb 10, 2025):

+1

<!-- gh-comment-id:2646910293 --> @sxsnwangrenfei commented on GitHub (Feb 10, 2025): +1
Author
Owner

@JoseEdSouza commented on GitHub (Feb 10, 2025):

up

<!-- gh-comment-id:2647873061 --> @JoseEdSouza commented on GitHub (Feb 10, 2025): up
Author
Owner

@zytoh0 commented on GitHub (Feb 10, 2025):

I posted this in #8620, but just so it doesn't get lost:

TLDR; we're working on this, it's going to take a while

Long version: we tried getting this working w/ llama.cpp but it was very hacked together and we couldn't get reasonable quality out of it. We could have shipped that version but I don't think anyone would have been particularly happy. We are looking to get it working w/ the new engine, but we're still a ways away from getting the new engine out (I could give a timeline for that, but it's invariably going to be wrong).

@pdevine Since you're still sometime away, is it possible that you release this hacked version first for us to use and then update it once you are satisfied? Please 🙏 🙏 🙏 🙏 🙏 thumbs up if anyone agrees.

<!-- gh-comment-id:2648473391 --> @zytoh0 commented on GitHub (Feb 10, 2025): > I posted this in #8620, but just so it doesn't get lost: > > TLDR; we're working on this, it's going to take a while > > Long version: we tried getting this working w/ llama.cpp but it was very hacked together and we couldn't get reasonable quality out of it. We could have shipped that version but I don't think anyone would have been particularly happy. We are looking to get it working w/ the new engine, but we're still a ways away from getting the new engine out (I could give a timeline for that, but it's invariably going to be wrong). @pdevine Since you're still sometime away, is it possible that you release this hacked version first for us to use and then update it once you are satisfied? Please 🙏 🙏 🙏 🙏 🙏 thumbs up if anyone agrees.
Author
Owner

@aole commented on GitHub (Feb 10, 2025):

+3.14

<!-- gh-comment-id:2649348166 --> @aole commented on GitHub (Feb 10, 2025): +3.14
Author
Owner

@zz-zhi54 commented on GitHub (Feb 11, 2025):

Can you release a beta version first? I need Ollama's API.

<!-- gh-comment-id:2649603064 --> @zz-zhi54 commented on GitHub (Feb 11, 2025): Can you release a beta version first? I need Ollama's API.
Author
Owner

@seblessa commented on GitHub (Feb 11, 2025):

Is there an ETA for Qwen2.5-VL vision model release on ollama ?

<!-- gh-comment-id:2651078929 --> @seblessa commented on GitHub (Feb 11, 2025): Is there an ETA for Qwen2.5-VL vision model release on ollama ?
Author
Owner

@iamdagy commented on GitHub (Feb 13, 2025):

Looking forward to this

<!-- gh-comment-id:2656701476 --> @iamdagy commented on GitHub (Feb 13, 2025): Looking forward to this
Author
Owner

@misaka-20002 commented on GitHub (Feb 13, 2025):

any ETA

<!-- gh-comment-id:2657871239 --> @misaka-20002 commented on GitHub (Feb 13, 2025): any ETA
Author
Owner

@wcool1 commented on GitHub (Feb 14, 2025):

look foward to

<!-- gh-comment-id:2658363748 --> @wcool1 commented on GitHub (Feb 14, 2025): look foward to
Author
Owner

@sam8890 commented on GitHub (Feb 14, 2025):

+1

<!-- gh-comment-id:2658394805 --> @sam8890 commented on GitHub (Feb 14, 2025): +1
Author
Owner

@3unnycheung commented on GitHub (Feb 14, 2025):

https://github.com/ollama/ollama/issues/8424 hope so

<!-- gh-comment-id:2659548989 --> @3unnycheung commented on GitHub (Feb 14, 2025): https://github.com/ollama/ollama/issues/8424 hope so
Author
Owner

@pdevine commented on GitHub (Feb 14, 2025):

No ETA yet, but I'm currently working on the new image processing code for the new engine, so hopefully soon-ish 🤞 @jmorganca did the original change, and I know everyone wants this model desperately, but please just hang tight for a bit longer. We'd rather publish a working model than publish a half working one.

<!-- gh-comment-id:2660054413 --> @pdevine commented on GitHub (Feb 14, 2025): No ETA yet, but I'm currently working on the new image processing code for the new engine, so hopefully soon-ish 🤞 @jmorganca did the original change, and I know everyone wants this model desperately, but please just hang tight for a bit longer. We'd rather publish a working model than publish a half working one.
Author
Owner

@olumolu commented on GitHub (Feb 15, 2025):

+1 for me please

<!-- gh-comment-id:2660894194 --> @olumolu commented on GitHub (Feb 15, 2025): +1 for me please
Author
Owner

@caiyajunx commented on GitHub (Feb 15, 2025):

+1

<!-- gh-comment-id:2660933644 --> @caiyajunx commented on GitHub (Feb 15, 2025): +1
Author
Owner

@sandorkonya commented on GitHub (Feb 16, 2025):

+1

<!-- gh-comment-id:2661417512 --> @sandorkonya commented on GitHub (Feb 16, 2025): +1
Author
Owner

@jakeju92 commented on GitHub (Feb 16, 2025):

+1

<!-- gh-comment-id:2661487574 --> @jakeju92 commented on GitHub (Feb 16, 2025): +1
Author
Owner

@Praveenstein commented on GitHub (Feb 16, 2025):

+1

<!-- gh-comment-id:2661567221 --> @Praveenstein commented on GitHub (Feb 16, 2025): +1
Author
Owner

@zz-zhi54 commented on GitHub (Feb 17, 2025):

Hey guys, let's stop the +1 or +++ activities, this is a "mail disaster" for each subscriber, just liking the existing replies is enough!

If you want to know the latest news, the Subscribe button on the right can help you

<!-- gh-comment-id:2661822491 --> @zz-zhi54 commented on GitHub (Feb 17, 2025): Hey guys, let's stop the +1 or +++ activities, this is a "mail disaster" for each subscriber, just liking the existing replies is enough! If you want to know the latest news, the `Subscribe` button on the right can help you
Author
Owner

@ianmage commented on GitHub (Feb 20, 2025):

+1

<!-- gh-comment-id:2670769471 --> @ianmage commented on GitHub (Feb 20, 2025): +1
Author
Owner

@vladislavdonchev commented on GitHub (Feb 22, 2025):

For anyone interested - making progress in llama.cpp:
https://github.com/ggml-org/llama.cpp/issues/11483

TL; DR

Testing and quantization are ongoing, but we have produced working models!
https://huggingface.co/IAILabs/Qwen2.5-VL-7b-Instruct-GGUF/tree/main

Before this can be propagated however, hardware acceleration for CLIP needs to be merged back into llama.cpp
Keep an eye on the linked issue for updates.

<!-- gh-comment-id:2676430795 --> @vladislavdonchev commented on GitHub (Feb 22, 2025): For anyone interested - making progress in llama.cpp: https://github.com/ggml-org/llama.cpp/issues/11483 TL; DR Testing and quantization are ongoing, but we have produced working models! https://huggingface.co/IAILabs/Qwen2.5-VL-7b-Instruct-GGUF/tree/main Before this can be propagated however, hardware acceleration for CLIP needs to be merged back into llama.cpp Keep an eye on the linked issue for updates.
Author
Owner

@wenshyan commented on GitHub (Feb 25, 2025):

Looking forward to test this out on Ollama!

<!-- gh-comment-id:2682715311 --> @wenshyan commented on GitHub (Feb 25, 2025): Looking forward to test this out on Ollama!
Author
Owner

@crazyn2 commented on GitHub (Feb 27, 2025):

+1

<!-- gh-comment-id:2687842168 --> @crazyn2 commented on GitHub (Feb 27, 2025): +1
Author
Owner

@EuPhobos commented on GitHub (Feb 27, 2025):

Stop "+1" please!
Just use "Subscribe" button..

<!-- gh-comment-id:2687849020 --> @EuPhobos commented on GitHub (Feb 27, 2025): Stop "+1" please! Just use "Subscribe" button..
Author
Owner

@xiasi0 commented on GitHub (Mar 27, 2025):

Is there any news here?

<!-- gh-comment-id:2756183326 --> @xiasi0 commented on GitHub (Mar 27, 2025): Is there any news here?
Author
Owner

@zz-zhi54 commented on GitHub (Mar 27, 2025):

What difficulties are you facing now and how long will it take to get support? Can you share it with us?

<!-- gh-comment-id:2756213247 --> @zz-zhi54 commented on GitHub (Mar 27, 2025): What difficulties are you facing now and how long will it take to get support? Can you share it with us?
Author
Owner

@kevin-pw commented on GitHub (Apr 3, 2025):

Awesome! Looks like the Ollama team is actively working on a Qwen 2.5 VL branch.

<!-- gh-comment-id:2774475482 --> @kevin-pw commented on GitHub (Apr 3, 2025): Awesome! Looks like the Ollama team is [actively working on a Qwen 2.5 VL branch](https://github.com/ollama/ollama/compare/main...brucemacd/qwen25vl).
Author
Owner

@wuaigleuiogueae commented on GitHub (Apr 14, 2025):

+1
What difficulties are you facing now and how long will it take to get support?

<!-- gh-comment-id:2800254358 --> @wuaigleuiogueae commented on GitHub (Apr 14, 2025): +1 What difficulties are you facing now and how long will it take to get support?
Author
Owner

@eroyee commented on GitHub (Apr 15, 2025):

It seems to me that unless one is able to contribute in terms of coding, the best thing that could be done in terms of 'support' is let the devs who are contributing get on with it rather than need to respond here?

Practically, keep an eye on the link that @kevin-pw posted, you can see what work is being done there, and whenever it becomes officially available I expect you'd see the model appear near the top of the list here: https://ollama.com/library?sort=newest

Otherwise my thanks to those who have and are working on this project, I very much appreciate the opportunity to learn how these things work and I'm sure Qwen2.5-VL will come along in due course :)

<!-- gh-comment-id:2804216575 --> @eroyee commented on GitHub (Apr 15, 2025): It seems to me that unless one is able to contribute in terms of coding, the best thing that could be done in terms of 'support' is let the devs who _are_ contributing get on with it rather than need to respond here? Practically, keep an eye on the link that @kevin-pw posted, you can see what work is being done there, and whenever it becomes officially available I expect you'd see the model appear near the top of the list here: https://ollama.com/library?sort=newest Otherwise my thanks to those who have and are working on this project, I very much appreciate the opportunity to learn how these things work and I'm sure Qwen2.5-VL will come along in due course :)
Author
Owner

@ddpasa commented on GitHub (Apr 16, 2025):

It seems to me that unless one is able to contribute in terms of coding, the best thing that could be done in terms of 'support' is let the devs who are contributing get on with it rather than need to respond here?

Practically, keep an eye on the link that @kevin-pw posted, you can see what work is being done there, and whenever it becomes officially available I expect you'd see the model appear near the top of the list here: https://ollama.com/library?sort=newest

Otherwise my thanks to those who have and are working on this project, I very much appreciate the opportunity to learn how these things work and I'm sure Qwen2.5-VL will come along in due course :)

The real work to support Qwen2-VL is happening in llama.cpp. They already have a CLI for supporting it here: https://github.com/ggml-org/llama.cpp/pull/10361

However llama-server does not yet support VLs, so it's a little tricky for ollama to support them.

In the mean time I recommend using llama.cpp's qwen executable as a stopgap.

<!-- gh-comment-id:2809035291 --> @ddpasa commented on GitHub (Apr 16, 2025): > It seems to me that unless one is able to contribute in terms of coding, the best thing that could be done in terms of 'support' is let the devs who _are_ contributing get on with it rather than need to respond here? > > Practically, keep an eye on the link that [@kevin-pw](https://github.com/kevin-pw) posted, you can see what work is being done there, and whenever it becomes officially available I expect you'd see the model appear near the top of the list here: https://ollama.com/library?sort=newest > > Otherwise my thanks to those who have and are working on this project, I very much appreciate the opportunity to learn how these things work and I'm sure Qwen2.5-VL will come along in due course :) The real work to support Qwen2-VL is happening in llama.cpp. They already have a CLI for supporting it here: https://github.com/ggml-org/llama.cpp/pull/10361 However llama-server does not yet support VLs, so it's a little tricky for ollama to support them. In the mean time I recommend using llama.cpp's qwen executable as a stopgap.
Author
Owner

@pdevine commented on GitHub (Apr 17, 2025):

Hey everyone. Thanks for you patience on this. We are very close to getting it out but ran into some snags with the way the vision model's patch embeddings work. Note that this is in the ollama engine, and not based on the llama.cpp change referenced above.

<!-- gh-comment-id:2811616320 --> @pdevine commented on GitHub (Apr 17, 2025): Hey everyone. Thanks for you patience on this. We are *very* close to getting it out but ran into some snags with the way the vision model's patch embeddings work. Note that this is in the ollama engine, and not based on the llama.cpp change referenced above.
Author
Owner

@barseghyanartur commented on GitHub (Apr 17, 2025):

Please, also include Qwen2.5-Omni: https://github.com/QwenLM/Qwen2.5-Omni

<!-- gh-comment-id:2812251581 --> @barseghyanartur commented on GitHub (Apr 17, 2025): Please, also include Qwen2.5-Omni: https://github.com/QwenLM/Qwen2.5-Omni
Author
Owner

@3unnycheung commented on GitHub (Apr 20, 2025):

Please, also include Qwen2.5-Omni: https://github.com/QwenLM/Qwen2.5-Omni

https://github.com/ollama/ollama/compare/main...qwen25omni

<!-- gh-comment-id:2817134712 --> @3unnycheung commented on GitHub (Apr 20, 2025): > Please, also include Qwen2.5-Omni: https://github.com/QwenLM/Qwen2.5-Omni https://github.com/ollama/ollama/compare/main...qwen25omni
Author
Owner

@euberdeveloper commented on GitHub (Apr 29, 2025):

any progress?

<!-- gh-comment-id:2839523871 --> @euberdeveloper commented on GitHub (Apr 29, 2025): any progress?
Author
Owner

@eroyee commented on GitHub (Apr 29, 2025):

any progress?

Yes.

Why don't you just have a look a few comments up and follow the links - you'll see quite a lot of work on this. eg. https://github.com/ollama/ollama/compare/main...brucemacd/qwen25vl

<!-- gh-comment-id:2840379285 --> @eroyee commented on GitHub (Apr 29, 2025): > any progress? **Yes**. Why don't you just have a look a few comments up and follow the links - you'll see quite a lot of work on this. eg. [https://github.com/ollama/ollama/compare/main...brucemacd/qwen25vl](url)
Author
Owner

@BruceMacD commented on GitHub (May 15, 2025):

Qwen2.5vl is in the official library now, it will run with Ollama 0.7.0 (released a few hours ago).
https://ollama.com/library/qwen2.5vl

<!-- gh-comment-id:2885063102 --> @BruceMacD commented on GitHub (May 15, 2025): Qwen2.5vl is in the official library now, it will run with Ollama 0.7.0 (released a few hours ago). https://ollama.com/library/qwen2.5vl
Author
Owner

@LFd3v commented on GitHub (May 15, 2025):

@BruceMacD The model page in ollama.com says it supports video, but I tried with an MP4 and it was not processed? Known bug or indeed there is no support for video and it is not planned? Thank you.

<!-- gh-comment-id:2885302535 --> @LFd3v commented on GitHub (May 15, 2025): @BruceMacD The model page in ollama.com says it supports video, but I tried with an MP4 and it was not processed? Known bug or indeed there is no support for video and it is not planned? Thank you.
Author
Owner

@BruceMacD commented on GitHub (May 16, 2025):

@LFd3v our implementation doesn't support video at this point, that part of the description was misleading. Sorry about that, I've updated the details on the website.

<!-- gh-comment-id:2885390478 --> @BruceMacD commented on GitHub (May 16, 2025): @LFd3v our implementation doesn't support video at this point, that part of the description was misleading. Sorry about that, I've updated the details on the website.
Author
Owner

@aseok commented on GitHub (May 17, 2025):

Latest ollama doesn't offload this model to gpu despite offloading others like qwen3 on ubuntu 24.04.
Nvidia GTX 1050 Ti@4GB.
Cuda 12.9
DRIVER version: 575.51.03

<!-- gh-comment-id:2888126663 --> @aseok commented on GitHub (May 17, 2025): Latest ollama doesn't offload this model to gpu despite offloading others like qwen3 on ubuntu 24.04. Nvidia GTX 1050 Ti@4GB. Cuda 12.9 DRIVER version: 575.51.03
Author
Owner

@eroyee commented on GitHub (May 17, 2025):

Latest ollama doesn't offload this model to gpu despite offloading others like qwen3.

FYI that's not my experience (Ubuntu 24.04, Nvidia 1070 and latest drivers), nvidia-smi -l shows healthy use of the GPU with the 7b model...

<!-- gh-comment-id:2888237359 --> @eroyee commented on GitHub (May 17, 2025): > Latest ollama doesn't offload this model to gpu despite offloading others like qwen3. FYI that's **not** my experience (Ubuntu 24.04, Nvidia 1070 and latest drivers), nvidia-smi -l shows healthy use of the GPU with the 7b model...
Author
Owner

@jmtatsch commented on GitHub (May 29, 2025):

@BruceMacD what is missing for supporting video?

<!-- gh-comment-id:2919269722 --> @jmtatsch commented on GitHub (May 29, 2025): @BruceMacD what is missing for supporting video?
Author
Owner

@BruceMacD commented on GitHub (May 29, 2025):

@jmtatsch A few things would be needed, Ollama doesn't have the ability to send video from the client the server and the model implementation only processes the one image frame while video implementations process multiple video frames at different steps in the multimodal model.

<!-- gh-comment-id:2920017482 --> @BruceMacD commented on GitHub (May 29, 2025): @jmtatsch A few things would be needed, Ollama doesn't have the ability to send video from the client the server and the model implementation only processes the one image frame while video implementations process multiple video frames at different steps in the multimodal model.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#4131