[GH-ISSUE #5786] Request to add support for InternVL-2 model #3604

Closed
opened 2026-04-12 14:21:04 -05:00 by GiteaMirror · 9 comments
Owner

Originally created by @CNEA-lw on GitHub (Jul 19, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/5786

It is hoped that the ollama platform can add the model InternVL-2 series.

Originally created by @CNEA-lw on GitHub (Jul 19, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/5786 It is hoped that the ollama platform can add the model InternVL-2 series.
GiteaMirror added the model label 2026-04-12 14:21:04 -05:00
Author
Owner

@rick-github commented on GitHub (Jul 19, 2024):

Needs support in llama.cpp first.

<!-- gh-comment-id:2238836185 --> @rick-github commented on GitHub (Jul 19, 2024): Needs support in llama.cpp first.
Author
Owner

@sammcj commented on GitHub (Jul 25, 2024):

https://github.com/ggerganov/llama.cpp/issues/6803

<!-- gh-comment-id:2249231700 --> @sammcj commented on GitHub (Jul 25, 2024): https://github.com/ggerganov/llama.cpp/issues/6803
Author
Owner

@Milor123 commented on GitHub (Sep 8, 2024):

+1 ❤️

<!-- gh-comment-id:2336818195 --> @Milor123 commented on GitHub (Sep 8, 2024): +1 ❤️
Author
Owner

@AlexM4H commented on GitHub (Sep 13, 2024):

Since yesterday vllm has internVL2 support. :-)

vllm-project/vllm/releases/tag/v0.6.1

<!-- gh-comment-id:2348236287 --> @AlexM4H commented on GitHub (Sep 13, 2024): Since yesterday vllm has internVL2 support. :-) [vllm-project/vllm/releases/tag/v0.6.1](https://github.com/vllm-project/vllm/releases/tag/v0.6.1)
Author
Owner

@barclaybrown commented on GitHub (Sep 15, 2024):

This might be a wayyyy out idea, but why not build support for other model runners into Ollama to cover models that lamacpp doesn't support. I have built apps around Ollama, and am dealing with how I might have to move away from Ollama and go to other or additional engines to support, in particular InternVL and Phi3.5 MOE models and others as they come. Why not build something like transformers support for some models, and/or make it an install option with torch as pre-req like LMDeploy does, or some other method. Ollama could be the "everything engine".

<!-- gh-comment-id:2351623195 --> @barclaybrown commented on GitHub (Sep 15, 2024): This might be a wayyyy out idea, but why not build support for other model runners into Ollama to cover models that lamacpp doesn't support. I have built apps around Ollama, and am dealing with how I might have to move away from Ollama and go to other or additional engines to support, in particular InternVL and Phi3.5 MOE models and others as they come. Why not build something like transformers support for some models, and/or make it an install option with torch as pre-req like LMDeploy does, or some other method. Ollama could be the "everything engine".
Author
Owner

@James4Ever0 commented on GitHub (Jan 28, 2025):

Have a look at here:

https://github.com/ggerganov/llama.cpp/pull/9403

https://github.com/qlylangyu/llama.cpp/pull/1

<!-- gh-comment-id:2619014284 --> @James4Ever0 commented on GitHub (Jan 28, 2025): Have a look at here: https://github.com/ggerganov/llama.cpp/pull/9403 https://github.com/qlylangyu/llama.cpp/pull/1
Author
Owner

@James4Ever0 commented on GitHub (Jan 28, 2025):

@sammcj Would you like to take a look at this?

Appreciate your work on https://github.com/ollama/ollama/pull/6279

@jmorganca

<!-- gh-comment-id:2619035031 --> @James4Ever0 commented on GitHub (Jan 28, 2025): @sammcj Would you like to take a look at this? Appreciate your work on https://github.com/ollama/ollama/pull/6279 @jmorganca
Author
Owner

@EvilaMany commented on GitHub (Apr 13, 2025):

any updates?

<!-- gh-comment-id:2799917524 --> @EvilaMany commented on GitHub (Apr 13, 2025): any updates?
Author
Owner

@rick-github commented on GitHub (Jan 8, 2026):

Superseded by internvl3 https://github.com/ollama/ollama/issues/10248

<!-- gh-comment-id:3721895848 --> @rick-github commented on GitHub (Jan 8, 2026): Superseded by internvl3 https://github.com/ollama/ollama/issues/10248
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#3604