[GH-ISSUE #8626] Tool Support for vision models #31344

Closed
opened 2026-04-22 11:43:38 -05:00 by GiteaMirror · 3 comments
Owner

Originally created by @abdarwish23 on GitHub (Jan 28, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/8626

Ollama vision models are not supporting tool calling this is very important specially for browser use or computer use Use-cases
can we have tool support for vision models ...

Originally created by @abdarwish23 on GitHub (Jan 28, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/8626 Ollama vision models are not supporting tool calling this is very important specially for browser use or computer use Use-cases can we have tool support for vision models ...
GiteaMirror added the feature request label 2026-04-22 11:43:38 -05:00
Author
Owner

@MHugonKaliop commented on GitHub (Jan 28, 2025):

It works with QWen2.5 for your information.
depends of the model, but it's quite tricky to "guess" compatible models, without installing and testing them

<!-- gh-comment-id:2618042725 --> @MHugonKaliop commented on GitHub (Jan 28, 2025): It works with QWen2.5 for your information. depends of the model, but it's quite tricky to "guess" compatible models, without installing and testing them
Author
Owner

@rick-github commented on GitHub (Jan 28, 2025):

https://github.com/ollama/ollama/issues/7611#issuecomment-2468749305

<!-- gh-comment-id:2618078961 --> @rick-github commented on GitHub (Jan 28, 2025): https://github.com/ollama/ollama/issues/7611#issuecomment-2468749305
Author
Owner

@rick-github commented on GitHub (Jan 5, 2026):

Models that have been trained for tools use (vision or non-vision) will typically have tool support. Models that haven't been trained for tool use can be modified to support tools as shown in #7611, but quality of results will vary.

<!-- gh-comment-id:3709546184 --> @rick-github commented on GitHub (Jan 5, 2026): Models that have been trained for tools use (vision or non-vision) will typically have tool support. Models that haven't been trained for tool use can be modified to support tools as shown in #7611, but quality of results will vary.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#31344