[GH-ISSUE #2295] multimodal processing doesn't work for one-shot CLI #47836

Closed
opened 2026-04-28 05:27:33 -05:00 by GiteaMirror · 1 comment
Owner

Originally created by @dhiltgen on GitHub (Jan 31, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/2295

Originally assigned to: @jmorganca on GitHub.

This doesn't work:

% ollama run llava "whats in this image ./image.jpg"
 I'm sorry, but as a text-based AI language model, I am not able to directly view or interpret images. However, if the image is related to
the topic of data science or machine learning, it could potentially be something like a dataset, a visualization of data, a chart, or any
other form of data representation. Please provide more context about the image you are referring to so that I can attempt to answer your
question.

But this does:

% ollama run llava
>>> what's in this image ./image.jpg
Added image './image.jpg'
 The image shows a hot dog in a bun, garnished with mustard and ketchup.

>>> Send a message (/? for help)
Originally created by @dhiltgen on GitHub (Jan 31, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/2295 Originally assigned to: @jmorganca on GitHub. This doesn't work: ``` % ollama run llava "whats in this image ./image.jpg" I'm sorry, but as a text-based AI language model, I am not able to directly view or interpret images. However, if the image is related to the topic of data science or machine learning, it could potentially be something like a dataset, a visualization of data, a chart, or any other form of data representation. Please provide more context about the image you are referring to so that I can attempt to answer your question. ``` But this does: ``` % ollama run llava >>> what's in this image ./image.jpg Added image './image.jpg' The image shows a hot dog in a bun, garnished with mustard and ketchup. >>> Send a message (/? for help) ```
GiteaMirror added the feature request label 2026-04-28 05:27:33 -05:00
Author
Owner

@pdevine commented on GitHub (Feb 1, 2024):

Yep, it was only ever added to the interactive chat. It should work on /api/generate (vs. /api/chat), so this should be relatively easy to add.

<!-- gh-comment-id:1920641800 --> @pdevine commented on GitHub (Feb 1, 2024): Yep, it was only ever added to the interactive chat. It _should_ work on `/api/generate` (vs. `/api/chat`), so this should be _relatively_ easy to add.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#47836