[PR #2300] [MERGED] Improvements to ollama run for multimodal models #36723

Closed
opened 2026-04-22 21:22:20 -05:00 by GiteaMirror · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/ollama/ollama/pull/2300
Author: @jmorganca
Created: 2/1/2024
Status: Merged
Merged: 2/2/2024
Merged by: @jmorganca

Base: mainHead: jmorganca/multimodal-repl


📝 Commits (1)

  • 5dcb4d9 Improvements to ollama run for multimodal models

📊 Changes

1 file changed (+11 additions, -21 deletions)

View changed files

📝 cmd/interactive.go (+11 -21)

📄 Description

Depends on #2296

This PR makes two changes to how ollama run works:

  1. Images are sent for all messages
  2. Messages without images can now be sent to multimodal models (they are language models too!), and instead a better prompt placeholder is provided. This is important for messages that don't include images but are relevant to a multimodal conversation (e.g. I will provide you a list of messages, provide me the captions for each or tell me more about the image I provided earlier)
  3. Only send the system prompt once

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/ollama/ollama/pull/2300 **Author:** [@jmorganca](https://github.com/jmorganca) **Created:** 2/1/2024 **Status:** ✅ Merged **Merged:** 2/2/2024 **Merged by:** [@jmorganca](https://github.com/jmorganca) **Base:** `main` ← **Head:** `jmorganca/multimodal-repl` --- ### 📝 Commits (1) - [`5dcb4d9`](https://github.com/ollama/ollama/commit/5dcb4d99c4f230e5ad27bcd368c23a8edcb0b191) Improvements to `ollama run` for multimodal models ### 📊 Changes **1 file changed** (+11 additions, -21 deletions) <details> <summary>View changed files</summary> 📝 `cmd/interactive.go` (+11 -21) </details> ### 📄 Description Depends on #2296 This PR makes two changes to how `ollama run` works: 1. Images are sent for all messages 2. Messages without images can now be sent to multimodal models (they are language models too!), and instead a better prompt placeholder is provided. This is important for messages that don't include images but are relevant to a multimodal conversation (e.g. `I will provide you a list of messages, provide me the captions for each` or `tell me more about the image I provided earlier`) 3. Only send the system prompt once --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
GiteaMirror added the pull-request label 2026-04-22 21:22:20 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#36723