[PR #11163] docs(modelfile): document creating vision models #39333

Open
opened 2026-04-22 23:59:30 -05:00 by GiteaMirror · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/ollama/ollama/pull/11163
Author: @sammcj
Created: 6/22/2025
Status: 🔄 Open

Base: mainHead: mmproj_docs


📝 Commits (1)

  • 73391f2 docs(modelfile): document creating vision models

📊 Changes

1 file changed (+1 additions, -0 deletions)

View changed files

📝 docs/modelfile.md (+1 -0)

📄 Description

Add note on how to create Ollama models with vision capabilities by providing a mmproj file and using the directory rather than the single model GGUF.

Reason for adding this: I've seen multiple people incorrectly stating things like "Ollama can't create vision models unless you create a single GGUF with the mmproj embedded", I suspected this wasn't true and after reading through the current codebase I found simply providing both files in the same directory works.


Related:


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/ollama/ollama/pull/11163 **Author:** [@sammcj](https://github.com/sammcj) **Created:** 6/22/2025 **Status:** 🔄 Open **Base:** `main` ← **Head:** `mmproj_docs` --- ### 📝 Commits (1) - [`73391f2`](https://github.com/ollama/ollama/commit/73391f22c03fc7d9d1f141c427450d0d5890d5f4) docs(modelfile): document creating vision models ### 📊 Changes **1 file changed** (+1 additions, -0 deletions) <details> <summary>View changed files</summary> 📝 `docs/modelfile.md` (+1 -0) </details> ### 📄 Description Add note on how to create Ollama models with vision capabilities by providing a mmproj file and using the directory rather than the single model GGUF. Reason for adding this: I've seen multiple people incorrectly stating things like "Ollama can't create vision models unless you create a single GGUF with the mmproj embedded", I suspected this wasn't true and after reading through the current codebase I found simply providing both files in the same directory works. --- Related: - https://github.com/ollama/ollama/issues/9967 - https://github.com/unslothai/unsloth/issues/2248 - https://github.com/covercash2/modelfile/pull/19 - https://www.reddit.com/r/ollama/comments/1jdkevi/creating_gemma_3_from_gguf_with_mmproj_not_working/ --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
GiteaMirror added the pull-request label 2026-04-22 23:59:30 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#39333