[PR #12721] [CLOSED] feat: Enable image embeddings for vision models #13925

Closed
opened 2026-04-13 00:40:26 -05:00 by GiteaMirror · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/ollama/ollama/pull/12721
Author: @daboe01
Created: 10/21/2025
Status: Closed

Base: mainHead: feat-image-embeddings-7677


📝 Commits (1)

  • e61b0ab feat: Enable image embeddings for vision models

📊 Changes

14 files changed (+432 additions, -1046 deletions)

View changed files

📝 api/types.go (+8 -0)
📝 go.mod (+1 -0)
📝 go.sum (+1 -0)
📝 llama/llama.go (+66 -1)
📝 llm/server.go (+63 -0)
📝 middleware/openai.go (+7 -1)
📝 middleware/openai_test.go (+1 -1)
📝 openai/openai.go (+74 -0)
📝 runner/llamarunner/image.go (+19 -0)
📝 runner/llamarunner/runner.go (+30 -1)
server/mock_llm_test.go (+99 -0)
📝 server/routes.go (+63 -7)
server/routes_test.go (+0 -966)
📝 server/sched_test.go (+0 -69)

📄 Description

This change enables the ability to generate embeddings for images through the API for vision models.

It introduces a new /image-embedding endpoint in the runner and updates the /api/embed and /api/embeddings handlers to support multimodal requests.

Fixes #7677


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/ollama/ollama/pull/12721 **Author:** [@daboe01](https://github.com/daboe01) **Created:** 10/21/2025 **Status:** ❌ Closed **Base:** `main` ← **Head:** `feat-image-embeddings-7677` --- ### 📝 Commits (1) - [`e61b0ab`](https://github.com/ollama/ollama/commit/e61b0abadb6fc18d75acdb800ab01a35f8a00c58) feat: Enable image embeddings for vision models ### 📊 Changes **14 files changed** (+432 additions, -1046 deletions) <details> <summary>View changed files</summary> 📝 `api/types.go` (+8 -0) 📝 `go.mod` (+1 -0) 📝 `go.sum` (+1 -0) 📝 `llama/llama.go` (+66 -1) 📝 `llm/server.go` (+63 -0) 📝 `middleware/openai.go` (+7 -1) 📝 `middleware/openai_test.go` (+1 -1) 📝 `openai/openai.go` (+74 -0) 📝 `runner/llamarunner/image.go` (+19 -0) 📝 `runner/llamarunner/runner.go` (+30 -1) ➕ `server/mock_llm_test.go` (+99 -0) 📝 `server/routes.go` (+63 -7) ➖ `server/routes_test.go` (+0 -966) 📝 `server/sched_test.go` (+0 -69) </details> ### 📄 Description This change enables the ability to generate embeddings for images through the API for vision models. It introduces a new `/image-embedding` endpoint in the runner and updates the `/api/embed` and `/api/embeddings` handlers to support multimodal requests. Fixes #7677 --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
GiteaMirror added the pull-request label 2026-04-13 00:40:26 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#13925