[GH-ISSUE #2795] Please update Llama.cpp Server. It now Supports Llava 1.6 Image Embedding Dimension properly. #27449

Closed
opened 2026-04-22 04:48:17 -05:00 by GiteaMirror · 3 comments
Owner

Originally created by @chigkim on GitHub (Feb 27, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/2795

Originally assigned to: @jmorganca on GitHub.

Last week pr/5553 was merged into Llama.cpp, and Llama.cpp server now supports llava 1.6 image embedding dimension properly.
This improves the accuracy greatly, and processes images in 4x larger dimension.
Could you guys update?
Thanks!

Originally created by @chigkim on GitHub (Feb 27, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/2795 Originally assigned to: @jmorganca on GitHub. Last week [pr/5553](https://github.com/ggerganov/llama.cpp/pull/5553) was merged into Llama.cpp, and Llama.cpp server now supports llava 1.6 image embedding dimension properly. This improves the accuracy greatly, and processes images in 4x larger dimension. Could you guys update? Thanks!
GiteaMirror added the bug label 2026-04-22 04:48:17 -05:00
Author
Owner

@jmorganca commented on GitHub (Apr 15, 2024):

This should be fixed now. Thanks for the issue!

<!-- gh-comment-id:2057617319 --> @jmorganca commented on GitHub (Apr 15, 2024): This should be fixed now. Thanks for the issue!
Author
Owner

@chigkim commented on GitHub (Apr 16, 2024):

Thanks!

Could you also merge this?

https://github.com/ggerganov/llama.cpp/pull/5896

Right now Ollama reports prompt with image as 0 token when accessing with api.

Should I create it a separate issue?

<!-- gh-comment-id:2058397036 --> @chigkim commented on GitHub (Apr 16, 2024): Thanks! Could you also merge this? https://github.com/ggerganov/llama.cpp/pull/5896 Right now Ollama reports prompt with image as 0 token when accessing with api. Should I create it a separate issue?
Author
Owner

@chigkim commented on GitHub (Apr 16, 2024):

I just created a new issue for it.
https://github.com/ollama/ollama/issues/3671

<!-- gh-comment-id:2058971566 --> @chigkim commented on GitHub (Apr 16, 2024): I just created a new issue for it. https://github.com/ollama/ollama/issues/3671
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#27449