github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-05-06 16:11:34 -05:00
Code Issues 14.5k Packages Projects Releases 120 Wiki Activity

[GH-ISSUE #13464] Cloud gemma3 models fail when an image is uploaded via the OpenAI API. #34644

New Issue
Closed
opened 2026-04-22 18:23:04 -05:00 by GiteaMirror · 1 comment
GiteaMirror commented 2026-04-22 18:23:04 -05:00
Owner
Copy Link

Originally created by @rick-github on GitHub (Dec 14, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/13464

Originally assigned to: @BruceMacD on GitHub.

What is the issue?

Works via Ollama API:

for i in ministral-3:14b gemma3:4b gemma3:12b gemma3:27b ; do echo "********** $i" ; echo '{
    "model":"'$i'",
    "messages":[{"role":"user","content":"Describe this image.",                                                                                                                   
    "images":["'"$(base64 -w0 ./image1.png)"'"]}],
    "stream":false                                                                                          
}' | curl -s  https://ollama.com/api/chat -H "Authorization: Bearer ${OLLAMA_API_KEY:?}" -d @- ; done

********** ministral-3:14b
{"model":"ministral-3:14b","created_at":"2025-12-14T02:05:33.006718568Z","message":{"role":"assistant","content":"The image shows a young, fluffy white puppy sitting on a set of stone steps. The puppy has a soft, thick coat and appears to be quite small and young, likely a few weeks old. It is wearing a red collar with a small bell attached, which is a common accessory for puppies to help with training and to alert owners to their presence. The puppy is looking directly at the camera with a curious and somewhat innocent expression. The background is blurred, focusing attention on the puppy, and it appears to be an outdoor setting, possibly a porch or a patio area."},"done":true,"done_reason":"stop","total_duration":1656158975,"prompt_eval_count":308,"eval_count":118}
********** gemma3:4b
{"model":"gemma3:4b","created_at":"2025-12-14T02:05:35.581613991Z","message":{"role":"assistant","content":"Here’s a description of the image:\n\n**Overall Impression:** The image is a close-up, heartwarming shot of a very young, fluffy white puppy. It's a soft, inviting image with a focus on the puppy’s cuteness.\n\n**Details:**\n\n*   **Subject:** A tiny, white puppy is the clear focal point. It appears to be a Shiba Inu puppy, judging by its facial features and fluffy coat.\n*   **Pose:** The puppy is sitting attentively, looking slightly to the side with a gentle, curious expression. It’s sitting on a concrete step.\n*   **Appearance:** The puppy is incredibly fluffy, with a thick, snow-white coat. It has dark eyes and ears that are slightly folded. It is wearing a red collar with a small, golden bell attached.\n*   **Background:** The background is blurred and consists of a stone or concrete step. A portion of a dark wooden structure or door is visible in the very top left corner.\n*   **Lighting:** The lighting appears to be natural and soft, giving the puppy a warm glow. \n\n**Overall Tone:** The image evokes feelings of warmth, innocence, and cuteness. It's a lovely portrait of a precious little puppy.\n\nWould you like me to focus on any particular aspect of the image?"},"done":true,"done_reason":"stop","total_duration":2180903936}
********** gemma3:12b
{"model":"gemma3:12b","created_at":"2025-12-14T02:05:39.784312004Z","message":{"role":"assistant","content":"Here's a description of the image:\n\n**Overall Impression:**\n\nThe image features an adorable, fluffy white puppy sitting on a stone surface, likely a step or ledge. The photo has a warm, slightly vintage feel.\n\n**Details:**\n\n*   **The Puppy:** The puppy is the clear focal point. It's a small, fluffy ball of white fur with dark eyes that give it a sweet, slightly concerned expression. It's wearing a red collar with a golden bell charm.\n*   **Surface:** The puppy is sitting on a gray stone surface with a textured, aged appearance. It seems to be a step or ledge, with visible cracks and variations in color, adding to the rustic vibe.\n*   **Background:** The background is blurred and out of focus, suggesting the photographer's intention to keep the viewer's attention on the puppy. A hint of a reddish-brown object can be seen.\n*   **Lighting:** The lighting appears to be soft and natural, creating gentle shadows and highlighting the puppy's fur.\n\n**Overall Mood:**\n\nThe image evokes feelings of tenderness, cuteness, and perhaps a touch of nostalgia."},"done":true,"done_reason":"stop","total_duration":3771276122}
********** gemma3:27b
{"model":"gemma3:27b","created_at":"2025-12-14T02:05:45.304294215Z","message":{"role":"assistant","content":"Here's a description of the image:\n\n**Overall Impression:**\n\nThe image features an incredibly cute, fluffy white puppy sitting on what appears to be a stone step. The puppy is the main focus, and the soft lighting and shallow depth of field contribute to a sweet, endearing aesthetic. \n\n**Detailed Description:**\n\n* **Puppy:** The puppy is small and mostly white, with a very fluffy coat. It has floppy ears and dark eyes. It's sitting with its paws tucked in, looking slightly to the right.\n* **Collar:** The puppy is wearing a red collar with a gold bell attached.\n* **Background:** The puppy is sitting on a textured stone step or ledge. The background is out of focus, with hints of a reddish-brown color that could be a wall or a door.\n* **Lighting:** The lighting is soft and diffused, creating gentle shadows and highlighting the puppy’s fluffy fur.\n* **Composition:** The puppy is positioned in the center of the frame, and the low angle makes it appear even more adorable.\n\n\n\nThe image evokes a feeling of warmth and tenderness, emphasizing the puppy’s cuteness and vulnerability."},"done":true,"done_reason":"stop","total_duration":5091334589}

Fails via the OpenAI API:

for i in ministral-3:14b gemma3:4b gemma3:12b gemma3:27b ; do echo "********** $i" ; echo '{                                                                     
    "model":"'$i'",
    "messages":[{"role":"user","content":[{"type":"text","text":"Describe this image."},{"type":"image_url","image_url":"data:image/png;base64,'"$(base64 -w0 ./image1.png)"'"}]}],
    "stream":false                                
}' | curl -s  https://ollama.com/v1/chat/completions -H "Authorization: Bearer ${OLLAMA_API_KEY:?}" -d @- ; done

********** ministral-3:14b
{"id":"chatcmpl-395","object":"chat.completion","created":1765677853,"model":"ministral-3:14b","system_fingerprint":"fp_ollama","choices":[{"index":0,"message":{"role":"assistant","content":"The image shows a small, fluffy white puppy sitting on a stone step. The puppy has a cute, rounded face with large, expressive eyes and floppy ears that are white and slightly darker at the tips. It appears to be wearing a small red collar with a bell attached to it, which is likely to help in training or for identification purposes. The puppy is sitting in a relaxed manner, looking slightly to the side with a gentle and curious expression. The background is blurred, but it seems to be an outdoor setting with a light-colored surface, possibly a patio or terrace."},"finish_reason":"stop"}],"usage":{"prompt_tokens":308,"completion_tokens":118,"total_tokens":426}}
********** gemma3:4b
{"error":"Internal Server Error"}
********** gemma3:12b
{"error":"Internal Server Error"}
********** gemma3:27b
{"error":"Internal Server Error"}

Relevant log output

OS

Linux

GPU

Other

CPU

Other

Ollama version

cloud

Originally created by @rick-github on GitHub (Dec 14, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/13464 Originally assigned to: @BruceMacD on GitHub. ### What is the issue? Works via Ollama API: ```console for i in ministral-3:14b gemma3:4b gemma3:12b gemma3:27b ; do echo "********** $i" ; echo '{ "model":"'$i'", "messages":[{"role":"user","content":"Describe this image.", "images":["'"$(base64 -w0 ./image1.png)"'"]}], "stream":false }' | curl -s https://ollama.com/api/chat -H "Authorization: Bearer ${OLLAMA_API_KEY:?}" -d @- ; done ``` ``` ********** ministral-3:14b {"model":"ministral-3:14b","created_at":"2025-12-14T02:05:33.006718568Z","message":{"role":"assistant","content":"The image shows a young, fluffy white puppy sitting on a set of stone steps. The puppy has a soft, thick coat and appears to be quite small and young, likely a few weeks old. It is wearing a red collar with a small bell attached, which is a common accessory for puppies to help with training and to alert owners to their presence. The puppy is looking directly at the camera with a curious and somewhat innocent expression. The background is blurred, focusing attention on the puppy, and it appears to be an outdoor setting, possibly a porch or a patio area."},"done":true,"done_reason":"stop","total_duration":1656158975,"prompt_eval_count":308,"eval_count":118} ********** gemma3:4b {"model":"gemma3:4b","created_at":"2025-12-14T02:05:35.581613991Z","message":{"role":"assistant","content":"Here’s a description of the image:\n\n**Overall Impression:** The image is a close-up, heartwarming shot of a very young, fluffy white puppy. It's a soft, inviting image with a focus on the puppy’s cuteness.\n\n**Details:**\n\n* **Subject:** A tiny, white puppy is the clear focal point. It appears to be a Shiba Inu puppy, judging by its facial features and fluffy coat.\n* **Pose:** The puppy is sitting attentively, looking slightly to the side with a gentle, curious expression. It’s sitting on a concrete step.\n* **Appearance:** The puppy is incredibly fluffy, with a thick, snow-white coat. It has dark eyes and ears that are slightly folded. It is wearing a red collar with a small, golden bell attached.\n* **Background:** The background is blurred and consists of a stone or concrete step. A portion of a dark wooden structure or door is visible in the very top left corner.\n* **Lighting:** The lighting appears to be natural and soft, giving the puppy a warm glow. \n\n**Overall Tone:** The image evokes feelings of warmth, innocence, and cuteness. It's a lovely portrait of a precious little puppy.\n\nWould you like me to focus on any particular aspect of the image?"},"done":true,"done_reason":"stop","total_duration":2180903936} ********** gemma3:12b {"model":"gemma3:12b","created_at":"2025-12-14T02:05:39.784312004Z","message":{"role":"assistant","content":"Here's a description of the image:\n\n**Overall Impression:**\n\nThe image features an adorable, fluffy white puppy sitting on a stone surface, likely a step or ledge. The photo has a warm, slightly vintage feel.\n\n**Details:**\n\n* **The Puppy:** The puppy is the clear focal point. It's a small, fluffy ball of white fur with dark eyes that give it a sweet, slightly concerned expression. It's wearing a red collar with a golden bell charm.\n* **Surface:** The puppy is sitting on a gray stone surface with a textured, aged appearance. It seems to be a step or ledge, with visible cracks and variations in color, adding to the rustic vibe.\n* **Background:** The background is blurred and out of focus, suggesting the photographer's intention to keep the viewer's attention on the puppy. A hint of a reddish-brown object can be seen.\n* **Lighting:** The lighting appears to be soft and natural, creating gentle shadows and highlighting the puppy's fur.\n\n**Overall Mood:**\n\nThe image evokes feelings of tenderness, cuteness, and perhaps a touch of nostalgia."},"done":true,"done_reason":"stop","total_duration":3771276122} ********** gemma3:27b {"model":"gemma3:27b","created_at":"2025-12-14T02:05:45.304294215Z","message":{"role":"assistant","content":"Here's a description of the image:\n\n**Overall Impression:**\n\nThe image features an incredibly cute, fluffy white puppy sitting on what appears to be a stone step. The puppy is the main focus, and the soft lighting and shallow depth of field contribute to a sweet, endearing aesthetic. \n\n**Detailed Description:**\n\n* **Puppy:** The puppy is small and mostly white, with a very fluffy coat. It has floppy ears and dark eyes. It's sitting with its paws tucked in, looking slightly to the right.\n* **Collar:** The puppy is wearing a red collar with a gold bell attached.\n* **Background:** The puppy is sitting on a textured stone step or ledge. The background is out of focus, with hints of a reddish-brown color that could be a wall or a door.\n* **Lighting:** The lighting is soft and diffused, creating gentle shadows and highlighting the puppy’s fluffy fur.\n* **Composition:** The puppy is positioned in the center of the frame, and the low angle makes it appear even more adorable.\n\n\n\nThe image evokes a feeling of warmth and tenderness, emphasizing the puppy’s cuteness and vulnerability."},"done":true,"done_reason":"stop","total_duration":5091334589} ``` Fails via the OpenAI API: ```console for i in ministral-3:14b gemma3:4b gemma3:12b gemma3:27b ; do echo "********** $i" ; echo '{ "model":"'$i'", "messages":[{"role":"user","content":[{"type":"text","text":"Describe this image."},{"type":"image_url","image_url":"data:image/png;base64,'"$(base64 -w0 ./image1.png)"'"}]}], "stream":false }' | curl -s https://ollama.com/v1/chat/completions -H "Authorization: Bearer ${OLLAMA_API_KEY:?}" -d @- ; done ``` ``` ********** ministral-3:14b {"id":"chatcmpl-395","object":"chat.completion","created":1765677853,"model":"ministral-3:14b","system_fingerprint":"fp_ollama","choices":[{"index":0,"message":{"role":"assistant","content":"The image shows a small, fluffy white puppy sitting on a stone step. The puppy has a cute, rounded face with large, expressive eyes and floppy ears that are white and slightly darker at the tips. It appears to be wearing a small red collar with a bell attached to it, which is likely to help in training or for identification purposes. The puppy is sitting in a relaxed manner, looking slightly to the side with a gentle and curious expression. The background is blurred, but it seems to be an outdoor setting with a light-colored surface, possibly a patio or terrace."},"finish_reason":"stop"}],"usage":{"prompt_tokens":308,"completion_tokens":118,"total_tokens":426}} ********** gemma3:4b {"error":"Internal Server Error"} ********** gemma3:12b {"error":"Internal Server Error"} ********** gemma3:27b {"error":"Internal Server Error"} ``` ### Relevant log output ```shell ``` ### OS Linux ### GPU Other ### CPU Other ### Ollama version cloud
GiteaMirror added the cloudbug labels 2026-04-22 18:23:05 -05:00
GiteaMirror commented 2026-04-22 18:23:06 -05:00
Author
Owner
Copy Link

@aditya14as commented on GitHub (Dec 22, 2025):

I really want to work on this issue @BruceMacD @ParthSareen Can you please assign this to me?

<!-- gh-comment-id:3682999400 --> @aditya14as commented on GitHub (Dec 22, 2025): I really want to work on this issue @BruceMacD @ParthSareen Can you please assign this to me?
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
 python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
No Label bug cloud
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#34644
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?