github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-05-06 16:11:34 -05:00
Code Issues 14.5k Packages Projects Releases 120 Wiki Activity

[GH-ISSUE #10731] degraded response quality with llama3.2-vision + 0.7.0 #69107

New Issue
Closed
opened 2026-05-04 17:10:52 -05:00 by GiteaMirror · 3 comments
GiteaMirror commented 2026-05-04 17:10:52 -05:00
Owner
Copy Link

Originally created by @rick-github on GitHub (May 16, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/10731

What is the issue?

0.6.8

$ for i in in {1..5} ; do ollama run llama3.2-vision:11b.bak describe this picture in 10 words ./picture.png ; done
Added image './picture.png'
A small white puppy with a red collar on its neck.

Added image './picture.png'
A small white puppy with a red collar.

Added image './picture.png'
A small white puppy with a red collar.

Added image './picture.png'
A white puppy with a red collar sits on concrete.

Added image './picture.png'
Small white dog with red collar sitting on stone step.

Added image './picture.png'
A small white dog with a red collar and bell.

0.7.0

$ for i in in {1..5} ; do ollama run llama3.2-vision:11b describe this picture in 10 words ./picture.png ; done
Added image './picture.png'
The image depicts a small white dog with a black nose and dark eyes, standing on a wooden floor.

Added image './picture.png'
The image shows a small, white dog with a red collar sitting on a stone or concrete surface. The dog appears to be a puppy, with a fluffy coat and a short tail. It is sitting on a flat surface, possibly a patio or a sidewalk, with 
its front paws tucked under its body and its head held up. The dog's ears are perked up, and it appears to be looking directly at the camera. The background of the image is out of focus, but it appears to be a wall or a fence. 
Overall, the image suggests that the dog is a happy and curious puppy who is enjoying its surroundings.

Added image './picture.png'
The image shows a white cat sitting on a couch. The cat is wearing a collar and looking at the camera. The background is a couch with a blanket on it.

Added image './picture.png'
The image features a small white dog with a black nose and floppy ears, standing on a gray concrete floor. The dog's body is oriented to the left, and its head is slightly tilted towards the camera. It has a short, smooth coat and 
appears to be a puppy or young adult. The dog's eyes are not visible, but its ears are perked up, and its mouth is closed. The dog's fur is a light gray color, and it has a distinctive black nose. The dog's posture suggests that it 
is alert and attentive, possibly waiting for a command or watching something in the distance. The background of the image is a gray concrete floor, which provides a neutral and unobtrusive backdrop for the dog. Overall, the image 
presents a clear and detailed view of the dog, showcasing its features and behavior.

Added image './picture.png'
The image shows a white cat with a pink collar and a pink tag on its collar.

Added image './picture.png'
The image shows a white dog with a red collar sitting on a stone floor.

NAME                                       ID              SIZE      MODIFIED     
llama3.2-vision:11b.bak                    38107a0cd119    7.9 GB    16 hours ago    
llama3.2-vision:11b                        684232d97d29    8.1 GB    14 hours ago

Relevant log output

OS

Linux, Docker

GPU

Nvidia

CPU

Intel

Ollama version

0.6.8, 0.7.0

Originally created by @rick-github on GitHub (May 16, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/10731 ### What is the issue? 0.6.8 ```console $ for i in in {1..5} ; do ollama run llama3.2-vision:11b.bak describe this picture in 10 words ./picture.png ; done Added image './picture.png' A small white puppy with a red collar on its neck. Added image './picture.png' A small white puppy with a red collar. Added image './picture.png' A small white puppy with a red collar. Added image './picture.png' A white puppy with a red collar sits on concrete. Added image './picture.png' Small white dog with red collar sitting on stone step. Added image './picture.png' A small white dog with a red collar and bell. ``` 0.7.0 ```console $ for i in in {1..5} ; do ollama run llama3.2-vision:11b describe this picture in 10 words ./picture.png ; done Added image './picture.png' The image depicts a small white dog with a black nose and dark eyes, standing on a wooden floor. Added image './picture.png' The image shows a small, white dog with a red collar sitting on a stone or concrete surface. The dog appears to be a puppy, with a fluffy coat and a short tail. It is sitting on a flat surface, possibly a patio or a sidewalk, with its front paws tucked under its body and its head held up. The dog's ears are perked up, and it appears to be looking directly at the camera. The background of the image is out of focus, but it appears to be a wall or a fence. Overall, the image suggests that the dog is a happy and curious puppy who is enjoying its surroundings. Added image './picture.png' The image shows a white cat sitting on a couch. The cat is wearing a collar and looking at the camera. The background is a couch with a blanket on it. Added image './picture.png' The image features a small white dog with a black nose and floppy ears, standing on a gray concrete floor. The dog's body is oriented to the left, and its head is slightly tilted towards the camera. It has a short, smooth coat and appears to be a puppy or young adult. The dog's eyes are not visible, but its ears are perked up, and its mouth is closed. The dog's fur is a light gray color, and it has a distinctive black nose. The dog's posture suggests that it is alert and attentive, possibly waiting for a command or watching something in the distance. The background of the image is a gray concrete floor, which provides a neutral and unobtrusive backdrop for the dog. Overall, the image presents a clear and detailed view of the dog, showcasing its features and behavior. Added image './picture.png' The image shows a white cat with a pink collar and a pink tag on its collar. Added image './picture.png' The image shows a white dog with a red collar sitting on a stone floor. ``` ```console NAME ID SIZE MODIFIED llama3.2-vision:11b.bak 38107a0cd119 7.9 GB 16 hours ago llama3.2-vision:11b 684232d97d29 8.1 GB 14 hours ago ``` ### Relevant log output ```shell ``` ### OS Linux, Docker ### GPU Nvidia ### CPU Intel ### Ollama version 0.6.8, 0.7.0
GiteaMirror added the bug label 2026-05-04 17:10:52 -05:00
GiteaMirror commented 2026-05-04 17:10:58 -05:00
Author
Owner
Copy Link

@rick-github commented on GitHub (May 16, 2025):

gemma3, mistral-small3.1 and llama4 offer mostly the same responses between 0.6.8 and 0.7.0 so this appears to be a problem with the new llama3.2-vision model. See also #10730.

<!-- gh-comment-id:2886567372 --> @rick-github commented on GitHub (May 16, 2025): gemma3, mistral-small3.1 and llama4 offer mostly the same responses between 0.6.8 and 0.7.0 so this appears to be a problem with the new llama3.2-vision model. See also #10730.
GiteaMirror commented 2026-05-04 17:10:59 -05:00
Author
Owner
Copy Link

@rick-github commented on GitHub (May 16, 2025):

llama3.2-vision:90b has similarly poor responses.

<!-- gh-comment-id:2886991815 --> @rick-github commented on GitHub (May 16, 2025): llama3.2-vision:90b has similarly poor responses.
GiteaMirror commented 2026-05-04 17:11:00 -05:00
Author
Owner
Copy Link

@rick-github commented on GitHub (May 24, 2025):

Pulling the updated model improved responses.

$ for i in in {1..5} ; do ollama run llama3.2-vision:11b describe this picture in 10 words ./picture.png ; done
Added image './picture.png'
This image depicts a small white dog with a red collar.

Added image './picture.png'
The image features a small white dog with a red collar. The dog is sitting on a stone surface, looking to its right.

Added image './picture.png'
This is a small white dog with a red collar and a bell.

Added image './picture.png'
This image is a close-up of a small, white dog.

Added image './picture.png'
The image features a small white puppy with a red collar.

Added image './picture.png'
The picture shows a small white puppy with a red collar. It is sitting.
<!-- gh-comment-id:2906089368 --> @rick-github commented on GitHub (May 24, 2025): Pulling the updated model improved responses. ```console $ for i in in {1..5} ; do ollama run llama3.2-vision:11b describe this picture in 10 words ./picture.png ; done Added image './picture.png' This image depicts a small white dog with a red collar. Added image './picture.png' The image features a small white dog with a red collar. The dog is sitting on a stone surface, looking to its right. Added image './picture.png' This is a small white dog with a red collar and a bell. Added image './picture.png' This image is a close-up of a small, white dog. Added image './picture.png' The image features a small white puppy with a red collar. Added image './picture.png' The picture shows a small white puppy with a red collar. It is sitting. ```
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
 python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
No Label bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#69107
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?