github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-07-16 05:05:37 -05:00
Code Issues 16.9k Packages Projects Releases 122 Wiki Activity

[GH-ISSUE #8296] Some Models seem to be crashing while using with JSON Schema mode #82996

New Issue
Open
opened 2026-05-09 16:54:38 -05:00 by GiteaMirror · 1 comment
GiteaMirror commented 2026-05-09 16:54:38 -05:00
Owner
Copy Link

Originally created by @VistritPandey on GitHub (Jan 3, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/8296

Originally assigned to: @ParthSareen on GitHub.

What is the issue?

OS: MacOS Sequoia | Linux
Processor | GPU: M3, M4 Pro, i7 with RTX 4070 [Same issue across various devices]
ollama version is 0.5.4

When I try running a batch to get results for it If I specify a format (JSON Schema), then it randomly stops processing randomly at a certain level of the batch. Let's say if I have 100 images, it will randomly stop at 15 or 16 etc. but when you restart the same batch, it does not pause/stop at the number it stopped before. When using Ollama Serve, I am not able to see any errors. But when using without the JSON Schema; it does not fail. This means the issue may be with certain models and how they are handling the JSON Schema.

I used the following models, with vision:
Llama 3.2-vision (never crashed or paused)
Llava-llama3 (crashes/stops occasionally with the JSON Schema)
Minicpm-v (crashes/stops occasionally with the JSON Schema)

OS

macOS

GPU

Apple

CPU

Apple

Ollama version

0.5.4

Originally created by @VistritPandey on GitHub (Jan 3, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/8296 Originally assigned to: @ParthSareen on GitHub. ### What is the issue? OS: MacOS Sequoia | Linux Processor | GPU: M3, M4 Pro, i7 with RTX 4070 [Same issue across various devices] ollama version is 0.5.4 When I try running a batch to get results for it If I specify a format (JSON Schema), then it randomly stops processing randomly at a certain level of the batch. Let's say if I have 100 images, it will randomly stop at 15 or 16 etc. but when you restart the same batch, it does not pause/stop at the number it stopped before. When using Ollama Serve, I am not able to see any errors. But when using without the JSON Schema; it does not fail. This means the issue may be with certain models and how they are handling the JSON Schema. I used the following models, with vision: Llama 3.2-vision (never crashed or paused) Llava-llama3 (crashes/stops occasionally with the JSON Schema) Minicpm-v (crashes/stops occasionally with the JSON Schema) ### OS macOS ### GPU Apple ### CPU Apple ### Ollama version 0.5.4
GiteaMirror added the bug label 2026-05-09 16:54:38 -05:00
GiteaMirror commented 2026-05-09 16:54:39 -05:00
Author
Owner
Copy Link

@karkisa commented on GitHub (Nov 14, 2025):

@VistritPandey thanks for opening this issue
@ParthSareen I face this issue as well for different set of models
more so with the qwen2.5 vl
the model just holds on the resource , and re-processing does not really work as it ends up in same situation

<!-- gh-comment-id:3533486123 --> @karkisa commented on GitHub (Nov 14, 2025): @VistritPandey thanks for opening this issue @ParthSareen I face this issue as well for different set of models more so with the qwen2.5 vl the model just holds on the resource , and re-processing does not really work as it ends up in same situation
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
 python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
No Label bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#82996
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?