[GH-ISSUE #5422] Verify and re-order GGUF files on ollama create #81072

Closed
opened 2026-05-09 10:19:05 -05:00 by GiteaMirror · 1 comment
Owner

Originally created by @jmorganca on GitHub (Jul 1, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/5422

What is the issue?

In certain cases GGUF files don't have ordered tensors – this creates a problem when estimating memory utilization because the start and end of a layer may be far apart

OS

No response

GPU

No response

CPU

No response

Ollama version

No response

Originally created by @jmorganca on GitHub (Jul 1, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/5422 ### What is the issue? In certain cases GGUF files don't have ordered tensors – this creates a problem when estimating memory utilization because the start and end of a layer may be far apart ### OS _No response_ ### GPU _No response_ ### CPU _No response_ ### Ollama version _No response_
GiteaMirror added the bug label 2026-05-09 10:19:05 -05:00
Author
Owner

@pdevine commented on GitHub (Mar 19, 2025):

I'm going to close this as ideally we should just separate all of the tensors and order this in the manifest.

<!-- gh-comment-id:2735346741 --> @pdevine commented on GitHub (Mar 19, 2025): I'm going to close this as ideally we should just separate all of the tensors and order this in the manifest.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#81072