[GH-ISSUE #6333] "couldn't remove unused layers: invalid character '\x00' looking for beginning of value" #50484

Closed
opened 2026-04-28 16:03:37 -05:00 by GiteaMirror · 5 comments
Owner

Originally created by @FellowTraveler on GitHub (Aug 13, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/6333

What is the issue?

image
(base) ollama % ollama pull llama3.1:8b-instruct-q8_0
pulling manifest 
pulling cc04e85e1f86... 100% ▕█████████████████████████████████████▏ 8.5 GB                         
pulling 11ce4ee3e170... 100% ▕█████████████████████████████████████▏ 1.7 KB                         
pulling 0ba8f0e314b4... 100% ▕█████████████████████████████████████▏  12 KB                         
pulling 56bb8bd477a5... 100% ▕█████████████████████████████████████▏   96 B                         
pulling 4a4a958ae550... 100% ▕█████████████████████████████████████▏  485 B                         
verifying sha256 digest 
writing manifest 
removing any unused layers 
success 
(base) ollama % ollama pull llama3.1:70b-instruct-q5_K_M
pulling manifest 
pulling f8f84c9d6421... 100% ▕█████████████████████████████████████▏  49 GB                         
pulling 11ce4ee3e170... 100% ▕█████████████████████████████████████▏ 1.7 KB                         
pulling 0ba8f0e314b4... 100% ▕█████████████████████████████████████▏  12 KB                         
pulling 56bb8bd477a5... 100% ▕█████████████████████████████████████▏   96 B                         
pulling a9528db392c2... 100% ▕█████████████████████████████████████▏  488 B                         
verifying sha256 digest 
writing manifest 
removing any unused layers 
success 
(base) ollama % ollama pull llama3.1:70b-instruct-q4_K_M
pulling manifest 
pulling de20d2cf2dc4... 100% ▕█████████████████████████████████████▏  42 GB                         
pulling 11ce4ee3e170... 100% ▕█████████████████████████████████████▏ 1.7 KB                         
pulling 0ba8f0e314b4... 100% ▕█████████████████████████████████████▏  12 KB                         
pulling 56bb8bd477a5... 100% ▕█████████████████████████████████████▏   96 B                         
pulling 4bde18c49e43... 100% ▕█████████████████████████████████████▏  488 B                         
verifying sha256 digest 
writing manifest 
removing any unused layers 
couldn't remove unused layers: invalid character '\x00' looking for beginning of value 
success 
(base) ollama % ollama pull llama3.1:70b-instruct-q4_K_M
pulling manifest 
pulling de20d2cf2dc4... 100% ▕█████████████████████████████████████▏  42 GB                         
pulling 11ce4ee3e170... 100% ▕█████████████████████████████████████▏ 1.7 KB                         
pulling 0ba8f0e314b4... 100% ▕█████████████████████████████████████▏  12 KB                         
pulling 56bb8bd477a5... 100% ▕█████████████████████████████████████▏   96 B                         
pulling 4bde18c49e43... 100% ▕█████████████████████████████████████▏  488 B                         
verifying sha256 digest 
writing manifest 
removing any unused layers 
couldn't remove unused layers: invalid character '\x00' looking for beginning of value 
success 
(base) ollama % ollama pull llama3.1:70b-instruct-q5_K_M
pulling manifest 
pulling f8f84c9d6421... 100% ▕█████████████████████████████████████▏  49 GB                         
pulling 11ce4ee3e170... 100% ▕█████████████████████████████████████▏ 1.7 KB                         
pulling 0ba8f0e314b4... 100% ▕█████████████████████████████████████▏  12 KB                         
pulling 56bb8bd477a5... 100% ▕█████████████████████████████████████▏   96 B                         
pulling a9528db392c2... 100% ▕█████████████████████████████████████▏  488 B                         
verifying sha256 digest 
writing manifest 
removing any unused layers 
couldn't remove unused layers: invalid character '\x00' looking for beginning of value 
success 
(base) ollama % ollama pull llama3.1:8b-instruct-q8_0   
pulling manifest 
pulling cc04e85e1f86... 100% ▕█████████████████████████████████████▏ 8.5 GB                         
pulling 11ce4ee3e170... 100% ▕█████████████████████████████████████▏ 1.7 KB                         
pulling 0ba8f0e314b4... 100% ▕█████████████████████████████████████▏  12 KB                         
pulling 56bb8bd477a5... 100% ▕█████████████████████████████████████▏   96 B                         
pulling 4a4a958ae550... 100% ▕█████████████████████████████████████▏  485 B                         
verifying sha256 digest 
writing manifest 
removing any unused layers 
couldn't remove unused layers: invalid character '\x00' looking for beginning of value 
success 
(base) ollama % ollama pull llama3.1:8b-instruct-fp16   
pulling manifest 
pulling 09cd6813dc2e... 100% ▕█████████████████████████████████████▏  16 GB                         
pulling 11ce4ee3e170... 100% ▕█████████████████████████████████████▏ 1.7 KB                         
pulling 0ba8f0e314b4... 100% ▕█████████████████████████████████████▏  12 KB                         
pulling 56bb8bd477a5... 100% ▕█████████████████████████████████████▏   96 B                         
pulling daa7d15f6d0b... 100% ▕█████████████████████████████████████▏  484 B                         
verifying sha256 digest 
writing manifest 
removing any unused layers 
couldn't remove unused layers: invalid character '\x00' looking for beginning of value 
success 
(base) ollama % 

OS

macOS

GPU

Apple

CPU

Apple

Ollama version

0.3.5-1-gb807ec8

Originally created by @FellowTraveler on GitHub (Aug 13, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/6333 ### What is the issue? <img width="934" alt="image" src="https://github.com/user-attachments/assets/937cbcd5-ac5f-4a0a-ba7b-97dc6327efa9"> ``` (base) ollama % ollama pull llama3.1:8b-instruct-q8_0 pulling manifest pulling cc04e85e1f86... 100% ▕█████████████████████████████████████▏ 8.5 GB pulling 11ce4ee3e170... 100% ▕█████████████████████████████████████▏ 1.7 KB pulling 0ba8f0e314b4... 100% ▕█████████████████████████████████████▏ 12 KB pulling 56bb8bd477a5... 100% ▕█████████████████████████████████████▏ 96 B pulling 4a4a958ae550... 100% ▕█████████████████████████████████████▏ 485 B verifying sha256 digest writing manifest removing any unused layers success (base) ollama % ollama pull llama3.1:70b-instruct-q5_K_M pulling manifest pulling f8f84c9d6421... 100% ▕█████████████████████████████████████▏ 49 GB pulling 11ce4ee3e170... 100% ▕█████████████████████████████████████▏ 1.7 KB pulling 0ba8f0e314b4... 100% ▕█████████████████████████████████████▏ 12 KB pulling 56bb8bd477a5... 100% ▕█████████████████████████████████████▏ 96 B pulling a9528db392c2... 100% ▕█████████████████████████████████████▏ 488 B verifying sha256 digest writing manifest removing any unused layers success (base) ollama % ollama pull llama3.1:70b-instruct-q4_K_M pulling manifest pulling de20d2cf2dc4... 100% ▕█████████████████████████████████████▏ 42 GB pulling 11ce4ee3e170... 100% ▕█████████████████████████████████████▏ 1.7 KB pulling 0ba8f0e314b4... 100% ▕█████████████████████████████████████▏ 12 KB pulling 56bb8bd477a5... 100% ▕█████████████████████████████████████▏ 96 B pulling 4bde18c49e43... 100% ▕█████████████████████████████████████▏ 488 B verifying sha256 digest writing manifest removing any unused layers couldn't remove unused layers: invalid character '\x00' looking for beginning of value success (base) ollama % ollama pull llama3.1:70b-instruct-q4_K_M pulling manifest pulling de20d2cf2dc4... 100% ▕█████████████████████████████████████▏ 42 GB pulling 11ce4ee3e170... 100% ▕█████████████████████████████████████▏ 1.7 KB pulling 0ba8f0e314b4... 100% ▕█████████████████████████████████████▏ 12 KB pulling 56bb8bd477a5... 100% ▕█████████████████████████████████████▏ 96 B pulling 4bde18c49e43... 100% ▕█████████████████████████████████████▏ 488 B verifying sha256 digest writing manifest removing any unused layers couldn't remove unused layers: invalid character '\x00' looking for beginning of value success (base) ollama % ollama pull llama3.1:70b-instruct-q5_K_M pulling manifest pulling f8f84c9d6421... 100% ▕█████████████████████████████████████▏ 49 GB pulling 11ce4ee3e170... 100% ▕█████████████████████████████████████▏ 1.7 KB pulling 0ba8f0e314b4... 100% ▕█████████████████████████████████████▏ 12 KB pulling 56bb8bd477a5... 100% ▕█████████████████████████████████████▏ 96 B pulling a9528db392c2... 100% ▕█████████████████████████████████████▏ 488 B verifying sha256 digest writing manifest removing any unused layers couldn't remove unused layers: invalid character '\x00' looking for beginning of value success (base) ollama % ollama pull llama3.1:8b-instruct-q8_0 pulling manifest pulling cc04e85e1f86... 100% ▕█████████████████████████████████████▏ 8.5 GB pulling 11ce4ee3e170... 100% ▕█████████████████████████████████████▏ 1.7 KB pulling 0ba8f0e314b4... 100% ▕█████████████████████████████████████▏ 12 KB pulling 56bb8bd477a5... 100% ▕█████████████████████████████████████▏ 96 B pulling 4a4a958ae550... 100% ▕█████████████████████████████████████▏ 485 B verifying sha256 digest writing manifest removing any unused layers couldn't remove unused layers: invalid character '\x00' looking for beginning of value success (base) ollama % ollama pull llama3.1:8b-instruct-fp16 pulling manifest pulling 09cd6813dc2e... 100% ▕█████████████████████████████████████▏ 16 GB pulling 11ce4ee3e170... 100% ▕█████████████████████████████████████▏ 1.7 KB pulling 0ba8f0e314b4... 100% ▕█████████████████████████████████████▏ 12 KB pulling 56bb8bd477a5... 100% ▕█████████████████████████████████████▏ 96 B pulling daa7d15f6d0b... 100% ▕█████████████████████████████████████▏ 484 B verifying sha256 digest writing manifest removing any unused layers couldn't remove unused layers: invalid character '\x00' looking for beginning of value success (base) ollama % ``` ### OS macOS ### GPU Apple ### CPU Apple ### Ollama version 0.3.5-1-gb807ec8
GiteaMirror added the bug label 2026-04-28 16:03:37 -05:00
Author
Owner

@FellowTraveler commented on GitHub (Aug 13, 2024):

I don't know how much of an issue this is, I mean the model appears to work fine.
But the message was a little funny so I thought I should report it.

<!-- gh-comment-id:2285612837 --> @FellowTraveler commented on GitHub (Aug 13, 2024): I don't know how much of an issue this is, I mean the model appears to work fine. But the message was a little funny so I thought I should report it.
Author
Owner

@scomper commented on GitHub (Aug 13, 2024):

Encountered the same problem, the issue persists even after deleting and re-downloading.

CleanShot 2024-08-13 at 20 03 29@2x

<!-- gh-comment-id:2286087261 --> @scomper commented on GitHub (Aug 13, 2024): Encountered the same problem, the issue persists even after deleting and re-downloading. ![CleanShot 2024-08-13 at 20 03 29@2x](https://github.com/user-attachments/assets/a9804b4b-732d-44b7-b869-6f64372b1e06)
Author
Owner

@Nicolas-nwb commented on GitHub (Aug 14, 2024):

Same problem on macOS Sonoma 14.6 with ollama version is 0.3.6

CleanShot 2024-08-14 at 10 36 22

<!-- gh-comment-id:2288236053 --> @Nicolas-nwb commented on GitHub (Aug 14, 2024): Same problem on macOS Sonoma 14.6 with ollama version is 0.3.6 ![CleanShot 2024-08-14 at 10 36 22](https://github.com/user-attachments/assets/736caab3-b73a-4c77-9bae-8cf680dc0b1b)
Author
Owner

@mxyng commented on GitHub (Aug 14, 2024):

this is a side effect of a recent change that enabled errors on invalid manifests. it's a result of trying to parse non-manifest files as manifests, namely .DS_Store on macOS but possibly others. this error does not affect the model pull and will be disabled in #6363

<!-- gh-comment-id:2290100506 --> @mxyng commented on GitHub (Aug 14, 2024): this is a side effect of a recent change that enabled errors on invalid manifests. it's a result of trying to parse non-manifest files as manifests, namely `.DS_Store` on macOS but possibly others. this error does not affect the model pull and will be disabled in #6363
Author
Owner

@johntdavies commented on GitHub (Aug 18, 2024):

I ran my usual update...

ollama list | awk '{print $1}' | tail -n +2 | xargs -I {} ollama pull {}

... and got the same n every model...

pulling manifest 
pulling d4403ce5a6e9... 100% ▕█████████████████████████████████████████████████████████████████████████████████████▏ 4.9 GB                         
pulling 0ba8f0e314b4... 100% ▕█████████████████████████████████████████████████████████████████████████████████████▏  12 KB                         
pulling b91960c3d374... 100% ▕█████████████████████████████████████████████████████████████████████████████████████▏ 1.8 KB                         
pulling 4895403bed7b... 100% ▕█████████████████████████████████████████████████████████████████████████████████████▏  202 B                         
pulling 9b0e89db3737... 100% ▕█████████████████████████████████████████████████████████████████████████████████████▏  561 B                         
verifying sha256 digest 
writing manifest 
removing any unused layers 
**couldn't remove unused layers: invalid character '\x00' looking for beginning of value** 
success 

Running on OSX 14.6.1 (M2 Max), Ollama 0.3.6

<!-- gh-comment-id:2295033807 --> @johntdavies commented on GitHub (Aug 18, 2024): I ran my usual update... `ollama list | awk '{print $1}' | tail -n +2 | xargs -I {} ollama pull {}` ... and got the same n every model... ``` pulling manifest pulling d4403ce5a6e9... 100% ▕█████████████████████████████████████████████████████████████████████████████████████▏ 4.9 GB pulling 0ba8f0e314b4... 100% ▕█████████████████████████████████████████████████████████████████████████████████████▏ 12 KB pulling b91960c3d374... 100% ▕█████████████████████████████████████████████████████████████████████████████████████▏ 1.8 KB pulling 4895403bed7b... 100% ▕█████████████████████████████████████████████████████████████████████████████████████▏ 202 B pulling 9b0e89db3737... 100% ▕█████████████████████████████████████████████████████████████████████████████████████▏ 561 B verifying sha256 digest writing manifest removing any unused layers **couldn't remove unused layers: invalid character '\x00' looking for beginning of value** success ``` Running on OSX 14.6.1 (M2 Max), Ollama 0.3.6
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#50484