[GH-ISSUE #10313] Is bitnet-b1.58-2B-4T-gguf available? #68829

Closed
opened 2026-05-04 15:22:33 -05:00 by GiteaMirror · 2 comments
Owner

Originally created by @boojongmin on GitHub (Apr 17, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/10313

question

I'm trying to use bitnet-b1.58-2B-4T-gguf, but I get the following error.

shell

ollama run hf.co/microsoft/bitnet-b1.58-2B-4T-gguf
Error: unable to load model: /Users/bjm/.ollama/models/blobs/sha256-13939ce5030319a35db346e5dba7a3a3bd599dfc18b113a2a97446ff964714c5

bitnet-b1.58-2B-4T-gguf

Originally created by @boojongmin on GitHub (Apr 17, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/10313 ### question I'm trying to use bitnet-b1.58-2B-4T-gguf, but I get the following error. ### shell ``` ollama run hf.co/microsoft/bitnet-b1.58-2B-4T-gguf Error: unable to load model: /Users/bjm/.ollama/models/blobs/sha256-13939ce5030319a35db346e5dba7a3a3bd599dfc18b113a2a97446ff964714c5 ``` ### link [bitnet-b1.58-2B-4T-gguf](https://huggingface.co/microsoft/bitnet-b1.58-2B-4T-gguf/tree/main)
GiteaMirror added the feature request label 2026-05-04 15:22:33 -05:00
Author
Owner

@SamFusco commented on GitHub (Apr 17, 2025):

I'm able to pull it...............

user@host:/usr/local/etc/dockerapps/ollama$ sudo docker compose exec -it ollama ollama pull hf.co/microsoft/bitnet-b1.58-2B-4T-gg
uf
[sudo] password for user:
pulling manifest
pulling 13939ce50303...  57% ▕███████████████████████████████                         ▏ 1.1 GB/1.8 GB   60 MB/s     12s
<!-- gh-comment-id:2812192695 --> @SamFusco commented on GitHub (Apr 17, 2025): I'm able to pull it............... ```bash user@host:/usr/local/etc/dockerapps/ollama$ sudo docker compose exec -it ollama ollama pull hf.co/microsoft/bitnet-b1.58-2B-4T-gg uf [sudo] password for user: pulling manifest pulling 13939ce50303... 57% ▕███████████████████████████████ ▏ 1.1 GB/1.8 GB 60 MB/s 12s ```
Author
Owner

@rick-github commented on GitHub (Apr 17, 2025):

1.58b tensors are currently unsupported. #2821

<!-- gh-comment-id:2812289320 --> @rick-github commented on GitHub (Apr 17, 2025): 1.58b tensors are currently unsupported. #2821
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#68829