[GH-ISSUE #10963] Error: unknown data type: I32 #7223

Closed
opened 2026-04-12 19:13:19 -05:00 by GiteaMirror · 2 comments
Owner

Originally created by @zswodegit on GitHub (Jun 4, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/10963

hi,
Im trying to import local checkpoint Qwen2.5-7B-AWQ download from HF, but always failed. if ollama support I32 type? (ollama version: 0.9.0)

Image

Originally created by @zswodegit on GitHub (Jun 4, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/10963 hi, Im trying to import local checkpoint Qwen2.5-7B-AWQ download from HF, but always failed. if ollama support I32 type? (ollama version: 0.9.0) ![Image](https://github.com/user-attachments/assets/b356fe58-f400-4f14-9262-2c044047d04c)
GiteaMirror added the model label 2026-04-12 19:13:19 -05:00
Author
Owner

@rick-github commented on GitHub (Jun 4, 2025):

AWQ is not supported.

<!-- gh-comment-id:2939420238 --> @rick-github commented on GitHub (Jun 4, 2025): AWQ is not supported.
Author
Owner

@pdevine commented on GitHub (Jun 10, 2025):

Going to go ahead and close this. Ollama doesn't support AWQ quantization currently.

<!-- gh-comment-id:2960212130 --> @pdevine commented on GitHub (Jun 10, 2025): Going to go ahead and close this. Ollama doesn't support AWQ quantization currently.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#7223