[GH-ISSUE #10360] Support Gemma 3 QAT #6807

Closed
opened 2026-04-12 18:35:35 -05:00 by GiteaMirror · 2 comments
Owner

Originally created by @chenbridge on GitHub (Apr 21, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/10360

Originally created by @chenbridge on GitHub (Apr 21, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/10360
GiteaMirror added the feature request label 2026-04-12 18:35:35 -05:00
Author
Owner

@chenbridge commented on GitHub (Apr 21, 2025):

bridge@BRIDGE-AORUS:$ ollama -v
ollama version is 0.6.5
bridge@BRIDGE-AORUS:
$ ollama run hf.co/google/gemma-3-12b-it-qat-q4_0-gguf
pulling manifest
Error: pull model manifest: Get "https://huggingface.co/api/models/google/gemma-3-12b-it-qat-q4_0-gguf/ssh-auth?nonce=7ESktrZPNthdEMIMT4uLMg&scope=&service=&ts=1745227959": read tcp 172.26.36.6:46298->13.33.174.80:443: read: connection reset by peer
bridge@BRIDGE-AORUS:~$

<!-- gh-comment-id:2818053715 --> @chenbridge commented on GitHub (Apr 21, 2025): bridge@BRIDGE-AORUS:~$ ollama -v ollama version is 0.6.5 bridge@BRIDGE-AORUS:~$ ollama run hf.co/google/gemma-3-12b-it-qat-q4_0-gguf pulling manifest Error: pull model manifest: Get "https://huggingface.co/api/models/google/gemma-3-12b-it-qat-q4_0-gguf/ssh-auth?nonce=7ESktrZPNthdEMIMT4uLMg&scope=&service=&ts=1745227959": read tcp 172.26.36.6:46298->13.33.174.80:443: read: connection reset by peer bridge@BRIDGE-AORUS:~$
Author
Owner

@rick-github commented on GitHub (Apr 21, 2025):

https://ollama.com/library/gemma3:12b-it-qat

<!-- gh-comment-id:2818059052 --> @rick-github commented on GitHub (Apr 21, 2025): https://ollama.com/library/gemma3:12b-it-qat
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#6807