github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-04-28 23:18:14 -05:00
Code Issues 9.8k Packages Projects Releases 117 Wiki Activity
Files
94f110b35aaa774a797cde3ee16e7260ee46b855
ollama/server/quantization.go
Michael Yang d0b32def60 skip quantizing per_layer_token_embd (#11207) 
this tensor isn't compatible with cuda when quantized to q4_K so skip it
2025-06-26 21:49:35 -07:00

8.2 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink