[GH-ISSUE #7312] Support for 1-bit LLMs #30407

Closed
opened 2026-04-22 10:00:49 -05:00 by GiteaMirror · 2 comments
Owner

Originally created by @chllei on GitHub (Oct 22, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/7312

Microsoft recently updated their 1-bit LLM inference framework; it is unclear whether Ollama can support it. This is particularly CPU inference-friendly.

Originally created by @chllei on GitHub (Oct 22, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/7312 Microsoft recently updated their [1-bit LLM](https://github.com/microsoft/BitNet) inference framework; it is unclear whether Ollama can support it. This is particularly CPU inference-friendly.
GiteaMirror added the feature request label 2026-04-22 10:00:49 -05:00
Author
Owner

@rick-github commented on GitHub (Oct 22, 2024):

https://github.com/ollama/ollama/issues/2821

<!-- gh-comment-id:2428909419 --> @rick-github commented on GitHub (Oct 22, 2024): https://github.com/ollama/ollama/issues/2821
Author
Owner

@jmorganca commented on GitHub (Nov 18, 2024):

Closing for https://github.com/ollama/ollama/issues/2821 (thanks @rick-github)

<!-- gh-comment-id:2482251796 --> @jmorganca commented on GitHub (Nov 18, 2024): Closing for https://github.com/ollama/ollama/issues/2821 (thanks @rick-github)
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#30407