[GH-ISSUE #10223] Quantization Uses System Drive #32468

Closed
opened 2026-04-22 13:46:05 -05:00 by GiteaMirror · 2 comments
Owner

Originally created by @thot-experiment on GitHub (Apr 10, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/10223

What is the issue?

When quantizing a model ollama writes the whole model to the system drive instead of staying on the drive where the models live. The expected behavior is that ollama isn't hardcoded to use a particular drive for anything, I expect many people do not have the hundreds of gigabytes free for such operations on their system drives.

OS

Windows

GPU

Nvidia

CPU

Intel

Ollama version

0.6.4

Originally created by @thot-experiment on GitHub (Apr 10, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/10223 ### What is the issue? When quantizing a model ollama writes the whole model to the system drive instead of staying on the drive where the models live. The expected behavior is that ollama isn't hardcoded to use a particular drive for *anything*, I expect many people do not have the hundreds of gigabytes free for such operations on their system drives. ### OS Windows ### GPU Nvidia ### CPU Intel ### Ollama version 0.6.4
GiteaMirror added the bug label 2026-04-22 13:46:05 -05:00
Author
Owner

@rick-github commented on GitHub (Apr 10, 2025):

Set %TMP% in the server environment to a temporary directory on the volume where the models are.

<!-- gh-comment-id:2795067756 --> @rick-github commented on GitHub (Apr 10, 2025): Set %TMP% in the server environment to a temporary directory on the volume where the models are.
Author
Owner

@thot-experiment commented on GitHub (Apr 10, 2025):

Fair enough. I'll make a pull clarifying the documentation.

<!-- gh-comment-id:2795123109 --> @thot-experiment commented on GitHub (Apr 10, 2025): Fair enough. I'll make a pull clarifying the documentation.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#32468