[GH-ISSUE #3139] low ram usage #63970

Closed
opened 2026-05-03 15:36:01 -05:00 by GiteaMirror · 1 comment
Owner

Originally created by @parzzd on GitHub (Mar 14, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/3139

i have a problem with the ram usage for qwen_1_5_4b
i have 16gb ram, but the software only use 1.6gb
is there a way to dedicate more ram to ollama process?

Originally created by @parzzd on GitHub (Mar 14, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/3139 i have a problem with the ram usage for qwen_1_5_4b i have 16gb ram, but the software only use 1.6gb is there a way to dedicate more ram to ollama process?
GiteaMirror added the question label 2026-05-03 15:36:01 -05:00
Author
Owner

@pdevine commented on GitHub (Mar 14, 2024):

Hey @parzzd , you're actually using a 4b parameter 4bit quantized version of qwen. If you don't want to use as heavily quantized version of that model you can:

ollama run qwen:4b-chat-v1.5-fp16

That should take about 9GB of RAM using a non-quantized model. You can try using a higher parameter count (like 7b) and play around with what level of quantization that you want.

I'll go ahead and close the issue, but feel free to keep commenting.

<!-- gh-comment-id:1998284967 --> @pdevine commented on GitHub (Mar 14, 2024): Hey @parzzd , you're actually using a 4b parameter 4bit quantized version of qwen. If you don't want to use as heavily quantized version of that model you can: ``` ollama run qwen:4b-chat-v1.5-fp16 ``` That should take about 9GB of RAM using a non-quantized model. You can try using a higher parameter count (like 7b) and play around with what level of quantization that you want. I'll go ahead and close the issue, but feel free to keep commenting.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#63970