[GH-ISSUE #9908] gemma3:27b not working #53000

Closed
opened 2026-04-29 01:37:32 -05:00 by GiteaMirror · 2 comments
Owner

Originally created by @jankogasic on GitHub (Mar 20, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/9908

What is the issue?

I am unable to make gemma3:27b work.

Image

Llama3.3:70B and gemma3:4b are working.

from nvidia-smi output it seems that entire 17GB of model are loaded onto GPU.

docker-compose.yaml:

Image

Relevant log output


OS

Docker

GPU

Nvidia

CPU

AMD

Ollama version

Tried both 0.6.1 and 0.6.2

Originally created by @jankogasic on GitHub (Mar 20, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/9908 ### What is the issue? I am unable to make `gemma3:27b` work. <img width="1320" alt="Image" src="https://github.com/user-attachments/assets/ebc56b4b-8753-4664-8cd4-775bd78383e0" /> `Llama3.3:70B` and `gemma3:4b` are working. from `nvidia-smi` output it seems that entire 17GB of model are loaded onto GPU. docker-compose.yaml: <img width="516" alt="Image" src="https://github.com/user-attachments/assets/6a34a6c5-83e1-470c-9295-305d20fb0b58" /> ### Relevant log output ```shell ``` ### OS Docker ### GPU Nvidia ### CPU AMD ### Ollama version Tried both 0.6.1 and 0.6.2
GiteaMirror added the bug label 2026-04-29 01:37:32 -05:00
Author
Owner

@rick-github commented on GitHub (Mar 20, 2025):

Server logs may aid in debugging. But be aware that gemma3 has a substantial system RAM footprint at the moment - :27b wants about 13G, so I suspect that the memory: 8g line in your docker config, combined with llama runner process has terminated: signal: killed, means that your kernel killed the runner due to OOM.

<!-- gh-comment-id:2740741698 --> @rick-github commented on GitHub (Mar 20, 2025): [Server logs](https://github.com/ollama/ollama/blob/main/docs/troubleshooting.md#how-to-troubleshoot-issues) may aid in debugging. But be aware that gemma3 has a substantial system RAM footprint at the moment - :27b wants about 13G, so I suspect that the `memory: 8g` line in your docker config, combined with `llama runner process has terminated: signal: killed`, means that your kernel killed the runner due to OOM.
Author
Owner

@jankogasic commented on GitHub (Mar 20, 2025):

That's it. It's working now. Too bad docker logs are not more precise in this case.

Thanks!

<!-- gh-comment-id:2740974739 --> @jankogasic commented on GitHub (Mar 20, 2025): That's it. It's working now. Too bad docker logs are not more precise in this case. Thanks!
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#53000