[GH-ISSUE #12196] Gemma3 not deployable via Ollama #8112

Closed
opened 2026-04-12 20:26:42 -05:00 by GiteaMirror · 3 comments
Owner

Originally created by @ImahnShekhzadeh on GitHub (Sep 6, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/12196

What is the issue?

Hi,
I'm trying to run gemma3:12b via ollama as follows:

docker system prune -f && \
docker run -d --gpus=all -v ollama:/root/.ollama -p 5049:5049 \
--name gemma3 ollama/ollama && \
docker exec -it gemma3 ollama run gemma3:12b && \
docker stop gemma3 && \
docker rm gemma3 && \
docker system prune -f

I have already upgraded ollama to the latest version. Running mistral-nemo works, though:

docker system prune -f && \
docker run -d --gpus=all -v ollama:/root/.ollama -p 5049:5049 \
--name mistral-nemo ollama/ollama && \
docker exec -it mistral-nemo ollama run mistral-nemo && \
docker stop mistral-nemo && \
docker rm mistral-nemo && \
docker system prune -f

Relevant log output

When trying to run gemma3:12b:

Total reclaimed space: 0B
1d9cfac212d486e0d386f8d51ee2365c211f39ed0bac3c6014f1afd8aff1607b
pulling manifest 
Error: pull model manifest: 412: 

The model you are attempting to pull requires a newer version of Ollama.

Please download the latest version at:

	https://ollama.com/download

OS

Linux

GPU

Nvidia

CPU

Intel

Ollama version

0.11.10

Originally created by @ImahnShekhzadeh on GitHub (Sep 6, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/12196 ### What is the issue? Hi, I'm trying to run `gemma3:12b` via `ollama` as follows: ``` docker system prune -f && \ docker run -d --gpus=all -v ollama:/root/.ollama -p 5049:5049 \ --name gemma3 ollama/ollama && \ docker exec -it gemma3 ollama run gemma3:12b && \ docker stop gemma3 && \ docker rm gemma3 && \ docker system prune -f ``` I have already upgraded `ollama` to the latest version. Running `mistral-nemo` works, though: ``` docker system prune -f && \ docker run -d --gpus=all -v ollama:/root/.ollama -p 5049:5049 \ --name mistral-nemo ollama/ollama && \ docker exec -it mistral-nemo ollama run mistral-nemo && \ docker stop mistral-nemo && \ docker rm mistral-nemo && \ docker system prune -f ``` ### Relevant log output When trying to run `gemma3:12b`: ```shell Total reclaimed space: 0B 1d9cfac212d486e0d386f8d51ee2365c211f39ed0bac3c6014f1afd8aff1607b pulling manifest Error: pull model manifest: 412: The model you are attempting to pull requires a newer version of Ollama. Please download the latest version at: https://ollama.com/download ``` ### OS Linux ### GPU Nvidia ### CPU Intel ### Ollama version 0.11.10
GiteaMirror added the bug label 2026-04-12 20:26:42 -05:00
Author
Owner

@rick-github commented on GitHub (Sep 6, 2025):

What does the following output:

docker run --rm ollama/ollama --version 
<!-- gh-comment-id:3261635586 --> @rick-github commented on GitHub (Sep 6, 2025): What does the following output: ``` docker run --rm ollama/ollama --version ```
Author
Owner

@ImahnShekhzadeh commented on GitHub (Sep 6, 2025):

Hi @rick-github,

the output is

Warning: could not connect to a running Ollama instance
Warning: client version is 0.3.12

So it seems I need to upgrade ollama in the docker instance. I'll give it a try and let you know if there are any issues/questions.

<!-- gh-comment-id:3261725904 --> @ImahnShekhzadeh commented on GitHub (Sep 6, 2025): Hi @rick-github, the output is ```shell Warning: could not connect to a running Ollama instance Warning: client version is 0.3.12 ``` So it seems I need to upgrade `ollama` in the docker instance. I'll give it a try and let you know if there are any issues/questions.
Author
Owner

@rick-github commented on GitHub (Sep 6, 2025):

docker pull ollama/ollama
<!-- gh-comment-id:3261728936 --> @rick-github commented on GitHub (Sep 6, 2025): ``` docker pull ollama/ollama ```
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#8112