github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-05-06 16:11:34 -05:00
Code Issues 14.5k Packages Projects Releases 120 Wiki Activity

[GH-ISSUE #15436] MLX model support for gemma 4 #9865

New Issue
Open
opened 2026-04-12 22:43:42 -05:00 by GiteaMirror · 1 comment
GiteaMirror commented 2026-04-12 22:43:42 -05:00
Owner
Copy Link

Originally created by @toughcoding on GitHub (Apr 8, 2026).
Original GitHub issue: https://github.com/ollama/ollama/issues/15436

Gemma 26B in mlx not supported yet

hf download mlx-community/gemma-4-26b-a4b-it-mxfp4

cd ~/.cache/huggingface/hub/models--mlx-community--gemma-4-26b-a4b-it-mxfp4
cp -rL snapshots/4d7ba9cbe85182e0b6882dfe72fc2fc6ea2b4afb final
echo "FROM final" > Modelfile

ollama create --experimental gemma-4-26b-a4b-it-mxfp4
importing safetensors model 
importing safetensors model 
importing model-00001-of-00003.safetensors (444 tensors) 
importing model-00002-of-00003.safetensors (452 tensors) 
importing model-00003-of-00003.safetensors (594 tensors) 
importing config config.json 
importing config generation_config.json 
importing config processor_config.json 
importing config tokenizer.json 
importing config tokenizer_config.json 
writing manifest for gemma-4-26b-a4b-it-mxfp4 
successfully imported gemma-4-26b-a4b-it-mxfp4 with 1048 layers

rm -Rf final

ollama list

NAME                                                     ID              SIZE     MODIFIED           

gemma-4-26b-a4b-it-mxfp4:latest                          2d1b607d3ef8    14 GB    About a minute ago

ollama --verbose run gemma-4-26b-a4b-it-mxfp4:latest 

Error: 500 Internal Server Error: mlx runner failed: Error: unsupported architecture: Gemma4ForConditionalGeneration (exit: exit status 1)
Originally created by @toughcoding on GitHub (Apr 8, 2026). Original GitHub issue: https://github.com/ollama/ollama/issues/15436 Gemma 26B in mlx not supported yet ``` hf download mlx-community/gemma-4-26b-a4b-it-mxfp4 cd ~/.cache/huggingface/hub/models--mlx-community--gemma-4-26b-a4b-it-mxfp4 cp -rL snapshots/4d7ba9cbe85182e0b6882dfe72fc2fc6ea2b4afb final echo "FROM final" > Modelfile ollama create --experimental gemma-4-26b-a4b-it-mxfp4 importing safetensors model  importing safetensors model  importing model-00001-of-00003.safetensors (444 tensors)  importing model-00002-of-00003.safetensors (452 tensors)  importing model-00003-of-00003.safetensors (594 tensors)  importing config config.json  importing config generation_config.json  importing config processor_config.json  importing config tokenizer.json  importing config tokenizer_config.json  writing manifest for gemma-4-26b-a4b-it-mxfp4  successfully imported gemma-4-26b-a4b-it-mxfp4 with 1048 layers rm -Rf final ollama list NAME                                                     ID              SIZE     MODIFIED            gemma-4-26b-a4b-it-mxfp4:latest                          2d1b607d3ef8    14 GB    About a minute ago ollama --verbose run gemma-4-26b-a4b-it-mxfp4:latest  Error: 500 Internal Server Error: mlx runner failed: Error: unsupported architecture: Gemma4ForConditionalGeneration (exit: exit status 1) ```
GiteaMirror added the mlxmodel labels 2026-04-12 22:43:42 -05:00
GiteaMirror commented 2026-04-12 22:43:43 -05:00
Author
Owner
Copy Link

@rick-github commented on GitHub (Apr 8, 2026):

https://github.com/ollama/ollama/pull/15244

<!-- gh-comment-id:4210123750 --> @rick-github commented on GitHub (Apr 8, 2026): https://github.com/ollama/ollama/pull/15244
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
 python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
No Label mlx model
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#9865
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?