[GH-ISSUE #15149] qwen3.5 nvfp4 models say "this model requires macOS" #9699

Closed
opened 2026-04-12 22:34:48 -05:00 by GiteaMirror · 3 comments
Owner

Originally created by @duffyjp on GitHub (Mar 30, 2026).
Original GitHub issue: https://github.com/ollama/ollama/issues/15149

What is the issue?

$ ollama pull qwen3.5:9b-nvfp4
pulling manifest 
Error: pull model manifest: 412: this model requires macOS
$ ollama pull qwen3.5:35b-a3b-nvfp4
pulling manifest 
Error: pull model manifest: 412: this model requires macOS

I have a 5060 TI 16gb.

Relevant log output


OS

Linux

GPU

Nvidia

CPU

Intel

Ollama version

0.19.0

Originally created by @duffyjp on GitHub (Mar 30, 2026). Original GitHub issue: https://github.com/ollama/ollama/issues/15149 ### What is the issue? ```bash $ ollama pull qwen3.5:9b-nvfp4 pulling manifest Error: pull model manifest: 412: this model requires macOS ``` ```bash $ ollama pull qwen3.5:35b-a3b-nvfp4 pulling manifest Error: pull model manifest: 412: this model requires macOS ``` I have a 5060 TI 16gb. ### Relevant log output ```shell ``` ### OS Linux ### GPU Nvidia ### CPU Intel ### Ollama version 0.19.0
GiteaMirror added the bug label 2026-04-12 22:34:48 -05:00
Author
Owner

@rick-github commented on GitHub (Mar 30, 2026):

qwen3.5:9b-nvfp4 is an MLX model and requires the MLX backend to run, which is currently only supported on macOS.

<!-- gh-comment-id:4157778247 --> @rick-github commented on GitHub (Mar 30, 2026): qwen3.5:9b-nvfp4 is an MLX model and requires the MLX backend to run, which is currently only supported on macOS.
Author
Owner

@duffyjp commented on GitHub (Mar 30, 2026):

Oh. Well that's a confusing name then, but okay.

<!-- gh-comment-id:4157853586 --> @duffyjp commented on GitHub (Mar 30, 2026): Oh. Well that's a confusing name then, but okay.
Author
Owner

@swoldemichael commented on GitHub (Apr 8, 2026):

Unless this nvfp4 refers to something different from the fp4 precision support on the nvidia blackwell gpus, this is a misnomer. nvfp4 is a hardware-native provision. This indicates to me, Apple engineers pushed their software implementation of fp4 on their hardware and called it nvfp4. You should at least put a readme not to confuse people.

<!-- gh-comment-id:4203947214 --> @swoldemichael commented on GitHub (Apr 8, 2026): Unless this nvfp4 refers to something different from the fp4 precision support on the nvidia blackwell gpus, this is a misnomer. nvfp4 is a hardware-native provision. This indicates to me, Apple engineers pushed their software implementation of fp4 on their hardware and called it nvfp4. You should at least put a readme not to confuse people.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#9699