[GH-ISSUE #8302] no compatible GPUs were discovered #67371

Closed
opened 2026-05-04 10:07:35 -05:00 by GiteaMirror · 2 comments
Owner

Originally created by @fatebugs on GitHub (Jan 4, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/8302

What is the issue?

Due to the limitations of the latest version of MacOS, I am unable to use the ollama.app client and can only use Docker as the runtime tool for ollama. When running ollama in Docker launched on Macmini M4, it prompts that the GPU cannot be found. In this case, how should I solve this problem
image

OS

macOS, Docker

GPU

Apple

CPU

Apple

Ollama version

0.5.4-0-g2ddc32d-dirty

Originally created by @fatebugs on GitHub (Jan 4, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/8302 ### What is the issue? Due to the limitations of the latest version of MacOS, I am unable to use the ollama.app client and can only use Docker as the runtime tool for ollama. When running ollama in Docker launched on Macmini M4, it prompts that the GPU cannot be found. In this case, how should I solve this problem ![image](https://github.com/user-attachments/assets/37300446-13c5-4239-8fa4-3930bb869272) ### OS macOS, Docker ### GPU Apple ### CPU Apple ### Ollama version 0.5.4-0-g2ddc32d-dirty
GiteaMirror added the bug label 2026-05-04 10:07:35 -05:00
Author
Owner
<!-- gh-comment-id:2570591899 --> @rick-github commented on GitHub (Jan 4, 2025): https://chariotsolutions.com/blog/post/apple-silicon-gpus-docker-and-ollama-pick-two/
Author
Owner

@fatebugs commented on GitHub (Jan 4, 2025):

https://chariotsolutions.com/blog/post/apple-silicon-gpus-docker-and-ollama-pick-two/

That is to say, the current situation is that it is not possible to support the use of GPUs by Olama in Docker desktop? The main purpose is to expose the Olama port on MacOS, which requires disabling MacOS' SIP, otherwise I cannot access it through the API

<!-- gh-comment-id:2570792363 --> @fatebugs commented on GitHub (Jan 4, 2025): > https://chariotsolutions.com/blog/post/apple-silicon-gpus-docker-and-ollama-pick-two/ That is to say, the current situation is that it is not possible to support the use of GPUs by Olama in Docker desktop? The main purpose is to expose the Olama port on MacOS, which requires disabling MacOS' SIP, otherwise I cannot access it through the API
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#67371