[GH-ISSUE #10227] Make GPU vendor support optional during installation on Windows #53221

Open
opened 2026-04-29 02:24:02 -05:00 by GiteaMirror · 0 comments
Owner

Originally created by @DimmaDont on GitHub (Apr 11, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/10227

This is the issue report for #10186.

Problem

Currently on Windows, the Ollama installer installs both CUDA and ROCm files by default. This is unnecessary for users using GPUs from only a single vendor, and increases installation time and disk usage.

Importance

This will improve installation and update times for users, and decrease disk usage.
In testing, ROCm-only installs took only 33% of the time a full install takes, and CUDA-only 75%.
For disk space, ROCm-only users will save ~3GB and CUDA-only ~1.8GB.

Usage

At installation time, users can deselect unwanted libraries. For example, NVIDIA-only users can skip installing ROCm files and AMD-only users CUDA files. Users running both can select both, and users running CPU-only can deselect both.

Testing

Testing can be performed by compiling and running the Inno Setup file in the pull request.

When installing, check:

  • Selection of neither/one/other/both GPU vendor options.
  • Only the selected vendors' support files are installed.

Documentation

docs/windows.md could be updated to document the Inno Setup /TYPE= option that can now be used.

Originally created by @DimmaDont on GitHub (Apr 11, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/10227 This is the issue report for #10186. ## Problem Currently on Windows, the Ollama installer installs both CUDA and ROCm files by default. This is unnecessary for users using GPUs from only a single vendor, and increases installation time and disk usage. ## Importance This will improve installation and update times for users, and decrease disk usage. In testing, ROCm-only installs took only **33%** of the time a full install takes, and CUDA-only 75%. For disk space, ROCm-only users will save ~3GB and CUDA-only ~1.8GB. ## Usage At installation time, users can deselect unwanted libraries. For example, NVIDIA-only users can skip installing ROCm files and AMD-only users CUDA files. Users running both can select both, and users running CPU-only can deselect both. ## Testing Testing can be performed by compiling and running the Inno Setup file in the pull request. When installing, check: * Selection of neither/one/other/both GPU vendor options. * Only the selected vendors' support files are installed. ## Documentation `docs/windows.md` could be updated to document the Inno Setup `/TYPE=` option that can now be used.
GiteaMirror added the feature request label 2026-04-29 02:24:02 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#53221