[GH-ISSUE #3798] Can this library utilize Intel's UHD graphics cards? #64382

Closed
opened 2026-05-03 17:26:21 -05:00 by GiteaMirror · 2 comments
Owner

Originally created by @Meshwa428 on GitHub (Apr 21, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/3798

Originally assigned to: @dhiltgen on GitHub.

My question is that most of the models are supported/backed by cuda to run on NVIDIA's cards, but what about Intel?

Many machines (most probably consumer grade intel laptops) still have intel gpus (UHD cards) so will ollama add a support for them?

Or intel gpus are just too hard to be used?

Cause to run those big models like llama 2 7b is still slow on cpu, so utilizing uhd cards might make them a little faster than the cpu and might just reduce the latency

I mean like libraries like open vino can even use intel uhd cards

Originally created by @Meshwa428 on GitHub (Apr 21, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/3798 Originally assigned to: @dhiltgen on GitHub. My question is that most of the models are supported/backed by cuda to run on NVIDIA's cards, but what about Intel? Many machines (most probably consumer grade intel laptops) still have intel gpus (UHD cards) so will ollama add a support for them? Or intel gpus are just too hard to be used? Cause to run those big models like llama 2 7b is still slow on cpu, so utilizing uhd cards might make them a little faster than the cpu and might just reduce the latency I mean like libraries like open vino can even use intel uhd cards
GiteaMirror added the intelfeature request labels 2026-05-03 17:26:22 -05:00
Author
Owner

@dhiltgen commented on GitHub (Aug 9, 2024):

Intel integrated GPU support is tracked via #3113

<!-- gh-comment-id:2278527999 --> @dhiltgen commented on GitHub (Aug 9, 2024): Intel integrated GPU support is tracked via #3113
Author
Owner
<!-- gh-comment-id:2314062709 --> @ayttop commented on GitHub (Aug 28, 2024): https://github.com/intel-analytics/ipex-llm/blob/main/docs/mddocs/Quickstart/llama_cpp_quickstart.md
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#64382