[GH-ISSUE #3242] When I run the model my CPU usage is high but GPU usage is low #1999

Closed
opened 2026-04-12 12:11:53 -05:00 by GiteaMirror · 9 comments
Owner

Originally created by @wangshuai67 on GitHub (Mar 19, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/3242

Originally assigned to: @dhiltgen on GitHub.

What is the issue?

  1. This is the gpu information of docker container

image
image

  1. This is the gpu information of the host machine

image

image

What did you expect to see?

Is there any abnormality in the above information?

Steps to reproduce

No response

Are there any recent changes that introduced the issue?

No response

OS

Linux

Architecture

x86

Platform

Docker

Ollama version

0.1.27

GPU

Nvidia

GPU info

image

CPU

No response

Other software

No response

Originally created by @wangshuai67 on GitHub (Mar 19, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/3242 Originally assigned to: @dhiltgen on GitHub. ### What is the issue? 1. This is the gpu information of docker container ![image](https://github.com/ollama/ollama/assets/13214849/d3d81824-5854-4fcf-b9fd-83bfa0d1c4ec) ![image](https://github.com/ollama/ollama/assets/13214849/426ab93f-4b91-4dfd-b178-c9112e0b944f) 2. This is the gpu information of the host machine ![image](https://github.com/ollama/ollama/assets/13214849/f5a66995-dfd8-4d27-b019-225bc32a0485) ![image](https://github.com/ollama/ollama/assets/13214849/bfe74c83-6eef-4629-a75c-1b111238e377) ### What did you expect to see? Is there any abnormality in the above information? ### Steps to reproduce _No response_ ### Are there any recent changes that introduced the issue? _No response_ ### OS Linux ### Architecture x86 ### Platform Docker ### Ollama version 0.1.27 ### GPU Nvidia ### GPU info ![image](https://github.com/ollama/ollama/assets/13214849/f5a66995-dfd8-4d27-b019-225bc32a0485) ### CPU _No response_ ### Other software _No response_
GiteaMirror added the bugnvidia labels 2026-04-12 12:11:53 -05:00
Author
Owner

@Elghandour-eng commented on GitHub (Mar 19, 2024):

Same Issue With Me

<!-- gh-comment-id:2006869997 --> @Elghandour-eng commented on GitHub (Mar 19, 2024): Same Issue With Me
Author
Owner

@yasserkh2 commented on GitHub (Mar 19, 2024):

i have the same issue
Screenshot 2024-03-19 130738

<!-- gh-comment-id:2006874576 --> @yasserkh2 commented on GitHub (Mar 19, 2024): i have the same issue ![Screenshot 2024-03-19 130738](https://github.com/ollama/ollama/assets/125663999/e6a65303-9f7b-40da-9cfd-d4db0b81d3a3)
Author
Owner

@dhiltgen commented on GitHub (Mar 19, 2024):

@wangshuai67 can you share your server log?

<!-- gh-comment-id:2007261288 --> @dhiltgen commented on GitHub (Mar 19, 2024): @wangshuai67 can you share your server log?
Author
Owner

@VectorZhao commented on GitHub (Mar 20, 2024):

+1

<!-- gh-comment-id:2008485899 --> @VectorZhao commented on GitHub (Mar 20, 2024): +1
Author
Owner

@RamiKassouf commented on GitHub (Mar 21, 2024):

same issue

<!-- gh-comment-id:2012204482 --> @RamiKassouf commented on GitHub (Mar 21, 2024): same issue
Author
Owner

@xvbingbing commented on GitHub (Mar 27, 2024):

How can I use my GPU to run ollama on linux? Can someone give me some detailed instructions?

<!-- gh-comment-id:2022105039 --> @xvbingbing commented on GitHub (Mar 27, 2024): How can I use my GPU to run ollama on linux? Can someone give me some detailed instructions?
Author
Owner

@oldgithubman commented on GitHub (Mar 30, 2024):

+1 Where is this server log you speak of?

<!-- gh-comment-id:2027933831 --> @oldgithubman commented on GitHub (Mar 30, 2024): +1 Where is this server log you speak of?
Author
Owner

@dhiltgen commented on GitHub (Mar 31, 2024):

Check out https://github.com/ollama/ollama/blob/main/docs/troubleshooting.md for instructions on how to retrieve the server log, which varies by platform.

<!-- gh-comment-id:2028914416 --> @dhiltgen commented on GitHub (Mar 31, 2024): Check out https://github.com/ollama/ollama/blob/main/docs/troubleshooting.md for instructions on how to retrieve the server log, which varies by platform.
Author
Owner

@dhiltgen commented on GitHub (Apr 15, 2024):

If you're still having trouble, please share the server log and I'll re-open the issue.

<!-- gh-comment-id:2057947572 --> @dhiltgen commented on GitHub (Apr 15, 2024): If you're still having trouble, please share the server log and I'll re-open the issue.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#1999