[GH-ISSUE #3864] can not start #2393

Closed
opened 2026-04-12 12:42:33 -05:00 by GiteaMirror · 2 comments
Owner

Originally created by @userandpass on GitHub (Apr 24, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/3864

Originally assigned to: @dhiltgen on GitHub.

What is the issue?

when I used 'CUDA_VISIBLE_DEVICES=0 ollama run qwen:7b', it starts normally.But I used 'sudo systemctl start ollama',it does not start properly

OS

Linux

GPU

Nvidia

CPU

No response

Ollama version

0.1.32

Originally created by @userandpass on GitHub (Apr 24, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/3864 Originally assigned to: @dhiltgen on GitHub. ### What is the issue? when I used 'CUDA_VISIBLE_DEVICES=0 ollama run qwen:7b', it starts normally.But I used 'sudo systemctl start ollama',it does not start properly ### OS Linux ### GPU Nvidia ### CPU _No response_ ### Ollama version 0.1.32
GiteaMirror added the bugneeds more info labels 2026-04-12 12:42:33 -05:00
Author
Owner

@dhiltgen commented on GitHub (Apr 24, 2024):

Ollama is a client-server architecture, and no inference is taking place in the client. That happens in the server. The environment variable CUDA_VISIBLE_DEVICES will only affect the server (ollama serve) , not the client (ollama run)

Can you share your server logs so we can see what the startup failure is?

<!-- gh-comment-id:2075337186 --> @dhiltgen commented on GitHub (Apr 24, 2024): Ollama is a client-server architecture, and no inference is taking place in the client. That happens in the server. The environment variable CUDA_VISIBLE_DEVICES will only affect the server (`ollama serve`) , not the client (`ollama run`) Can you share your server logs so we can see what the startup failure is?
Author
Owner

@dhiltgen commented on GitHub (May 4, 2024):

If you're still having trouble, please share you server log and I'll reopen the issue.

<!-- gh-comment-id:2094505035 --> @dhiltgen commented on GitHub (May 4, 2024): If you're still having trouble, please share you server log and I'll reopen the issue.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#2393