[GH-ISSUE #6141] Ollama stopped a available="", not loading #29595

Closed
opened 2026-04-22 08:36:07 -05:00 by GiteaMirror · 5 comments
Owner

Originally created by @rohithbojja on GitHub (Aug 2, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/6141

Originally assigned to: @dhiltgen on GitHub.

What is the issue?

time=2024-08-02T16:41:38.633+05:30 level=INFO source=images.go:781 msg="total blobs: 9"
time=2024-08-02T16:41:38.633+05:30 level=INFO source=images.go:788 msg="total unused blobs removed: 0"
time=2024-08-02T16:41:38.633+05:30 level=INFO source=routes.go:1156 msg="Listening on 127.0.0.1:11434 (version 0.3.2)"
time=2024-08-02T16:41:38.633+05:30 level=INFO source=payload.go:30 msg="extracting embedded files" dir=/tmp/ollama1292947772/runners
time=2024-08-02T16:41:43.479+05:30 level=INFO source=payload.go:44 msg="Dynamic LLM libraries [cpu cpu_avx cpu_avx2 cuda_v11 rocm_v60102]"
time=2024-08-02T16:41:43.479+05:30 level=INFO source=gpu.go:205 msg="looking for compatible GPUs"
time=2024-08-02T16:41:43.484+05:30 level=INFO source=gpu.go:346 msg="no compatible GPUs were discovered"
time=2024-08-02T16:41:43.484+05:30 level=INFO source=types.go:105 msg="inference compute" id=0 library=cpu compute="" driver=0.0 name="" total="31.4 GiB" available="27.4 GiB"

OS

No response

GPU

No response

CPU

No response

Ollama version

No response

Originally created by @rohithbojja on GitHub (Aug 2, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/6141 Originally assigned to: @dhiltgen on GitHub. ### What is the issue? time=2024-08-02T16:41:38.633+05:30 level=INFO source=images.go:781 msg="total blobs: 9" time=2024-08-02T16:41:38.633+05:30 level=INFO source=images.go:788 msg="total unused blobs removed: 0" time=2024-08-02T16:41:38.633+05:30 level=INFO source=routes.go:1156 msg="Listening on 127.0.0.1:11434 (version 0.3.2)" time=2024-08-02T16:41:38.633+05:30 level=INFO source=payload.go:30 msg="extracting embedded files" dir=/tmp/ollama1292947772/runners time=2024-08-02T16:41:43.479+05:30 level=INFO source=payload.go:44 msg="Dynamic LLM libraries [cpu cpu_avx cpu_avx2 cuda_v11 rocm_v60102]" time=2024-08-02T16:41:43.479+05:30 level=INFO source=gpu.go:205 msg="looking for compatible GPUs" time=2024-08-02T16:41:43.484+05:30 level=INFO source=gpu.go:346 msg="no compatible GPUs were discovered" time=2024-08-02T16:41:43.484+05:30 level=INFO source=types.go:105 msg="inference compute" id=0 library=cpu compute="" driver=0.0 name="" total="31.4 GiB" available="27.4 GiB" ### OS _No response_ ### GPU _No response_ ### CPU _No response_ ### Ollama version _No response_
GiteaMirror added the question label 2026-04-22 08:36:07 -05:00
Author
Owner

@rick-github commented on GitHub (Aug 2, 2024):

This looks normal for a CPU-only system. Have you tried running a model (ollama run llama3.1)?

<!-- gh-comment-id:2265379832 --> @rick-github commented on GitHub (Aug 2, 2024): This looks normal for a CPU-only system. Have you tried running a model (`ollama run llama3.1`)?
Author
Owner

@Siddharth-Latthe-07 commented on GitHub (Aug 2, 2024):

Here are some of possible causes for the above issue:-

  1. No Compatible GPUs:- Since no compatible GPUs were found, the system is falling back to CPU computation.
  2. Empty Compute Field:- The compute="" field being empty could indicate a configuration issue.
  3. Resource Availability

Solutions:-

  1. check the configurations of the system
  2. verify permissions and check the documnetation and logs..

Plz provide a little more about the issue
Hope this helps
Thanks

<!-- gh-comment-id:2265417223 --> @Siddharth-Latthe-07 commented on GitHub (Aug 2, 2024): Here are some of possible causes for the above issue:- 1. No Compatible GPUs:- Since no compatible GPUs were found, the system is falling back to CPU computation. 2. Empty Compute Field:- The compute="" field being empty could indicate a configuration issue. 3. Resource Availability Solutions:- 1. check the configurations of the system 2. verify permissions and check the documnetation and logs.. Plz provide a little more about the issue Hope this helps Thanks
Author
Owner

@dhiltgen commented on GitHub (Aug 2, 2024):

@rohithbojja as mentioned above, that looks like normal output from ollama serve if you ran it in a terminal. Ollama is a client-server architecture, and the server is ready to accept requests from clients. You didn't mention which OS you're on, but if you follow the https://github.com/ollama/ollama/blob/main/README.md#quickstart installation instructions, the server should be running in the background, and then you can use the client ollama run llama3.1 from your preferred terminal.

If there's something else going on, please elaborate and I'll reopen the issue.

<!-- gh-comment-id:2266140043 --> @dhiltgen commented on GitHub (Aug 2, 2024): @rohithbojja as mentioned above, that looks like normal output from `ollama serve` if you ran it in a terminal. Ollama is a client-server architecture, and the server is ready to accept requests from clients. You didn't mention which OS you're on, but if you follow the https://github.com/ollama/ollama/blob/main/README.md#quickstart installation instructions, the server should be running in the background, and then you can use the client `ollama run llama3.1` from your preferred terminal. If there's something else going on, please elaborate and I'll reopen the issue.
Author
Owner

@rohithbojja commented on GitHub (Aug 6, 2024):

im trying to run it in VM and send requests from local.
OLLAMA_HOST=x.x.x.x.x.x:yyy OLLAMA_KEEP_ALIVE="60m" ollama serve
but cant load models

<!-- gh-comment-id:2270483142 --> @rohithbojja commented on GitHub (Aug 6, 2024): im trying to run it in VM and send requests from local. OLLAMA_HOST=x.x.x.x.x.x:yyy OLLAMA_KEEP_ALIVE="60m" ollama serve but cant load models
Author
Owner

@rick-github commented on GitHub (Aug 6, 2024):

You need to add more information to aid in debugging. Server logs, a record of a terminal session, actual error messages, etc.

<!-- gh-comment-id:2270922918 --> @rick-github commented on GitHub (Aug 6, 2024): You need to add more information to aid in debugging. [Server logs](https://github.com/ollama/ollama/blob/main/docs/troubleshooting.md#how-to-troubleshoot-issues), a record of a terminal session, actual error messages, etc.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#29595