github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-07-15 12:48:05 -05:00
Code Issues 16.9k Packages Projects Releases 122 Wiki Activity

[GH-ISSUE #4548] Error: [0] server cpu not listed in available servers map[] #2851

New Issue
Closed
opened 2026-04-12 13:11:49 -05:00 by GiteaMirror · 19 comments
GiteaMirror commented 2026-04-12 13:11:49 -05:00
Owner
Copy Link

Originally created by @ZivenLu on GitHub (May 21, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/4548

Originally assigned to: @dhiltgen on GitHub.

What is the issue?

I got the error message when I run the command: ollama run llama3. I use the windows OS and ollama service already up.
The error message:
C:\Users\xxx>ollama run llama3
Error: [0] server cpu not listed in available servers map[]

OS

Windows

GPU

Nvidia

CPU

Intel

Ollama version

0.1.38

Originally created by @ZivenLu on GitHub (May 21, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/4548 Originally assigned to: @dhiltgen on GitHub. ### What is the issue? I got the error message when I run the command: **ollama run llama3**. I use the windows OS and ollama service already up. The error message: **C:\Users\xxx>ollama run llama3 Error: [0] server cpu not listed in available servers map[]** ### OS Windows ### GPU Nvidia ### CPU Intel ### Ollama version 0.1.38
GiteaMirror added the bugwindows labels 2026-04-12 13:11:49 -05:00
GiteaMirror commented 2026-04-12 13:11:51 -05:00
Author
Owner
Copy Link

@ZivenLu commented on GitHub (May 21, 2024):

The below is the log from server.log:

time=2024-05-21T08:20:47.923+08:00 level=DEBUG source=gpu.go:122 msg="Detecting GPUs"
time=2024-05-21T08:20:47.923+08:00 level=DEBUG source=gpu.go:261 msg="Searching for GPU library" name=nvcuda.dll
time=2024-05-21T08:20:47.924+08:00 level=DEBUG source=gpu.go:280 msg="gpu library search" globs="[C:\\Users\\zlu\\AppData\\Local\\Programs\\Ollama\\nvcuda.dll* C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2\\bin\\nvcuda.dll* C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2\\libnvvp\\nvcuda.dll* D:\\Go\\bin\\nvcuda.dll* C:\\msys641\\nvcuda.dll* C:\\msys64\\usr\\bin1\\nvcuda.dll* C:\\msys64\\ucrt64\\bin1\\nvcuda.dll* C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\bin\\nvcuda.dll* C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\libnvvp\\nvcuda.dll* C:\\Program Files\\Common Files\\Oracle\\Java\\javapath\\nvcuda.dll* C:\\Program Files (x86)\\Common Files\\Oracle\\Java\\javapath\\nvcuda.dll* C:\\WINDOWS\\system32\\nvcuda.dll* C:\\WINDOWS\\nvcuda.dll* C:\\WINDOWS\\System32\\Wbem\\nvcuda.dll* C:\\WINDOWS\\System32\\WindowsPowerShell\\v1.0\\nvcuda.dll* C:\\WINDOWS\\System32\\OpenSSH\\nvcuda.dll* C:\\simulatorBB\\datahub\\usr\\local\\bin\\nvcuda.dll* C:\\Program Files\\Intel\\WiFi\\bin\\nvcuda.dll* C:\\Program Files\\Common Files\\Intel\\WirelessCommon\\nvcuda.dll* E:\\kns_resources\\Java_Tools\\apache-maven-3.5.2\\bin\\nvcuda.dll* E:\\kns_resources\\OracleDB_Tool\\instantclient_12_1\\nvcuda.dll* C:\\Graphviz2.38\\bin\\nvcuda.dll* E:\\kns_resources\\OpenSSL\\OpenSSL-Win64\\bin\\nvcuda.dll* C:\\Java\\jdk-11\\bin\\nvcuda.dll* C:\\PostgreSQL\\10\\bin\\nvcuda.dll* C:\\Program Files\\Microsoft Network Monitor 3\\nvcuda.dll* C:\\Users\\zlu\\.rustup\\nvcuda.dll* C:\\Users\\zlu\\.cargo\\nvcuda.dll* E:\\kns_resources\\Tool\\protoc-21.1-win64\\bin\\nvcuda.dll* C:\\Program Files\\dotnet\\nvcuda.dll* C:\\Python3119\\nvcuda.dll* C:\\Python3119\\Scripts\\nvcuda.dll* C:\\Program Files (x86)\\NVIDIA Corporation\\PhysX\\Common\\nvcuda.dll* C:\\Program Files\\NVIDIA Corporation\\Nsight Compute 2023.2.2\\nvcuda.dll* C:\\CMake\\bin\\nvcuda.dll* C:\\Program Files\\Microsoft Visual Studio\\2022\\Community\\VC\\Tools\\MSVC\\14.35.32215\\bin\\Hostx64\\x64\\nvcuda.dll* C:\\Users\\zlu\\.cargo\\bin\\nvcuda.dll* C:\\Users\\zlu\\.windows-build-tools\\python27\\nvcuda.dll* C:\\Program Files (x86)\\Common Files\\Oracle\\Java\\javapath\\nvcuda.dll* C:\\Windows\\system32\\nvcuda.dll* C:\\Windows\\nvcuda.dll* C:\\Windows\\System32\\Wbem\\nvcuda.dll* C:\\Windows\\System32\\WindowsPowerShell\\v1.0\\nvcuda.dll* C:\\Windows\\System32\\OpenSSH\\nvcuda.dll* C:\\simulatorBB\\datahub\\usr\\local\\bin\\nvcuda.dll* C:\\Program Files\\Intel\\WiFi\\bin\\nvcuda.dll* C:\\Program Files\\Common Files\\Intel\\WirelessCommon\\nvcuda.dll* E:\\kns_resources\\Java_Tools\\apache-maven-3.5.2\\bin\\nvcuda.dll* E:\\kns_resources\\C_CPLUSPLUS\\mingw64\\bin\\nvcuda.dll* D:\\kns_working\\GitSource\\BBMES_Project\\SUPPLIER_LINKAGE\\bin\\nvcuda.dll* E:\\kns_resources\\OracleDB_Tool\\instantclient_12_1\\nvcuda.dll* C:\\Program Files (x86)\\Windows Kits\\10\\Windows Performance Toolkit\\nvcuda.dll* C:\\Graphviz2.38\\bin\\nvcuda.dll* E:\\kns_resources\\OpenSSL\\OpenSSL-Win64\\bin\\nvcuda.dll* E:\\kns_resources\\Nodejs_Tool\\node-v10.16.3-win-x64\\nvcuda.dll* C:\\Java\\jdk1.8.0_211\\bin\\nvcuda.dll* C:\\PostgreSQL\\10\\bin\\nvcuda.dll* C:\\Program Files\\Microsoft Network Monitor 3\\nvcuda.dll* C:\\Users\\zlu\\AppData\\Local\\Microsoft\\WindowsApps\\nvcuda.dll* C:\\Users\\zlu\\go\\bin\\nvcuda.dll* C:\\MicrosoftVSCode\\bin\\nvcuda.dll* C:\\Users\\zlu\\go\\bin\\nvcuda.dll* C:\\Users\\zlu\\AppData\\Local\\Microsoft\\WindowsApps\\nvcuda.dll* E:\\kns_resources\\Flutter\\tools\\flutter_windows_3.10.0-stable\\flutter\\bin\\nvcuda.dll* C:\\Users\\zlu\\.dotnet\\tools\\nvcuda.dll* C:\\Program Files (x86)\\Git\\bin\\nvcuda.dll* C:\\Python3119\\nvcuda.dll* C:\\Python3119\\Scripts\\nvcuda.dll* E:\\kns_resources\\Nodejs_Tool\\node-v22.0.0-win-x64\\nvcuda.dll* D:\\Go\\bin\\nvcuda.dll* C:\\WINDOWS\\system32\\nvcuda.dll* C:\\Users\\zlu\\AppData\\Local\\Programs\\Ollama\\nvcuda.dll* c:\\windows\\system*\\nvcuda.dll]"
time=2024-05-21T08:20:48.145+08:00 level=DEBUG source=gpu.go:285 msg="skipping PhysX cuda library path" path="C:\\Program Files (x86)\\NVIDIA Corporation\\PhysX\\Common\\nvcuda.dll*"
time=2024-05-21T08:20:48.383+08:00 level=DEBUG source=gpu.go:313 msg="discovered GPU libraries" paths="[C:\\WINDOWS\\system32\\nvcuda.dll C:\\Windows\\system32\\nvcuda.dll]"
time=2024-05-21T08:20:48.386+08:00 level=DEBUG source=gpu.go:127 msg="detected GPUs" count=1 library=C:\WINDOWS\system32\nvcuda.dll
time=2024-05-21T08:20:48.386+08:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2"
time=2024-05-21T08:20:48.710+08:00 level=DEBUG source=amd_windows.go:31 msg="unable to load amdhip64.dll: The specified module could not be found."
time=2024-05-21T08:20:48.712+08:00 level=DEBUG source=gguf.go:57 msg="model = &llm.gguf{containerGGUF:(*llm.containerGGUF)(0xc000fe8540), kv:llm.KV{}, tensors:[]*llm.Tensor(nil), parameters:0x0}"
time=2024-05-21T08:21:04.251+08:00 level=DEBUG source=sched.go:153 msg="loading first model" model=D:\ollama_models\blobs\sha256-00e1317cbf74d901080d7100f57580ba8dd8de57203072dc6f668324ba545f29
time=2024-05-21T08:21:04.251+08:00 level=DEBUG source=memory.go:44 msg=evaluating library=cuda gpu_count=1 available="3.3 GiB"
time=2024-05-21T08:21:04.253+08:00 level=INFO source=memory.go:133 msg="offload to gpu" layers.requested=-1 layers.real=17 memory.available="3.3 GiB" memory.required.full="5.0 GiB" memory.required.partial="3.3 GiB" memory.required.kv="256.0 MiB" memory.weights.total="4.1 GiB" memory.weights.repeating="3.7 GiB" memory.weights.nonrepeating="411.0 MiB" memory.graph.full="164.0 MiB" memory.graph.partial="677.5 MiB"
time=2024-05-21T08:21:04.253+08:00 level=DEBUG source=memory.go:44 msg=evaluating library=cuda gpu_count=1 available="3.3 GiB"
time=2024-05-21T08:21:04.254+08:00 level=INFO source=memory.go:133 msg="offload to gpu" layers.requested=-1 layers.real=17 memory.available="3.3 GiB" memory.required.full="5.0 GiB" memory.required.partial="3.3 GiB" memory.required.kv="256.0 MiB" memory.weights.total="4.1 GiB" memory.weights.repeating="3.7 GiB" memory.weights.nonrepeating="411.0 MiB" memory.graph.full="164.0 MiB" memory.graph.partial="677.5 MiB"
time=2024-05-21T08:21:04.254+08:00 level=DEBUG source=memory.go:44 msg=evaluating library=cuda gpu_count=1 available="3.3 GiB"
time=2024-05-21T08:21:04.256+08:00 level=INFO source=memory.go:133 msg="offload to gpu" layers.requested=-1 layers.real=17 memory.available="3.3 GiB" memory.required.full="5.0 GiB" memory.required.partial="3.3 GiB" memory.required.kv="256.0 MiB" memory.weights.total="4.1 GiB" memory.weights.repeating="3.7 GiB" memory.weights.nonrepeating="411.0 MiB" memory.graph.full="164.0 MiB" memory.graph.partial="677.5 MiB"
time=2024-05-21T08:21:04.261+08:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2"
time=2024-05-21T08:21:04.261+08:00 level=ERROR source=server.go:219 msg="server list inconsistent" error="[0] server cpu not listed in available servers map[]"
time=2024-05-21T08:21:04.261+08:00 level=ERROR source=server.go:361 msg="unable to load any llama server" error="[0] server cpu not listed in available servers map[]"
time=2024-05-21T08:21:04.261+08:00 level=INFO source=sched.go:318 msg="NewLlamaServer failed" model=D:\ollama_models\blobs\sha256-00e1317cbf74d901080d7100f57580ba8dd8de57203072dc6f668324ba545f29 error="[0] server cpu not listed in available servers map[]"
[
<!-- gh-comment-id:2121481259 --> @ZivenLu commented on GitHub (May 21, 2024): The below is the log from server.log: ``` time=2024-05-21T08:20:47.923+08:00 level=DEBUG source=gpu.go:122 msg="Detecting GPUs" time=2024-05-21T08:20:47.923+08:00 level=DEBUG source=gpu.go:261 msg="Searching for GPU library" name=nvcuda.dll time=2024-05-21T08:20:47.924+08:00 level=DEBUG source=gpu.go:280 msg="gpu library search" globs="[C:\\Users\\zlu\\AppData\\Local\\Programs\\Ollama\\nvcuda.dll* C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2\\bin\\nvcuda.dll* C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2\\libnvvp\\nvcuda.dll* D:\\Go\\bin\\nvcuda.dll* C:\\msys641\\nvcuda.dll* C:\\msys64\\usr\\bin1\\nvcuda.dll* C:\\msys64\\ucrt64\\bin1\\nvcuda.dll* C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\bin\\nvcuda.dll* C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.1\\libnvvp\\nvcuda.dll* C:\\Program Files\\Common Files\\Oracle\\Java\\javapath\\nvcuda.dll* C:\\Program Files (x86)\\Common Files\\Oracle\\Java\\javapath\\nvcuda.dll* C:\\WINDOWS\\system32\\nvcuda.dll* C:\\WINDOWS\\nvcuda.dll* C:\\WINDOWS\\System32\\Wbem\\nvcuda.dll* C:\\WINDOWS\\System32\\WindowsPowerShell\\v1.0\\nvcuda.dll* C:\\WINDOWS\\System32\\OpenSSH\\nvcuda.dll* C:\\simulatorBB\\datahub\\usr\\local\\bin\\nvcuda.dll* C:\\Program Files\\Intel\\WiFi\\bin\\nvcuda.dll* C:\\Program Files\\Common Files\\Intel\\WirelessCommon\\nvcuda.dll* E:\\kns_resources\\Java_Tools\\apache-maven-3.5.2\\bin\\nvcuda.dll* E:\\kns_resources\\OracleDB_Tool\\instantclient_12_1\\nvcuda.dll* C:\\Graphviz2.38\\bin\\nvcuda.dll* E:\\kns_resources\\OpenSSL\\OpenSSL-Win64\\bin\\nvcuda.dll* C:\\Java\\jdk-11\\bin\\nvcuda.dll* C:\\PostgreSQL\\10\\bin\\nvcuda.dll* C:\\Program Files\\Microsoft Network Monitor 3\\nvcuda.dll* C:\\Users\\zlu\\.rustup\\nvcuda.dll* C:\\Users\\zlu\\.cargo\\nvcuda.dll* E:\\kns_resources\\Tool\\protoc-21.1-win64\\bin\\nvcuda.dll* C:\\Program Files\\dotnet\\nvcuda.dll* C:\\Python3119\\nvcuda.dll* C:\\Python3119\\Scripts\\nvcuda.dll* C:\\Program Files (x86)\\NVIDIA Corporation\\PhysX\\Common\\nvcuda.dll* C:\\Program Files\\NVIDIA Corporation\\Nsight Compute 2023.2.2\\nvcuda.dll* C:\\CMake\\bin\\nvcuda.dll* C:\\Program Files\\Microsoft Visual Studio\\2022\\Community\\VC\\Tools\\MSVC\\14.35.32215\\bin\\Hostx64\\x64\\nvcuda.dll* C:\\Users\\zlu\\.cargo\\bin\\nvcuda.dll* C:\\Users\\zlu\\.windows-build-tools\\python27\\nvcuda.dll* C:\\Program Files (x86)\\Common Files\\Oracle\\Java\\javapath\\nvcuda.dll* C:\\Windows\\system32\\nvcuda.dll* C:\\Windows\\nvcuda.dll* C:\\Windows\\System32\\Wbem\\nvcuda.dll* C:\\Windows\\System32\\WindowsPowerShell\\v1.0\\nvcuda.dll* C:\\Windows\\System32\\OpenSSH\\nvcuda.dll* C:\\simulatorBB\\datahub\\usr\\local\\bin\\nvcuda.dll* C:\\Program Files\\Intel\\WiFi\\bin\\nvcuda.dll* C:\\Program Files\\Common Files\\Intel\\WirelessCommon\\nvcuda.dll* E:\\kns_resources\\Java_Tools\\apache-maven-3.5.2\\bin\\nvcuda.dll* E:\\kns_resources\\C_CPLUSPLUS\\mingw64\\bin\\nvcuda.dll* D:\\kns_working\\GitSource\\BBMES_Project\\SUPPLIER_LINKAGE\\bin\\nvcuda.dll* E:\\kns_resources\\OracleDB_Tool\\instantclient_12_1\\nvcuda.dll* C:\\Program Files (x86)\\Windows Kits\\10\\Windows Performance Toolkit\\nvcuda.dll* C:\\Graphviz2.38\\bin\\nvcuda.dll* E:\\kns_resources\\OpenSSL\\OpenSSL-Win64\\bin\\nvcuda.dll* E:\\kns_resources\\Nodejs_Tool\\node-v10.16.3-win-x64\\nvcuda.dll* C:\\Java\\jdk1.8.0_211\\bin\\nvcuda.dll* C:\\PostgreSQL\\10\\bin\\nvcuda.dll* C:\\Program Files\\Microsoft Network Monitor 3\\nvcuda.dll* C:\\Users\\zlu\\AppData\\Local\\Microsoft\\WindowsApps\\nvcuda.dll* C:\\Users\\zlu\\go\\bin\\nvcuda.dll* C:\\MicrosoftVSCode\\bin\\nvcuda.dll* C:\\Users\\zlu\\go\\bin\\nvcuda.dll* C:\\Users\\zlu\\AppData\\Local\\Microsoft\\WindowsApps\\nvcuda.dll* E:\\kns_resources\\Flutter\\tools\\flutter_windows_3.10.0-stable\\flutter\\bin\\nvcuda.dll* C:\\Users\\zlu\\.dotnet\\tools\\nvcuda.dll* C:\\Program Files (x86)\\Git\\bin\\nvcuda.dll* C:\\Python3119\\nvcuda.dll* C:\\Python3119\\Scripts\\nvcuda.dll* E:\\kns_resources\\Nodejs_Tool\\node-v22.0.0-win-x64\\nvcuda.dll* D:\\Go\\bin\\nvcuda.dll* C:\\WINDOWS\\system32\\nvcuda.dll* C:\\Users\\zlu\\AppData\\Local\\Programs\\Ollama\\nvcuda.dll* c:\\windows\\system*\\nvcuda.dll]" time=2024-05-21T08:20:48.145+08:00 level=DEBUG source=gpu.go:285 msg="skipping PhysX cuda library path" path="C:\\Program Files (x86)\\NVIDIA Corporation\\PhysX\\Common\\nvcuda.dll*" time=2024-05-21T08:20:48.383+08:00 level=DEBUG source=gpu.go:313 msg="discovered GPU libraries" paths="[C:\\WINDOWS\\system32\\nvcuda.dll C:\\Windows\\system32\\nvcuda.dll]" time=2024-05-21T08:20:48.386+08:00 level=DEBUG source=gpu.go:127 msg="detected GPUs" count=1 library=C:\WINDOWS\system32\nvcuda.dll time=2024-05-21T08:20:48.386+08:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2" time=2024-05-21T08:20:48.710+08:00 level=DEBUG source=amd_windows.go:31 msg="unable to load amdhip64.dll: The specified module could not be found." time=2024-05-21T08:20:48.712+08:00 level=DEBUG source=gguf.go:57 msg="model = &llm.gguf{containerGGUF:(*llm.containerGGUF)(0xc000fe8540), kv:llm.KV{}, tensors:[]*llm.Tensor(nil), parameters:0x0}" time=2024-05-21T08:21:04.251+08:00 level=DEBUG source=sched.go:153 msg="loading first model" model=D:\ollama_models\blobs\sha256-00e1317cbf74d901080d7100f57580ba8dd8de57203072dc6f668324ba545f29 time=2024-05-21T08:21:04.251+08:00 level=DEBUG source=memory.go:44 msg=evaluating library=cuda gpu_count=1 available="3.3 GiB" time=2024-05-21T08:21:04.253+08:00 level=INFO source=memory.go:133 msg="offload to gpu" layers.requested=-1 layers.real=17 memory.available="3.3 GiB" memory.required.full="5.0 GiB" memory.required.partial="3.3 GiB" memory.required.kv="256.0 MiB" memory.weights.total="4.1 GiB" memory.weights.repeating="3.7 GiB" memory.weights.nonrepeating="411.0 MiB" memory.graph.full="164.0 MiB" memory.graph.partial="677.5 MiB" time=2024-05-21T08:21:04.253+08:00 level=DEBUG source=memory.go:44 msg=evaluating library=cuda gpu_count=1 available="3.3 GiB" time=2024-05-21T08:21:04.254+08:00 level=INFO source=memory.go:133 msg="offload to gpu" layers.requested=-1 layers.real=17 memory.available="3.3 GiB" memory.required.full="5.0 GiB" memory.required.partial="3.3 GiB" memory.required.kv="256.0 MiB" memory.weights.total="4.1 GiB" memory.weights.repeating="3.7 GiB" memory.weights.nonrepeating="411.0 MiB" memory.graph.full="164.0 MiB" memory.graph.partial="677.5 MiB" time=2024-05-21T08:21:04.254+08:00 level=DEBUG source=memory.go:44 msg=evaluating library=cuda gpu_count=1 available="3.3 GiB" time=2024-05-21T08:21:04.256+08:00 level=INFO source=memory.go:133 msg="offload to gpu" layers.requested=-1 layers.real=17 memory.available="3.3 GiB" memory.required.full="5.0 GiB" memory.required.partial="3.3 GiB" memory.required.kv="256.0 MiB" memory.weights.total="4.1 GiB" memory.weights.repeating="3.7 GiB" memory.weights.nonrepeating="411.0 MiB" memory.graph.full="164.0 MiB" memory.graph.partial="677.5 MiB" time=2024-05-21T08:21:04.261+08:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2" time=2024-05-21T08:21:04.261+08:00 level=ERROR source=server.go:219 msg="server list inconsistent" error="[0] server cpu not listed in available servers map[]" time=2024-05-21T08:21:04.261+08:00 level=ERROR source=server.go:361 msg="unable to load any llama server" error="[0] server cpu not listed in available servers map[]" time=2024-05-21T08:21:04.261+08:00 level=INFO source=sched.go:318 msg="NewLlamaServer failed" model=D:\ollama_models\blobs\sha256-00e1317cbf74d901080d7100f57580ba8dd8de57203072dc6f668324ba545f29 error="[0] server cpu not listed in available servers map[]" [ ```
GiteaMirror commented 2026-04-12 13:11:51 -05:00
Author
Owner
Copy Link

@dhiltgen commented on GitHub (May 21, 2024):

Can you explain how you installed Ollama? Did you use the OllamaSetup.exe installer, or the zip file, or did you build from source?

<!-- gh-comment-id:2123247302 --> @dhiltgen commented on GitHub (May 21, 2024): Can you explain how you installed Ollama? Did you use the OllamaSetup.exe installer, or the zip file, or did you build from source?
GiteaMirror commented 2026-04-12 13:11:52 -05:00
Author
Owner
Copy Link

@ZivenLu commented on GitHub (May 22, 2024):

We use OllamaSetup.exe to install ollama. The installation is ok and it is running. Only when we try to run the model, we got the error. We also try to build the code but we didn't build it successfully on Windows OS.

<!-- gh-comment-id:2123630719 --> @ZivenLu commented on GitHub (May 22, 2024): We use OllamaSetup.exe to install ollama. The installation is ok and it is running. Only when we try to run the model, we got the error. We also try to build the code but we didn't build it successfully on Windows OS.
GiteaMirror commented 2026-04-12 13:11:52 -05:00
Author
Owner
Copy Link

@charly-chrtx commented on GitHub (May 22, 2024):

I got the same issue on macOS after the last update.

<!-- gh-comment-id:2125066198 --> @charly-chrtx commented on GitHub (May 22, 2024): I got the same issue on macOS after the last update.
GiteaMirror commented 2026-04-12 13:11:52 -05:00
Author
Owner
Copy Link

@qzhou711 commented on GitHub (May 22, 2024):

I got the same issue. I have installed 7 models in my ollama. But it can only show 3 of them.
Before that, I just did 'export OLLAMA_MODELS=/usr/share/ollama/.ollama/'.

<!-- gh-comment-id:2125392461 --> @qzhou711 commented on GitHub (May 22, 2024): I got the same issue. I have installed 7 models in my ollama. But it can only show 3 of them. Before that, I just did 'export OLLAMA_MODELS=/usr/share/ollama/.ollama/'.
GiteaMirror commented 2026-04-12 13:11:53 -05:00
Author
Owner
Copy Link

@dhiltgen commented on GitHub (May 22, 2024):

@ZivenLu it looks like you shared a subset of the server log. Did you see anything like this when the server started?

time=2024-05-22T14:37:19.153-07:00 level=INFO source=routes.go:1074 msg="Listening on 127.0.0.1:11434 (version 0.0.0)"
time=2024-05-22T14:37:19.154-07:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=C:\Users\danie\code\ollama\dist\windows-amd64\ollama_runners\cpu
time=2024-05-22T14:37:19.154-07:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=C:\Users\danie\code\ollama\dist\windows-amd64\ollama_runners\cpu_avx
time=2024-05-22T14:37:19.154-07:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=C:\Users\danie\code\ollama\dist\windows-amd64\ollama_runners\cpu_avx2
time=2024-05-22T14:37:19.154-07:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=C:\Users\danie\code\ollama\dist\windows-amd64\ollama_runners\cuda_v11.3
time=2024-05-22T14:37:19.154-07:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=C:\Users\danie\code\ollama\dist\windows-amd64\ollama_runners\rocm_v5.7
time=2024-05-22T14:37:19.154-07:00 level=INFO source=payload.go:44 msg="Dynamic LLM libraries [cpu cpu_avx cpu_avx2 cuda_v11.3 rocm_v5.7]"
time=2024-05-22T14:37:19.154-07:00 level=DEBUG source=payload.go:45 msg="Override detection logic by setting OLLAMA_LLM_LIBRARY"

From what you describe, I'm expecting it may look something like Listening on 127.0.0.1:11434 (version 0.1.38) followed by Dynamic LLM libraries []

Can you also share the output of (get-command ollama).source - if you installed in a non-standard location, there might be a bug in the way we resolve the paths to the dynamic llm libraries.

<!-- gh-comment-id:2125802987 --> @dhiltgen commented on GitHub (May 22, 2024): @ZivenLu it looks like you shared a subset of the server log. Did you see anything like this when the server started? ``` time=2024-05-22T14:37:19.153-07:00 level=INFO source=routes.go:1074 msg="Listening on 127.0.0.1:11434 (version 0.0.0)" time=2024-05-22T14:37:19.154-07:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=C:\Users\danie\code\ollama\dist\windows-amd64\ollama_runners\cpu time=2024-05-22T14:37:19.154-07:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=C:\Users\danie\code\ollama\dist\windows-amd64\ollama_runners\cpu_avx time=2024-05-22T14:37:19.154-07:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=C:\Users\danie\code\ollama\dist\windows-amd64\ollama_runners\cpu_avx2 time=2024-05-22T14:37:19.154-07:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=C:\Users\danie\code\ollama\dist\windows-amd64\ollama_runners\cuda_v11.3 time=2024-05-22T14:37:19.154-07:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=C:\Users\danie\code\ollama\dist\windows-amd64\ollama_runners\rocm_v5.7 time=2024-05-22T14:37:19.154-07:00 level=INFO source=payload.go:44 msg="Dynamic LLM libraries [cpu cpu_avx cpu_avx2 cuda_v11.3 rocm_v5.7]" time=2024-05-22T14:37:19.154-07:00 level=DEBUG source=payload.go:45 msg="Override detection logic by setting OLLAMA_LLM_LIBRARY" ``` From what you describe, I'm expecting it may look something like `Listening on 127.0.0.1:11434 (version 0.1.38)` followed by `Dynamic LLM libraries []` Can you also share the output of `(get-command ollama).source` - if you installed in a non-standard location, there might be a bug in the way we resolve the paths to the dynamic llm libraries.
GiteaMirror commented 2026-04-12 13:11:53 -05:00
Author
Owner
Copy Link

@ZivenLu commented on GitHub (May 23, 2024):

  • My log show: Dynamic LLM libraries [] . It is empty.

  • What does it mean "(get-command ollama).source"? What is the command?

  • I copied the complete log after I restart and run the model:

2024/05/23 11:12:34 routes.go:1008: INFO server config env="map[OLLAMA_DEBUG:true OLLAMA_LLM_LIBRARY: OLLAMA_MAX_LOADED_MODELS:1 OLLAMA_MAX_QUEUE:512 OLLAMA_MAX_VRAM:0 OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:1 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:] OLLAMA_RUNNERS_DIR:D:\ollama_runners OLLAMA_TMPDIR:D:\OLLAMA_TMPDIR]"
time=2024-05-23T11:12:34.586+08:00 level=INFO source=images.go:704 msg="total blobs: 15"
time=2024-05-23T11:12:34.602+08:00 level=INFO source=images.go:711 msg="total unused blobs removed: 0"
time=2024-05-23T11:12:34.608+08:00 level=INFO source=routes.go:1054 msg="Listening on 127.0.0.1:11434 (version 0.1.38)"
time=2024-05-23T11:12:34.609+08:00 level=INFO source=payload.go:44 msg="Dynamic LLM libraries []"
time=2024-05-23T11:12:34.609+08:00 level=DEBUG source=payload.go:45 msg="Override detection logic by setting OLLAMA_LLM_LIBRARY"
time=2024-05-23T11:12:34.609+08:00 level=DEBUG source=sched.go:90 msg="starting llm scheduler"
time=2024-05-23T11:12:34.609+08:00 level=DEBUG source=gpu.go:122 msg="Detecting GPUs"
time=2024-05-23T11:12:34.609+08:00 level=DEBUG source=gpu.go:261 msg="Searching for GPU library" name=nvcuda.dll
time=2024-05-23T11:12:34.609+08:00 level=DEBUG source=gpu.go:280 msg="gpu library search" globs="[C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\bin\nvcuda.dll C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\libnvvp\nvcuda.dll* D:\Go\bin\nvcuda.dll* D:\msys64\nvcuda.dll* D:\msys64\usr\bin\nvcuda.dll* D:\msys64\ucrt64\bin\nvcuda.dll* C:\Program Files\Common Files\Oracle\Java\javapath\nvcuda.dll* C:\Program Files (x86)\Common Files\Oracle\Java\javapath\nvcuda.dll* C:\WINDOWS\system32\nvcuda.dll* C:\WINDOWS\nvcuda.dll* C:\WINDOWS\System32\Wbem\nvcuda.dll* C:\WINDOWS\System32\WindowsPowerShell\v1.0\nvcuda.dll* C:\WINDOWS\System32\OpenSSH\nvcuda.dll* C:\simulatorBB\datahub\usr\local\bin\nvcuda.dll* C:\Program Files\Intel\WiFi\bin\nvcuda.dll* C:\Program Files\Common Files\Intel\WirelessCommon\nvcuda.dll* E:\kns_resources\Java_Tools\apache-maven-3.5.2\bin\nvcuda.dll* E:\kns_resources\OracleDB_Tool\instantclient_12_1\nvcuda.dll* C:\Graphviz2.38\bin\nvcuda.dll* E:\kns_resources\OpenSSL\OpenSSL-Win64\bin\nvcuda.dll* C:\Java\jdk-11\bin\nvcuda.dll* C:\PostgreSQL\10\bin\nvcuda.dll* C:\Program Files\Microsoft Network Monitor 3\nvcuda.dll* C:\Users\zlu\.rustup\nvcuda.dll* C:\Users\zlu\.cargo\nvcuda.dll* E:\kns_resources\Tool\protoc-21.1-win64\bin\nvcuda.dll* C:\Program Files\dotnet\nvcuda.dll* C:\Python3119\nvcuda.dll* C:\Python3119\Scripts\nvcuda.dll* C:\Program Files (x86)\NVIDIA Corporation\PhysX\Common\nvcuda.dll* C:\Program Files\NVIDIA Corporation\Nsight Compute 2023.2.2\nvcuda.dll* C:\CMake\bin\nvcuda.dll* C:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.35.32215\bin\Hostx64\x64\nvcuda.dll* C:\Users\zlu\.cargo\bin\nvcuda.dll* C:\Users\zlu\.windows-build-tools\python27\nvcuda.dll* C:\Program Files (x86)\Common Files\Oracle\Java\javapath\nvcuda.dll* C:\Windows\system32\nvcuda.dll* C:\Windows\nvcuda.dll* C:\Windows\System32\Wbem\nvcuda.dll* C:\Windows\System32\WindowsPowerShell\v1.0\nvcuda.dll* C:\Windows\System32\OpenSSH\nvcuda.dll* C:\simulatorBB\datahub\usr\local\bin\nvcuda.dll* C:\Program Files\Intel\WiFi\bin\nvcuda.dll* C:\Program Files\Common Files\Intel\WirelessCommon\nvcuda.dll* E:\kns_resources\Java_Tools\apache-maven-3.5.2\bin\nvcuda.dll* D:\kns_working\GitSource\BBMES_Project\SUPPLIER_LINKAGE\bin\nvcuda.dll* E:\kns_resources\OracleDB_Tool\instantclient_12_1\nvcuda.dll* C:\Program Files (x86)\Windows Kits\10\Windows Performance Toolkit\nvcuda.dll* C:\Graphviz2.38\bin\nvcuda.dll* E:\kns_resources\OpenSSL\OpenSSL-Win64\bin\nvcuda.dll* E:\kns_resources\Nodejs_Tool\node-v10.16.3-win-x64\nvcuda.dll* C:\Java\jdk1.8.0_211\bin\nvcuda.dll* C:\PostgreSQL\10\bin\nvcuda.dll* C:\Program Files\Microsoft Network Monitor 3\nvcuda.dll* C:\Users\zlu\AppData\Local\Microsoft\WindowsApps\nvcuda.dll* C:\Users\zlu\go\bin\nvcuda.dll* C:\MicrosoftVSCode\bin\nvcuda.dll* C:\Users\zlu\go\bin\nvcuda.dll* C:\Users\zlu\AppData\Local\Microsoft\WindowsApps\nvcuda.dll* E:\kns_resources\Flutter\tools\flutter_windows_3.10.0-stable\flutter\bin\nvcuda.dll* C:\Users\zlu\.dotnet\tools\nvcuda.dll* C:\Program Files (x86)\Git\bin\nvcuda.dll* C:\Python3119\nvcuda.dll* C:\Python3119\Scripts\nvcuda.dll* E:\kns_resources\Nodejs_Tool\node-v22.0.0-win-x64\nvcuda.dll* D:\Go\bin\nvcuda.dll* C:\Users\zlu\AppData\Local\Programs\Ollama\nvcuda.dll* C:\Users\zlu\AppData\Local\Programs\Ollama\nvcuda.dll* c:\windows\system*\nvcuda.dll]"
time=2024-05-23T11:12:34.656+08:00 level=DEBUG source=gpu.go:285 msg="skipping PhysX cuda library path" path="C:\Program Files (x86)\NVIDIA Corporation\PhysX\Common\nvcuda.dll*"
time=2024-05-23T11:12:34.701+08:00 level=DEBUG source=gpu.go:313 msg="discovered GPU libraries" paths="[C:\WINDOWS\system32\nvcuda.dll C:\Windows\system32\nvcuda.dll]"
time=2024-05-23T11:12:34.795+08:00 level=DEBUG source=gpu.go:127 msg="detected GPUs" count=1 library=C:\WINDOWS\system32\nvcuda.dll
time=2024-05-23T11:12:34.796+08:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2"
time=2024-05-23T11:12:34.988+08:00 level=DEBUG source=amd_windows.go:31 msg="unable to load amdhip64.dll: The specified module could not be found."
time=2024-05-23T11:12:34.988+08:00 level=INFO source=types.go:71 msg="inference compute" id=GPU-bfe27b97-ae2a-af15-ea51-795dc276e561 library=cuda compute=6.1 driver=12.2 name="Quadro P1000" total="4.0 GiB" available="3.3 GiB"
[GIN] 2024/05/23 - 11:13:12 | 200 | 0s | 127.0.0.1 | HEAD "/"
[GIN] 2024/05/23 - 11:13:12 | 200 | 9.7851ms | 127.0.0.1 | POST "/api/show"
[GIN] 2024/05/23 - 11:13:12 | 200 | 3.3578ms | 127.0.0.1 | POST "/api/show"
time=2024-05-23T11:13:12.424+08:00 level=DEBUG source=gpu.go:122 msg="Detecting GPUs"
time=2024-05-23T11:13:12.424+08:00 level=DEBUG source=gpu.go:261 msg="Searching for GPU library" name=nvcuda.dll
time=2024-05-23T11:13:12.424+08:00 level=DEBUG source=gpu.go:280 msg="gpu library search" globs="[C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\bin\nvcuda.dll* C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.2\libnvvp\nvcuda.dll* D:\Go\bin\nvcuda.dll* D:\msys64\nvcuda.dll* D:\msys64\usr\bin\nvcuda.dll* D:\msys64\ucrt64\bin\nvcuda.dll* C:\Program Files\Common Files\Oracle\Java\javapath\nvcuda.dll* C:\Program Files (x86)\Common Files\Oracle\Java\javapath\nvcuda.dll* C:\WINDOWS\system32\nvcuda.dll* C:\WINDOWS\nvcuda.dll* C:\WINDOWS\System32\Wbem\nvcuda.dll* C:\WINDOWS\System32\WindowsPowerShell\v1.0\nvcuda.dll* C:\WINDOWS\System32\OpenSSH\nvcuda.dll* C:\simulatorBB\datahub\usr\local\bin\nvcuda.dll* C:\Program Files\Intel\WiFi\bin\nvcuda.dll* C:\Program Files\Common Files\Intel\WirelessCommon\nvcuda.dll* E:\kns_resources\Java_Tools\apache-maven-3.5.2\bin\nvcuda.dll* E:\kns_resources\OracleDB_Tool\instantclient_12_1\nvcuda.dll* C:\Graphviz2.38\bin\nvcuda.dll* E:\kns_resources\OpenSSL\OpenSSL-Win64\bin\nvcuda.dll* C:\Java\jdk-11\bin\nvcuda.dll* C:\PostgreSQL\10\bin\nvcuda.dll* C:\Program Files\Microsoft Network Monitor 3\nvcuda.dll* C:\Users\zlu\.rustup\nvcuda.dll* C:\Users\zlu\.cargo\nvcuda.dll* E:\kns_resources\Tool\protoc-21.1-win64\bin\nvcuda.dll* C:\Program Files\dotnet\nvcuda.dll* C:\Python3119\nvcuda.dll* C:\Python3119\Scripts\nvcuda.dll* C:\Program Files (x86)\NVIDIA Corporation\PhysX\Common\nvcuda.dll* C:\Program Files\NVIDIA Corporation\Nsight Compute 2023.2.2\nvcuda.dll* C:\CMake\bin\nvcuda.dll* C:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.35.32215\bin\Hostx64\x64\nvcuda.dll* C:\Users\zlu\.cargo\bin\nvcuda.dll* C:\Users\zlu\.windows-build-tools\python27\nvcuda.dll* C:\Program Files (x86)\Common Files\Oracle\Java\javapath\nvcuda.dll* C:\Windows\system32\nvcuda.dll* C:\Windows\nvcuda.dll* C:\Windows\System32\Wbem\nvcuda.dll* C:\Windows\System32\WindowsPowerShell\v1.0\nvcuda.dll* C:\Windows\System32\OpenSSH\nvcuda.dll* C:\simulatorBB\datahub\usr\local\bin\nvcuda.dll* C:\Program Files\Intel\WiFi\bin\nvcuda.dll* C:\Program Files\Common Files\Intel\WirelessCommon\nvcuda.dll* E:\kns_resources\Java_Tools\apache-maven-3.5.2\bin\nvcuda.dll* D:\kns_working\GitSource\BBMES_Project\SUPPLIER_LINKAGE\bin\nvcuda.dll* E:\kns_resources\OracleDB_Tool\instantclient_12_1\nvcuda.dll* C:\Program Files (x86)\Windows Kits\10\Windows Performance Toolkit\nvcuda.dll* C:\Graphviz2.38\bin\nvcuda.dll* E:\kns_resources\OpenSSL\OpenSSL-Win64\bin\nvcuda.dll* E:\kns_resources\Nodejs_Tool\node-v10.16.3-win-x64\nvcuda.dll* C:\Java\jdk1.8.0_211\bin\nvcuda.dll* C:\PostgreSQL\10\bin\nvcuda.dll* C:\Program Files\Microsoft Network Monitor 3\nvcuda.dll* C:\Users\zlu\AppData\Local\Microsoft\WindowsApps\nvcuda.dll* C:\Users\zlu\go\bin\nvcuda.dll* C:\MicrosoftVSCode\bin\nvcuda.dll* C:\Users\zlu\go\bin\nvcuda.dll* C:\Users\zlu\AppData\Local\Microsoft\WindowsApps\nvcuda.dll* E:\kns_resources\Flutter\tools\flutter_windows_3.10.0-stable\flutter\bin\nvcuda.dll* C:\Users\zlu\.dotnet\tools\nvcuda.dll* C:\Program Files (x86)\Git\bin\nvcuda.dll* C:\Python3119\nvcuda.dll* C:\Python3119\Scripts\nvcuda.dll* E:\kns_resources\Nodejs_Tool\node-v22.0.0-win-x64\nvcuda.dll* D:\Go\bin\nvcuda.dll* C:\Users\zlu\AppData\Local\Programs\Ollama\nvcuda.dll* C:\Users\zlu\AppData\Local\Programs\Ollama\nvcuda.dll* c:\windows\system*\nvcuda.dll]"
time=2024-05-23T11:13:12.453+08:00 level=DEBUG source=gpu.go:285 msg="skipping PhysX cuda library path" path="C:\Program Files (x86)\NVIDIA Corporation\PhysX\Common\nvcuda.dll*"
time=2024-05-23T11:13:12.483+08:00 level=DEBUG source=gpu.go:313 msg="discovered GPU libraries" paths="[C:\WINDOWS\system32\nvcuda.dll C:\Windows\system32\nvcuda.dll]"
time=2024-05-23T11:13:12.483+08:00 level=DEBUG source=gpu.go:127 msg="detected GPUs" count=1 library=C:\WINDOWS\system32\nvcuda.dll
time=2024-05-23T11:13:12.483+08:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2"
time=2024-05-23T11:13:12.572+08:00 level=DEBUG source=amd_windows.go:31 msg="unable to load amdhip64.dll: The specified module could not be found."
time=2024-05-23T11:13:12.574+08:00 level=DEBUG source=gguf.go:57 msg="model = &llm.gguf{containerGGUF:(*llm.containerGGUF)(0xc00032ef40), kv:llm.KV{}, tensors:[]*llm.Tensor(nil), parameters:0x0}"
time=2024-05-23T11:13:15.271+08:00 level=DEBUG source=sched.go:153 msg="loading first model" model=D:\ollama_models\blobs\sha256-00e1317cbf74d901080d7100f57580ba8dd8de57203072dc6f668324ba545f29
time=2024-05-23T11:13:15.271+08:00 level=DEBUG source=memory.go:44 msg=evaluating library=cuda gpu_count=1 available="3.3 GiB"
time=2024-05-23T11:13:15.272+08:00 level=INFO source=memory.go:133 msg="offload to gpu" layers.requested=-1 layers.real=17 memory.available="3.3 GiB" memory.required.full="5.0 GiB" memory.required.partial="3.3 GiB" memory.required.kv="256.0 MiB" memory.weights.total="4.1 GiB" memory.weights.repeating="3.7 GiB" memory.weights.nonrepeating="411.0 MiB" memory.graph.full="164.0 MiB" memory.graph.partial="677.5 MiB"
time=2024-05-23T11:13:15.272+08:00 level=DEBUG source=memory.go:44 msg=evaluating library=cuda gpu_count=1 available="3.3 GiB"
time=2024-05-23T11:13:15.272+08:00 level=INFO source=memory.go:133 msg="offload to gpu" layers.requested=-1 layers.real=17 memory.available="3.3 GiB" memory.required.full="5.0 GiB" memory.required.partial="3.3 GiB" memory.required.kv="256.0 MiB" memory.weights.total="4.1 GiB" memory.weights.repeating="3.7 GiB" memory.weights.nonrepeating="411.0 MiB" memory.graph.full="164.0 MiB" memory.graph.partial="677.5 MiB"
time=2024-05-23T11:13:15.272+08:00 level=DEBUG source=memory.go:44 msg=evaluating library=cuda gpu_count=1 available="3.3 GiB"
time=2024-05-23T11:13:15.273+08:00 level=INFO source=memory.go:133 msg="offload to gpu" layers.requested=-1 layers.real=17 memory.available="3.3 GiB" memory.required.full="5.0 GiB" memory.required.partial="3.3 GiB" memory.required.kv="256.0 MiB" memory.weights.total="4.1 GiB" memory.weights.repeating="3.7 GiB" memory.weights.nonrepeating="411.0 MiB" memory.graph.full="164.0 MiB" memory.graph.partial="677.5 MiB"
time=2024-05-23T11:13:15.273+08:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2"
time=2024-05-23T11:13:15.274+08:00 level=ERROR source=server.go:219 msg="server list inconsistent" error="[0] server cpu not listed in available servers map[]"
time=2024-05-23T11:13:15.274+08:00 level=ERROR source=server.go:361 msg="unable to load any llama server" error="[0] server cpu not listed in available servers map[]"
time=2024-05-23T11:13:15.274+08:00 level=INFO source=sched.go:318 msg="NewLlamaServer failed" model=D:\ollama_models\blobs\sha256-00e1317cbf74d901080d7100f57580ba8dd8de57203072dc6f668324ba545f29 error="[0] server cpu not listed in available servers map[]"
[GIN] 2024/05/23 - 11:13:15 | 500 | 2.8466349s | 127.0.0.1 | POST "/api/chat"

<!-- gh-comment-id:2126155122 --> @ZivenLu commented on GitHub (May 23, 2024): - My log show: **Dynamic LLM libraries []** . It is empty. - What does it mean "(get-command ollama).source"? What is the command? - I copied the complete log after I restart and run the model: 2024/05/23 11:12:34 routes.go:1008: INFO server config env="map[OLLAMA_DEBUG:true OLLAMA_LLM_LIBRARY: OLLAMA_MAX_LOADED_MODELS:1 OLLAMA_MAX_QUEUE:512 OLLAMA_MAX_VRAM:0 OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:1 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:*] OLLAMA_RUNNERS_DIR:D:\\ollama_runners OLLAMA_TMPDIR:D:\\OLLAMA_TMPDIR]" time=2024-05-23T11:12:34.586+08:00 level=INFO source=images.go:704 msg="total blobs: 15" time=2024-05-23T11:12:34.602+08:00 level=INFO source=images.go:711 msg="total unused blobs removed: 0" **time=2024-05-23T11:12:34.608+08:00 level=INFO source=routes.go:1054 msg="Listening on 127.0.0.1:11434 (version 0.1.38)"** **time=2024-05-23T11:12:34.609+08:00 level=INFO source=payload.go:44 msg="Dynamic LLM libraries []"** time=2024-05-23T11:12:34.609+08:00 level=DEBUG source=payload.go:45 msg="Override detection logic by setting OLLAMA_LLM_LIBRARY" time=2024-05-23T11:12:34.609+08:00 level=DEBUG source=sched.go:90 msg="starting llm scheduler" time=2024-05-23T11:12:34.609+08:00 level=DEBUG source=gpu.go:122 msg="Detecting GPUs" time=2024-05-23T11:12:34.609+08:00 level=DEBUG source=gpu.go:261 msg="Searching for GPU library" name=nvcuda.dll time=2024-05-23T11:12:34.609+08:00 level=DEBUG source=gpu.go:280 msg="gpu library search" globs="[C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2\\bin\\nvcuda.dll* C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2\\libnvvp\\nvcuda.dll* D:\\Go\\bin\\nvcuda.dll* D:\\msys64\\nvcuda.dll* D:\\msys64\\usr\\bin\\nvcuda.dll* D:\\msys64\\ucrt64\\bin\\nvcuda.dll* C:\\Program Files\\Common Files\\Oracle\\Java\\javapath\\nvcuda.dll* C:\\Program Files (x86)\\Common Files\\Oracle\\Java\\javapath\\nvcuda.dll* C:\\WINDOWS\\system32\\nvcuda.dll* C:\\WINDOWS\\nvcuda.dll* C:\\WINDOWS\\System32\\Wbem\\nvcuda.dll* C:\\WINDOWS\\System32\\WindowsPowerShell\\v1.0\\nvcuda.dll* C:\\WINDOWS\\System32\\OpenSSH\\nvcuda.dll* C:\\simulatorBB\\datahub\\usr\\local\\bin\\nvcuda.dll* C:\\Program Files\\Intel\\WiFi\\bin\\nvcuda.dll* C:\\Program Files\\Common Files\\Intel\\WirelessCommon\\nvcuda.dll* E:\\kns_resources\\Java_Tools\\apache-maven-3.5.2\\bin\\nvcuda.dll* E:\\kns_resources\\OracleDB_Tool\\instantclient_12_1\\nvcuda.dll* C:\\Graphviz2.38\\bin\\nvcuda.dll* E:\\kns_resources\\OpenSSL\\OpenSSL-Win64\\bin\\nvcuda.dll* C:\\Java\\jdk-11\\bin\\nvcuda.dll* C:\\PostgreSQL\\10\\bin\\nvcuda.dll* C:\\Program Files\\Microsoft Network Monitor 3\\nvcuda.dll* C:\\Users\\zlu\\.rustup\\nvcuda.dll* C:\\Users\\zlu\\.cargo\\nvcuda.dll* E:\\kns_resources\\Tool\\protoc-21.1-win64\\bin\\nvcuda.dll* C:\\Program Files\\dotnet\\nvcuda.dll* C:\\Python3119\\nvcuda.dll* C:\\Python3119\\Scripts\\nvcuda.dll* C:\\Program Files (x86)\\NVIDIA Corporation\\PhysX\\Common\\nvcuda.dll* C:\\Program Files\\NVIDIA Corporation\\Nsight Compute 2023.2.2\\nvcuda.dll* C:\\CMake\\bin\\nvcuda.dll* C:\\Program Files\\Microsoft Visual Studio\\2022\\Community\\VC\\Tools\\MSVC\\14.35.32215\\bin\\Hostx64\\x64\\nvcuda.dll* C:\\Users\\zlu\\.cargo\\bin\\nvcuda.dll* C:\\Users\\zlu\\.windows-build-tools\\python27\\nvcuda.dll* C:\\Program Files (x86)\\Common Files\\Oracle\\Java\\javapath\\nvcuda.dll* C:\\Windows\\system32\\nvcuda.dll* C:\\Windows\\nvcuda.dll* C:\\Windows\\System32\\Wbem\\nvcuda.dll* C:\\Windows\\System32\\WindowsPowerShell\\v1.0\\nvcuda.dll* C:\\Windows\\System32\\OpenSSH\\nvcuda.dll* C:\\simulatorBB\\datahub\\usr\\local\\bin\\nvcuda.dll* C:\\Program Files\\Intel\\WiFi\\bin\\nvcuda.dll* C:\\Program Files\\Common Files\\Intel\\WirelessCommon\\nvcuda.dll* E:\\kns_resources\\Java_Tools\\apache-maven-3.5.2\\bin\\nvcuda.dll* D:\\kns_working\\GitSource\\BBMES_Project\\SUPPLIER_LINKAGE\\bin\\nvcuda.dll* E:\\kns_resources\\OracleDB_Tool\\instantclient_12_1\\nvcuda.dll* C:\\Program Files (x86)\\Windows Kits\\10\\Windows Performance Toolkit\\nvcuda.dll* C:\\Graphviz2.38\\bin\\nvcuda.dll* E:\\kns_resources\\OpenSSL\\OpenSSL-Win64\\bin\\nvcuda.dll* E:\\kns_resources\\Nodejs_Tool\\node-v10.16.3-win-x64\\nvcuda.dll* C:\\Java\\jdk1.8.0_211\\bin\\nvcuda.dll* C:\\PostgreSQL\\10\\bin\\nvcuda.dll* C:\\Program Files\\Microsoft Network Monitor 3\\nvcuda.dll* C:\\Users\\zlu\\AppData\\Local\\Microsoft\\WindowsApps\\nvcuda.dll* C:\\Users\\zlu\\go\\bin\\nvcuda.dll* C:\\MicrosoftVSCode\\bin\\nvcuda.dll* C:\\Users\\zlu\\go\\bin\\nvcuda.dll* C:\\Users\\zlu\\AppData\\Local\\Microsoft\\WindowsApps\\nvcuda.dll* E:\\kns_resources\\Flutter\\tools\\flutter_windows_3.10.0-stable\\flutter\\bin\\nvcuda.dll* C:\\Users\\zlu\\.dotnet\\tools\\nvcuda.dll* C:\\Program Files (x86)\\Git\\bin\\nvcuda.dll* C:\\Python3119\\nvcuda.dll* C:\\Python3119\\Scripts\\nvcuda.dll* E:\\kns_resources\\Nodejs_Tool\\node-v22.0.0-win-x64\\nvcuda.dll* D:\\Go\\bin\\nvcuda.dll* C:\\Users\\zlu\\AppData\\Local\\Programs\\Ollama\\nvcuda.dll* C:\\Users\\zlu\\AppData\\Local\\Programs\\Ollama\\nvcuda.dll* c:\\windows\\system*\\nvcuda.dll]" time=2024-05-23T11:12:34.656+08:00 level=DEBUG source=gpu.go:285 msg="skipping PhysX cuda library path" path="C:\\Program Files (x86)\\NVIDIA Corporation\\PhysX\\Common\\nvcuda.dll*" time=2024-05-23T11:12:34.701+08:00 level=DEBUG source=gpu.go:313 msg="discovered GPU libraries" paths="[C:\\WINDOWS\\system32\\nvcuda.dll C:\\Windows\\system32\\nvcuda.dll]" time=2024-05-23T11:12:34.795+08:00 level=DEBUG source=gpu.go:127 msg="detected GPUs" count=1 library=C:\WINDOWS\system32\nvcuda.dll time=2024-05-23T11:12:34.796+08:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2" time=2024-05-23T11:12:34.988+08:00 level=DEBUG source=amd_windows.go:31 msg="unable to load amdhip64.dll: The specified module could not be found." time=2024-05-23T11:12:34.988+08:00 level=INFO source=types.go:71 msg="inference compute" id=GPU-bfe27b97-ae2a-af15-ea51-795dc276e561 library=cuda compute=6.1 driver=12.2 name="Quadro P1000" total="4.0 GiB" available="3.3 GiB" [GIN] 2024/05/23 - 11:13:12 | 200 | 0s | 127.0.0.1 | HEAD "/" [GIN] 2024/05/23 - 11:13:12 | 200 | 9.7851ms | 127.0.0.1 | POST "/api/show" [GIN] 2024/05/23 - 11:13:12 | 200 | 3.3578ms | 127.0.0.1 | POST "/api/show" time=2024-05-23T11:13:12.424+08:00 level=DEBUG source=gpu.go:122 msg="Detecting GPUs" time=2024-05-23T11:13:12.424+08:00 level=DEBUG source=gpu.go:261 msg="Searching for GPU library" name=nvcuda.dll time=2024-05-23T11:13:12.424+08:00 level=DEBUG source=gpu.go:280 msg="gpu library search" globs="[C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2\\bin\\nvcuda.dll* C:\\Program Files\\NVIDIA GPU Computing Toolkit\\CUDA\\v12.2\\libnvvp\\nvcuda.dll* D:\\Go\\bin\\nvcuda.dll* D:\\msys64\\nvcuda.dll* D:\\msys64\\usr\\bin\\nvcuda.dll* D:\\msys64\\ucrt64\\bin\\nvcuda.dll* C:\\Program Files\\Common Files\\Oracle\\Java\\javapath\\nvcuda.dll* C:\\Program Files (x86)\\Common Files\\Oracle\\Java\\javapath\\nvcuda.dll* C:\\WINDOWS\\system32\\nvcuda.dll* C:\\WINDOWS\\nvcuda.dll* C:\\WINDOWS\\System32\\Wbem\\nvcuda.dll* C:\\WINDOWS\\System32\\WindowsPowerShell\\v1.0\\nvcuda.dll* C:\\WINDOWS\\System32\\OpenSSH\\nvcuda.dll* C:\\simulatorBB\\datahub\\usr\\local\\bin\\nvcuda.dll* C:\\Program Files\\Intel\\WiFi\\bin\\nvcuda.dll* C:\\Program Files\\Common Files\\Intel\\WirelessCommon\\nvcuda.dll* E:\\kns_resources\\Java_Tools\\apache-maven-3.5.2\\bin\\nvcuda.dll* E:\\kns_resources\\OracleDB_Tool\\instantclient_12_1\\nvcuda.dll* C:\\Graphviz2.38\\bin\\nvcuda.dll* E:\\kns_resources\\OpenSSL\\OpenSSL-Win64\\bin\\nvcuda.dll* C:\\Java\\jdk-11\\bin\\nvcuda.dll* C:\\PostgreSQL\\10\\bin\\nvcuda.dll* C:\\Program Files\\Microsoft Network Monitor 3\\nvcuda.dll* C:\\Users\\zlu\\.rustup\\nvcuda.dll* C:\\Users\\zlu\\.cargo\\nvcuda.dll* E:\\kns_resources\\Tool\\protoc-21.1-win64\\bin\\nvcuda.dll* C:\\Program Files\\dotnet\\nvcuda.dll* C:\\Python3119\\nvcuda.dll* C:\\Python3119\\Scripts\\nvcuda.dll* C:\\Program Files (x86)\\NVIDIA Corporation\\PhysX\\Common\\nvcuda.dll* C:\\Program Files\\NVIDIA Corporation\\Nsight Compute 2023.2.2\\nvcuda.dll* C:\\CMake\\bin\\nvcuda.dll* C:\\Program Files\\Microsoft Visual Studio\\2022\\Community\\VC\\Tools\\MSVC\\14.35.32215\\bin\\Hostx64\\x64\\nvcuda.dll* C:\\Users\\zlu\\.cargo\\bin\\nvcuda.dll* C:\\Users\\zlu\\.windows-build-tools\\python27\\nvcuda.dll* C:\\Program Files (x86)\\Common Files\\Oracle\\Java\\javapath\\nvcuda.dll* C:\\Windows\\system32\\nvcuda.dll* C:\\Windows\\nvcuda.dll* C:\\Windows\\System32\\Wbem\\nvcuda.dll* C:\\Windows\\System32\\WindowsPowerShell\\v1.0\\nvcuda.dll* C:\\Windows\\System32\\OpenSSH\\nvcuda.dll* C:\\simulatorBB\\datahub\\usr\\local\\bin\\nvcuda.dll* C:\\Program Files\\Intel\\WiFi\\bin\\nvcuda.dll* C:\\Program Files\\Common Files\\Intel\\WirelessCommon\\nvcuda.dll* E:\\kns_resources\\Java_Tools\\apache-maven-3.5.2\\bin\\nvcuda.dll* D:\\kns_working\\GitSource\\BBMES_Project\\SUPPLIER_LINKAGE\\bin\\nvcuda.dll* E:\\kns_resources\\OracleDB_Tool\\instantclient_12_1\\nvcuda.dll* C:\\Program Files (x86)\\Windows Kits\\10\\Windows Performance Toolkit\\nvcuda.dll* C:\\Graphviz2.38\\bin\\nvcuda.dll* E:\\kns_resources\\OpenSSL\\OpenSSL-Win64\\bin\\nvcuda.dll* E:\\kns_resources\\Nodejs_Tool\\node-v10.16.3-win-x64\\nvcuda.dll* C:\\Java\\jdk1.8.0_211\\bin\\nvcuda.dll* C:\\PostgreSQL\\10\\bin\\nvcuda.dll* C:\\Program Files\\Microsoft Network Monitor 3\\nvcuda.dll* C:\\Users\\zlu\\AppData\\Local\\Microsoft\\WindowsApps\\nvcuda.dll* C:\\Users\\zlu\\go\\bin\\nvcuda.dll* C:\\MicrosoftVSCode\\bin\\nvcuda.dll* C:\\Users\\zlu\\go\\bin\\nvcuda.dll* C:\\Users\\zlu\\AppData\\Local\\Microsoft\\WindowsApps\\nvcuda.dll* E:\\kns_resources\\Flutter\\tools\\flutter_windows_3.10.0-stable\\flutter\\bin\\nvcuda.dll* C:\\Users\\zlu\\.dotnet\\tools\\nvcuda.dll* C:\\Program Files (x86)\\Git\\bin\\nvcuda.dll* C:\\Python3119\\nvcuda.dll* C:\\Python3119\\Scripts\\nvcuda.dll* E:\\kns_resources\\Nodejs_Tool\\node-v22.0.0-win-x64\\nvcuda.dll* D:\\Go\\bin\\nvcuda.dll* C:\\Users\\zlu\\AppData\\Local\\Programs\\Ollama\\nvcuda.dll* C:\\Users\\zlu\\AppData\\Local\\Programs\\Ollama\\nvcuda.dll* c:\\windows\\system*\\nvcuda.dll]" time=2024-05-23T11:13:12.453+08:00 level=DEBUG source=gpu.go:285 msg="skipping PhysX cuda library path" path="C:\\Program Files (x86)\\NVIDIA Corporation\\PhysX\\Common\\nvcuda.dll*" time=2024-05-23T11:13:12.483+08:00 level=DEBUG source=gpu.go:313 msg="discovered GPU libraries" paths="[C:\\WINDOWS\\system32\\nvcuda.dll C:\\Windows\\system32\\nvcuda.dll]" time=2024-05-23T11:13:12.483+08:00 level=DEBUG source=gpu.go:127 msg="detected GPUs" count=1 library=C:\WINDOWS\system32\nvcuda.dll time=2024-05-23T11:13:12.483+08:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2" time=2024-05-23T11:13:12.572+08:00 level=DEBUG source=amd_windows.go:31 msg="unable to load amdhip64.dll: The specified module could not be found." time=2024-05-23T11:13:12.574+08:00 level=DEBUG source=gguf.go:57 msg="model = &llm.gguf{containerGGUF:(*llm.containerGGUF)(0xc00032ef40), kv:llm.KV{}, tensors:[]*llm.Tensor(nil), parameters:0x0}" time=2024-05-23T11:13:15.271+08:00 level=DEBUG source=sched.go:153 msg="loading first model" model=D:\ollama_models\blobs\sha256-00e1317cbf74d901080d7100f57580ba8dd8de57203072dc6f668324ba545f29 time=2024-05-23T11:13:15.271+08:00 level=DEBUG source=memory.go:44 msg=evaluating library=cuda gpu_count=1 available="3.3 GiB" time=2024-05-23T11:13:15.272+08:00 level=INFO source=memory.go:133 msg="offload to gpu" layers.requested=-1 layers.real=17 memory.available="3.3 GiB" memory.required.full="5.0 GiB" memory.required.partial="3.3 GiB" memory.required.kv="256.0 MiB" memory.weights.total="4.1 GiB" memory.weights.repeating="3.7 GiB" memory.weights.nonrepeating="411.0 MiB" memory.graph.full="164.0 MiB" memory.graph.partial="677.5 MiB" time=2024-05-23T11:13:15.272+08:00 level=DEBUG source=memory.go:44 msg=evaluating library=cuda gpu_count=1 available="3.3 GiB" time=2024-05-23T11:13:15.272+08:00 level=INFO source=memory.go:133 msg="offload to gpu" layers.requested=-1 layers.real=17 memory.available="3.3 GiB" memory.required.full="5.0 GiB" memory.required.partial="3.3 GiB" memory.required.kv="256.0 MiB" memory.weights.total="4.1 GiB" memory.weights.repeating="3.7 GiB" memory.weights.nonrepeating="411.0 MiB" memory.graph.full="164.0 MiB" memory.graph.partial="677.5 MiB" time=2024-05-23T11:13:15.272+08:00 level=DEBUG source=memory.go:44 msg=evaluating library=cuda gpu_count=1 available="3.3 GiB" time=2024-05-23T11:13:15.273+08:00 level=INFO source=memory.go:133 msg="offload to gpu" layers.requested=-1 layers.real=17 memory.available="3.3 GiB" memory.required.full="5.0 GiB" memory.required.partial="3.3 GiB" memory.required.kv="256.0 MiB" memory.weights.total="4.1 GiB" memory.weights.repeating="3.7 GiB" memory.weights.nonrepeating="411.0 MiB" memory.graph.full="164.0 MiB" memory.graph.partial="677.5 MiB" time=2024-05-23T11:13:15.273+08:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2" time=2024-05-23T11:13:15.274+08:00 level=ERROR source=server.go:219 msg="server list inconsistent" error="[0] server cpu not listed in available servers map[]" time=2024-05-23T11:13:15.274+08:00 level=ERROR source=server.go:361 msg="unable to load any llama server" error="[0] server cpu not listed in available servers map[]" time=2024-05-23T11:13:15.274+08:00 level=INFO source=sched.go:318 msg="NewLlamaServer failed" model=D:\ollama_models\blobs\sha256-00e1317cbf74d901080d7100f57580ba8dd8de57203072dc6f668324ba545f29 error="[0] server cpu not listed in available servers map[]" [GIN] 2024/05/23 - 11:13:15 | 500 | 2.8466349s | 127.0.0.1 | POST "/api/chat"
GiteaMirror commented 2026-04-12 13:11:53 -05:00
Author
Owner
Copy Link

@ZivenLu commented on GitHub (May 23, 2024):

I configured the wrong environment variable: OLLAMA_RUNNERS_DIR. Now I remove this environment variable:OLLAMA_RUNNERS_DIR. It can works well. Thanks a lot!
time=2024-05-23T12:04:14.766+08:00 level=INFO source=routes.go:1054 msg="Listening on 127.0.0.1:11434 (version 0.1.38)"
time=2024-05-23T12:04:14.766+08:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=C:\Users\zlu\AppData\Local\Programs\Ollama\ollama_runners\cpu
time=2024-05-23T12:04:14.766+08:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=C:\Users\zlu\AppData\Local\Programs\Ollama\ollama_runners\cpu_avx
time=2024-05-23T12:04:14.766+08:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=C:\Users\zlu\AppData\Local\Programs\Ollama\ollama_runners\cpu_avx2
time=2024-05-23T12:04:14.766+08:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=C:\Users\zlu\AppData\Local\Programs\Ollama\ollama_runners\cuda_v11.3
time=2024-05-23T12:04:14.767+08:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=C:\Users\zlu\AppData\Local\Programs\Ollama\ollama_runners\rocm_v5.7
time=2024-05-23T12:04:14.767+08:00 level=INFO source=payload.go:44 msg="Dynamic LLM libraries [cuda_v11.3 rocm_v5.7 cpu cpu_avx cpu_avx2]"

<!-- gh-comment-id:2126191459 --> @ZivenLu commented on GitHub (May 23, 2024): I configured the wrong environment variable: OLLAMA_RUNNERS_DIR. Now I remove this environment variable:OLLAMA_RUNNERS_DIR. It can works well. Thanks a lot! time=2024-05-23T12:04:14.766+08:00 level=INFO source=routes.go:1054 msg="Listening on 127.0.0.1:11434 (version 0.1.38)" time=2024-05-23T12:04:14.766+08:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=C:\Users\zlu\AppData\Local\Programs\Ollama\ollama_runners\cpu time=2024-05-23T12:04:14.766+08:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=C:\Users\zlu\AppData\Local\Programs\Ollama\ollama_runners\cpu_avx time=2024-05-23T12:04:14.766+08:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=C:\Users\zlu\AppData\Local\Programs\Ollama\ollama_runners\cpu_avx2 time=2024-05-23T12:04:14.766+08:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=C:\Users\zlu\AppData\Local\Programs\Ollama\ollama_runners\cuda_v11.3 time=2024-05-23T12:04:14.767+08:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=C:\Users\zlu\AppData\Local\Programs\Ollama\ollama_runners\rocm_v5.7 time=2024-05-23T12:04:14.767+08:00 level=INFO source=payload.go:44 msg=**"Dynamic LLM libraries [cuda_v11.3 rocm_v5.7 cpu cpu_avx cpu_avx2]"**
GiteaMirror commented 2026-04-12 13:11:54 -05:00
Author
Owner
Copy Link

@dhiltgen commented on GitHub (May 23, 2024):

That's great! I'm going to go ahead and close this one. For others that reported similar problems, please share your full server log which will include a line reporting any override variables you have set. Hopefully the root cause is the same, but if it looks like there's still a bug, I'll reopen the issue.

<!-- gh-comment-id:2127503598 --> @dhiltgen commented on GitHub (May 23, 2024): That's great! I'm going to go ahead and close this one. For others that reported similar problems, please share your full server log which will include a line reporting any override variables you have set. Hopefully the root cause is the same, but if it looks like there's still a bug, I'll reopen the issue.
GiteaMirror commented 2026-04-12 13:11:54 -05:00
Author
Owner
Copy Link

@some1ataplace commented on GitHub (May 28, 2024):

Getting this error on Debian. Not using a graphics card, only a CPU. Some models work and can be downloaded successfully, but others fail with this error.

Commands:

ollama run llama2:7b
Error: [0] server cpu not listed in available servers map[]
sudo journalctl -e -u ollama | less

Result:

May 28 01:42:01 debian ollama[520751]: time=2024-05-28T01:42:01.963-04:00 level=INFO source=memory.go:133 msg="offload to gpu" layers.requested=-1 layers.real=14 memory.available="2.3 GiB" memory.required.full="4.8 GiB" memory.required.partial="2.2 GiB" memory.required.kv="1.0 GiB" memory.weights.total="3.5 GiB" memory.weights.repeating="3.4 GiB" memory.weights.nonrepeating="102.6 MiB" memory.graph.full="164.0 MiB" memory.graph.partial="193.0 MiB"
May 28 01:42:01 debian ollama[520751]: time=2024-05-28T01:42:01.963-04:00 level=ERROR source=server.go:219 msg="server list inconsistent" error="[0] server cpu not listed in available servers map[]"
May 28 01:42:01 debian ollama[520751]: time=2024-05-28T01:42:01.963-04:00 level=ERROR source=server.go:361 msg="unable to load any llama server" error="[0] server cpu not listed in available servers map[]"
May 28 01:42:01 debian ollama[520751]: time=2024-05-28T01:42:01.963-04:00 level=INFO source=sched.go:318 msg="NewLlamaServer failed" model=/usr/share/ollama/.ollama/models/blobs/sha256-8934d96d3f08982e95922b2b7a2c626a1fe873d7c3b06e8e56d7bc0a1fef9246 error="[0] server cpu not listed in available servers map[]"

Seems like I am not the only one on Linux having this issue:
https://www.reddit.com/r/termux/comments/1cmjppk/how_can_i_fix_this_server_cpu_not_listed/

<!-- gh-comment-id:2134407435 --> @some1ataplace commented on GitHub (May 28, 2024): Getting this error on Debian. Not using a graphics card, only a CPU. Some models work and can be downloaded successfully, but others fail with this error. Commands: ``` ollama run llama2:7b Error: [0] server cpu not listed in available servers map[] sudo journalctl -e -u ollama | less ``` Result: May 28 01:42:01 debian ollama[520751]: time=2024-05-28T01:42:01.963-04:00 level=INFO source=memory.go:133 msg="offload to gpu" layers.requested=-1 layers.real=14 memory.available="2.3 GiB" memory.required.full="4.8 GiB" memory.required.partial="2.2 GiB" memory.required.kv="1.0 GiB" memory.weights.total="3.5 GiB" memory.weights.repeating="3.4 GiB" memory.weights.nonrepeating="102.6 MiB" memory.graph.full="164.0 MiB" memory.graph.partial="193.0 MiB" May 28 01:42:01 debian ollama[520751]: time=2024-05-28T01:42:01.963-04:00 level=ERROR source=server.go:219 msg="server list inconsistent" error="[0] server cpu not listed in available servers map[]" May 28 01:42:01 debian ollama[520751]: time=2024-05-28T01:42:01.963-04:00 level=ERROR source=server.go:361 msg="unable to load any llama server" error="[0] server cpu not listed in available servers map[]" May 28 01:42:01 debian ollama[520751]: time=2024-05-28T01:42:01.963-04:00 level=INFO source=sched.go:318 msg="NewLlamaServer failed" model=/usr/share/ollama/.ollama/models/blobs/sha256-8934d96d3f08982e95922b2b7a2c626a1fe873d7c3b06e8e56d7bc0a1fef9246 error="[0] server cpu not listed in available servers map[]" Seems like I am not the only one on Linux having this issue: https://www.reddit.com/r/termux/comments/1cmjppk/how_can_i_fix_this_server_cpu_not_listed/
GiteaMirror commented 2026-04-12 13:11:54 -05:00
Author
Owner
Copy Link

@dhiltgen commented on GitHub (May 28, 2024):

@some1ataplace can you share a more complete server log showing startup of the server up to this failure? Please set OLLAMA_DEBUG=1 as well to increase logging.

<!-- gh-comment-id:2135703671 --> @dhiltgen commented on GitHub (May 28, 2024): @some1ataplace can you share a more complete server log showing startup of the server up to this failure? Please set `OLLAMA_DEBUG=1` as well to increase logging.
GiteaMirror commented 2026-04-12 13:11:54 -05:00
Author
Owner
Copy Link

@some1ataplace commented on GitHub (May 28, 2024):

Interestingly enough, after restarting the ollama server it worked.

export OLLAMA_DEBUG="1"

sudo systemctl stop ollama
sudo service ollama restart
sudo systemctl start ollama
sudo service ollama status

ollama.service - Ollama Service
Loaded: loaded (/etc/systemd/system/ollama.service; enabled; preset: enabled)
Active: active (running) since Tue 2024-05-28 13:51:59 EDT; 1min 26s ago
Main PID: 545172 (ollama)
Tasks: 13 (limit: 18895)
Memory: 476.3M
CPU: 5.117s
CGroup: /system.slice/ollama.service
└─545172 /usr/local/bin/ollama serve

May 28 13:51:59 debian systemd[1]: Started ollama.service - Ollama Service.
May 28 13:51:59 debian ollama[545172]: 2024/05/28 13:51:59 routes.go:1008: INFO server config env="map[OLLAMA_DEBUG:false OLLAMA_LLM_LIBRARY: OLLAMA_MAX_LOADED_MODELS:1 OLLAMA_MAX_QUEUE:512 OLLAMA_MAX_VRAM:0 OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:1 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:*] OLLAMA_RUNNERS_DIR: OLLAMA_TMPDIR:]"
May 28 13:51:59 debian ollama[545172]: time=2024-05-28T13:51:59.319-04:00 level=INFO source=images.go:704 msg="total blobs: 0"
May 28 13:51:59 debian ollama[545172]: time=2024-05-28T13:51:59.319-04:00 level=INFO source=images.go:711 msg="total unused blobs removed: 0"
May 28 13:51:59 debian ollama[545172]: time=2024-05-28T13:51:59.319-04:00 level=INFO source=routes.go:1054 msg="Listening on 127.0.0.1:11434 (version 0.1.38)"
May 28 13:51:59 debian ollama[545172]: time=2024-05-28T13:51:59.319-04:00 level=INFO source=payload.go:30 msg="extracting embedded files" dir=/tmp/ollama259544789/runners
May 28 13:52:02 debian ollama[545172]: time=2024-05-28T13:52:02.099-04:00 level=INFO source=payload.go:44 msg="Dynamic LLM libraries [cpu cpu_avx cpu_avx2 cuda_v11 rocm_v60002]"
May 28 13:52:02 debian ollama[545172]: time=2024-05-28T13:52:02.114-04:00 level=INFO source=types.go:71 msg="inference compute" id=0 library=cpu compute="" driver=0.0 name="" total="15.5 GiB" available="5.5 GiB"

sudo journalctl -e -u ollama | less

May 28 13:51:28 debian systemd[1]: Stopping ollama.service - Ollama Service...
May 28 13:51:28 debian systemd[1]: ollama.service: Deactivated successfully.
May 28 13:51:28 debian systemd[1]: Stopped ollama.service - Ollama Service.
May 28 13:51:28 debian systemd[1]: ollama.service: Consumed 2h 21min 28.478s CPU time.
May 28 13:51:59 debian systemd[1]: Started ollama.service - Ollama Service.
May 28 13:51:59 debian ollama[545172]: 2024/05/28 13:51:59 routes.go:1008: INFO server config env="map[OLLAMA_DEBUG:false OLLAMA_LLM_LIBRARY: OLLAMA_MAX_LOADED_MODELS:1 OLLAMA_MAX_QUEUE:512 OLLAMA_MAX_VRAM:0 OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:1 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:*] OLLAMA_RUNNERS_DIR: OLLAMA_TMPDIR:]"
May 28 13:51:59 debian ollama[545172]: time=2024-05-28T13:51:59.319-04:00 level=INFO source=images.go:704 msg="total blobs: 0"
May 28 13:51:59 debian ollama[545172]: time=2024-05-28T13:51:59.319-04:00 level=INFO source=images.go:711 msg="total unused blobs removed: 0"
May 28 13:51:59 debian ollama[545172]: time=2024-05-28T13:51:59.319-04:00 level=INFO source=routes.go:1054 msg="Listening on 127.0.0.1:11434 (version 0.1.38)"
May 28 13:51:59 debian ollama[545172]: time=2024-05-28T13:51:59.319-04:00 level=INFO source=payload.go:30 msg="extracting embedded files" dir=/tmp/ollama259544789/runners
May 28 13:52:02 debian ollama[545172]: time=2024-05-28T13:52:02.099-04:00 level=INFO source=payload.go:44 msg="Dynamic LLM libraries [cpu cpu_avx cpu_avx2 cuda_v11 rocm_v60002]"
May 28 13:52:02 debian ollama[545172]: time=2024-05-28T13:52:02.114-04:00 level=INFO source=types.go:71 msg="inference compute" id=0 library=cpu compute="" driver=0.0 name="" total="15.5 GiB" available="5.5 GiB"

ollama run llama2:7b

ollama run llama2:7b
pulling manifest
pulling 8934d96d3f08... 100% ▕███████████████████████████████████████████████████████▏ 3.8 GB
pulling 8c17c2ebb0ea... 100% ▕███████████████████████████████████████████████████████▏ 7.0 KB
pulling 7c23fb36d801... 100% ▕███████████████████████████████████████████████████████▏ 4.8 KB
pulling 2e0493f67d0c... 100% ▕███████████████████████████████████████████████████████▏ 59 B
pulling fa304d675061... 100% ▕███████████████████████████████████████████████████████▏ 91 B
pulling 42ba7f8a01dd... 100% ▕███████████████████████████████████████████████████████▏ 557 B
verifying sha256 digest
writing manifest
removing any unused layers
success

Send a message (/? for help)

<!-- gh-comment-id:2135834711 --> @some1ataplace commented on GitHub (May 28, 2024): Interestingly enough, after restarting the ollama server it worked. `export OLLAMA_DEBUG="1"` ``` sudo systemctl stop ollama sudo service ollama restart sudo systemctl start ollama sudo service ollama status ``` ollama.service - Ollama Service Loaded: loaded (/etc/systemd/system/ollama.service; enabled; preset: enabled) Active: active (running) since Tue 2024-05-28 13:51:59 EDT; 1min 26s ago Main PID: 545172 (ollama) Tasks: 13 (limit: 18895) Memory: 476.3M CPU: 5.117s CGroup: /system.slice/ollama.service └─545172 /usr/local/bin/ollama serve May 28 13:51:59 debian systemd[1]: Started ollama.service - Ollama Service. May 28 13:51:59 debian ollama[545172]: 2024/05/28 13:51:59 routes.go:1008: INFO server config env="map[OLLAMA_DEBUG:false OLLAMA_LLM_LIBRARY: OLLAMA_MAX_LOADED_MODELS:1 OLLAMA_MAX_QUEUE:512 OLLAMA_MAX_VRAM:0 OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:1 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:*] OLLAMA_RUNNERS_DIR: OLLAMA_TMPDIR:]" May 28 13:51:59 debian ollama[545172]: time=2024-05-28T13:51:59.319-04:00 level=INFO source=images.go:704 msg="total blobs: 0" May 28 13:51:59 debian ollama[545172]: time=2024-05-28T13:51:59.319-04:00 level=INFO source=images.go:711 msg="total unused blobs removed: 0" May 28 13:51:59 debian ollama[545172]: time=2024-05-28T13:51:59.319-04:00 level=INFO source=routes.go:1054 msg="Listening on 127.0.0.1:11434 (version 0.1.38)" May 28 13:51:59 debian ollama[545172]: time=2024-05-28T13:51:59.319-04:00 level=INFO source=payload.go:30 msg="extracting embedded files" dir=/tmp/ollama259544789/runners May 28 13:52:02 debian ollama[545172]: time=2024-05-28T13:52:02.099-04:00 level=INFO source=payload.go:44 msg="Dynamic LLM libraries [cpu cpu_avx cpu_avx2 cuda_v11 rocm_v60002]" May 28 13:52:02 debian ollama[545172]: time=2024-05-28T13:52:02.114-04:00 level=INFO source=types.go:71 msg="inference compute" id=0 library=cpu compute="" driver=0.0 name="" total="15.5 GiB" available="5.5 GiB" `sudo journalctl -e -u ollama | less` May 28 13:51:28 debian systemd[1]: Stopping ollama.service - Ollama Service... May 28 13:51:28 debian systemd[1]: ollama.service: Deactivated successfully. May 28 13:51:28 debian systemd[1]: Stopped ollama.service - Ollama Service. May 28 13:51:28 debian systemd[1]: ollama.service: Consumed 2h 21min 28.478s CPU time. May 28 13:51:59 debian systemd[1]: Started ollama.service - Ollama Service. May 28 13:51:59 debian ollama[545172]: 2024/05/28 13:51:59 routes.go:1008: INFO server config env="map[OLLAMA_DEBUG:false OLLAMA_LLM_LIBRARY: OLLAMA_MAX_LOADED_MODELS:1 OLLAMA_MAX_QUEUE:512 OLLAMA_MAX_VRAM:0 OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:1 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:*] OLLAMA_RUNNERS_DIR: OLLAMA_TMPDIR:]" May 28 13:51:59 debian ollama[545172]: time=2024-05-28T13:51:59.319-04:00 level=INFO source=images.go:704 msg="total blobs: 0" May 28 13:51:59 debian ollama[545172]: time=2024-05-28T13:51:59.319-04:00 level=INFO source=images.go:711 msg="total unused blobs removed: 0" May 28 13:51:59 debian ollama[545172]: time=2024-05-28T13:51:59.319-04:00 level=INFO source=routes.go:1054 msg="Listening on 127.0.0.1:11434 (version 0.1.38)" May 28 13:51:59 debian ollama[545172]: time=2024-05-28T13:51:59.319-04:00 level=INFO source=payload.go:30 msg="extracting embedded files" dir=/tmp/ollama259544789/runners May 28 13:52:02 debian ollama[545172]: time=2024-05-28T13:52:02.099-04:00 level=INFO source=payload.go:44 msg="Dynamic LLM libraries [cpu cpu_avx cpu_avx2 cuda_v11 rocm_v60002]" May 28 13:52:02 debian ollama[545172]: time=2024-05-28T13:52:02.114-04:00 level=INFO source=types.go:71 msg="inference compute" id=0 library=cpu compute="" driver=0.0 name="" total="15.5 GiB" available="5.5 GiB" `ollama run llama2:7b` ollama run llama2:7b pulling manifest pulling 8934d96d3f08... 100% ▕███████████████████████████████████████████████████████▏ 3.8 GB pulling 8c17c2ebb0ea... 100% ▕███████████████████████████████████████████████████████▏ 7.0 KB pulling 7c23fb36d801... 100% ▕███████████████████████████████████████████████████████▏ 4.8 KB pulling 2e0493f67d0c... 100% ▕███████████████████████████████████████████████████████▏ 59 B pulling fa304d675061... 100% ▕███████████████████████████████████████████████████████▏ 91 B pulling 42ba7f8a01dd... 100% ▕███████████████████████████████████████████████████████▏ 557 B verifying sha256 digest writing manifest removing any unused layers success >>> Send a message (/? for help)
GiteaMirror commented 2026-04-12 13:11:55 -05:00
Author
Owner
Copy Link

@heuet commented on GitHub (Jun 26, 2024):

sudo service ollama restart

<!-- gh-comment-id:2190709549 --> @heuet commented on GitHub (Jun 26, 2024): sudo service ollama restart
GiteaMirror commented 2026-04-12 13:11:56 -05:00
Author
Owner
Copy Link

@gordonhart commented on GitHub (Jul 1, 2024):

Just ran into this on MacOS and can confirm that restarting the Ollama application fixed the issue.

<!-- gh-comment-id:2200228636 --> @gordonhart commented on GitHub (Jul 1, 2024): Just ran into this on MacOS and can confirm that restarting the Ollama application fixed the issue.
GiteaMirror commented 2026-04-12 13:11:56 -05:00
Author
Owner
Copy Link

@gdhua commented on GitHub (Jul 3, 2024):

I got the same issue on WindowsOS after the last update.

<!-- gh-comment-id:2205102234 --> @gdhua commented on GitHub (Jul 3, 2024): I got the same issue on WindowsOS after the last update.
GiteaMirror commented 2026-04-12 13:11:57 -05:00
Author
Owner
Copy Link

@gdhua commented on GitHub (Jul 3, 2024):

server.log
2024/07/03 12:48:57 routes.go:1064: INFO server config env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: OLLAMA_DEBUG:false OLLAMA_FLASH_ATTENTION:false OLLAMA_HOST:http://127.0.0.1:11434 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE: OLLAMA_LLM_LIBRARY: OLLAMA_MAX_LOADED_MODELS:1 OLLAMA_MAX_QUEUE:512 OLLAMA_MAX_VRAM:0 OLLAMA_MODELS:D:\data\OLLAMA_MODELS OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:1 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://*] OLLAMA_RUNNERS_DIR:D:\data\OLLAMA_RUNNERS_DIR OLLAMA_SCHED_SPREAD:false OLLAMA_TMPDIR: ROCR_VISIBLE_DEVICES:]"
time=2024-07-03T12:48:57.622+08:00 level=INFO source=images.go:730 msg="total blobs: 19"
time=2024-07-03T12:48:57.623+08:00 level=INFO source=images.go:737 msg="total unused blobs removed: 0"
time=2024-07-03T12:48:57.624+08:00 level=INFO source=routes.go:1111 msg="Listening on 127.0.0.1:11434 (version 0.1.48)"
time=2024-07-03T12:48:57.624+08:00 level=INFO source=payload.go:44 msg="Dynamic LLM libraries []"
time=2024-07-03T12:48:57.804+08:00 level=INFO source=types.go:98 msg="inference compute" id=GPU-c521c791-20db-fbee-ed8f-d9b2d6736693 library=cuda compute=8.6 driver=12.2 name="NVIDIA GeForce RTX 3060" total="12.0 GiB" available="11.0 GiB"
time=2024-07-03T12:49:20.929+08:00 level=INFO source=memory.go:309 msg="offload to cuda" layers.requested=-1 layers.model=13 layers.offload=13 layers.split="" memory.available="[10.5 GiB]" memory.required.full="809.9 MiB" memory.required.partial="809.9 MiB" memory.required.kv="24.0 MiB" memory.required.allocations="[809.9 MiB]" memory.weights.total="240.1 MiB" memory.weights.repeating="195.4 MiB" memory.weights.nonrepeating="44.7 MiB" memory.graph.full="48.0 MiB" memory.graph.partial="48.0 MiB"
time=2024-07-03T12:49:20.929+08:00 level=ERROR source=server.go:259 msg="server list inconsistent" error="[0] server cpu not listed in available servers map[]"
time=2024-07-03T12:49:20.929+08:00 level=ERROR source=server.go:409 msg="unable to load any llama server" error="[0] server cpu not listed in available servers map[]"
time=2024-07-03T12:49:20.929+08:00 level=INFO source=sched.go:362 msg="NewLlamaServer failed" model=D:\data\OLLAMA_MODELS\blobs\sha256-970aa74c0a90ef7482477cf803618e776e173c007bf957f635f1015bfcfef0e6 error="[0] server cpu not listed in available servers map[]"
[GIN] 2024/07/03 - 12:49:20 | 500 | 19.5637ms | 127.0.0.1 | POST "/api/embeddings"

<!-- gh-comment-id:2205103722 --> @gdhua commented on GitHub (Jul 3, 2024): server.log 2024/07/03 12:48:57 routes.go:1064: INFO server config env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: OLLAMA_DEBUG:false OLLAMA_FLASH_ATTENTION:false OLLAMA_HOST:http://127.0.0.1:11434 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE: OLLAMA_LLM_LIBRARY: OLLAMA_MAX_LOADED_MODELS:1 OLLAMA_MAX_QUEUE:512 OLLAMA_MAX_VRAM:0 OLLAMA_MODELS:D:\\data\\OLLAMA_MODELS OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:1 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://*] OLLAMA_RUNNERS_DIR:D:\\data\\OLLAMA_RUNNERS_DIR OLLAMA_SCHED_SPREAD:false OLLAMA_TMPDIR: ROCR_VISIBLE_DEVICES:]" time=2024-07-03T12:48:57.622+08:00 level=INFO source=images.go:730 msg="total blobs: 19" time=2024-07-03T12:48:57.623+08:00 level=INFO source=images.go:737 msg="total unused blobs removed: 0" time=2024-07-03T12:48:57.624+08:00 level=INFO source=routes.go:1111 msg="Listening on 127.0.0.1:11434 (version 0.1.48)" time=2024-07-03T12:48:57.624+08:00 level=INFO source=payload.go:44 msg="Dynamic LLM libraries []" time=2024-07-03T12:48:57.804+08:00 level=INFO source=types.go:98 msg="inference compute" id=GPU-c521c791-20db-fbee-ed8f-d9b2d6736693 library=cuda compute=8.6 driver=12.2 name="NVIDIA GeForce RTX 3060" total="12.0 GiB" available="11.0 GiB" time=2024-07-03T12:49:20.929+08:00 level=INFO source=memory.go:309 msg="offload to cuda" layers.requested=-1 layers.model=13 layers.offload=13 layers.split="" memory.available="[10.5 GiB]" memory.required.full="809.9 MiB" memory.required.partial="809.9 MiB" memory.required.kv="24.0 MiB" memory.required.allocations="[809.9 MiB]" memory.weights.total="240.1 MiB" memory.weights.repeating="195.4 MiB" memory.weights.nonrepeating="44.7 MiB" memory.graph.full="48.0 MiB" memory.graph.partial="48.0 MiB" time=2024-07-03T12:49:20.929+08:00 level=ERROR source=server.go:259 msg="server list inconsistent" error="[0] server cpu not listed in available servers map[]" time=2024-07-03T12:49:20.929+08:00 level=ERROR source=server.go:409 msg="unable to load any llama server" error="[0] server cpu not listed in available servers map[]" time=2024-07-03T12:49:20.929+08:00 level=INFO source=sched.go:362 msg="NewLlamaServer failed" model=D:\data\OLLAMA_MODELS\blobs\sha256-970aa74c0a90ef7482477cf803618e776e173c007bf957f635f1015bfcfef0e6 error="[0] server cpu not listed in available servers map[]" [GIN] 2024/07/03 - 12:49:20 | 500 | 19.5637ms | 127.0.0.1 | POST "/api/embeddings"
GiteaMirror commented 2026-04-12 13:11:57 -05:00
Author
Owner
Copy Link

@dhiltgen commented on GitHub (Jul 5, 2024):

I just merged a fix which should get rid of this error case in the next release.

<!-- gh-comment-id:2211094129 --> @dhiltgen commented on GitHub (Jul 5, 2024): I just merged a fix which should get rid of this error case in the next release.
GiteaMirror commented 2026-04-12 13:11:58 -05:00
Author
Owner
Copy Link

@lenzenc commented on GitHub (Jul 8, 2024):

I got the same error recently.

My version: ollama version is 0.1.45

A quick restart of Ollama resolved the issue for me.

<!-- gh-comment-id:2214040312 --> @lenzenc commented on GitHub (Jul 8, 2024): I got the same error recently. My version: ollama version is 0.1.45 A quick restart of Ollama resolved the issue for me.
GiteaMirror commented 2026-04-12 13:11:58 -05:00
Author
Owner
Copy Link

@jeniasaigak commented on GitHub (Jul 15, 2024):

Resolved by restarting via brew services:

brew services restart ollama
<!-- gh-comment-id:2227891197 --> @jeniasaigak commented on GitHub (Jul 15, 2024): Resolved by restarting via brew services: ``` brew services restart ollama ```
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
 python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
No Label bug windows
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#2851
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?