[GH-ISSUE #4970] llama runner process has terminated: exit status 0xc0000022 #49651

Closed
opened 2026-04-28 12:29:45 -05:00 by GiteaMirror · 1 comment
Owner

Originally created by @qq775862807 on GitHub (Jun 11, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/4970

What is the issue?

models:qwen2;Llama 3
2024/06/11 10:55:01 routes.go:1011: INFO server config env="map[OLLAMA_DEBUG:false OLLAMA_FLASH_ATTENTION:false OLLAMA_HOST: OLLAMA_KEEP_ALIVE: OLLAMA_LLM_LIBRARY: OLLAMA_MAX_LOADED_MODELS:1 OLLAMA_MAX_QUEUE:512 OLLAMA_MAX_VRAM:0 OLLAMA_MODELS: OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:1 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://*] OLLAMA_RUNNERS_DIR:C:\Users\EDY\AppData\Local\Programs\Ollama\ollama_runners OLLAMA_TMPDIR:]"
time=2024-06-11T10:55:01.880+08:00 level=INFO source=images.go:740 msg="total blobs: 10"
time=2024-06-11T10:55:01.881+08:00 level=INFO source=images.go:747 msg="total unused blobs removed: 0"
time=2024-06-11T10:55:01.882+08:00 level=INFO source=routes.go:1057 msg="Listening on 127.0.0.1:11434 (version 0.1.42)"
time=2024-06-11T10:55:01.882+08:00 level=INFO source=payload.go:44 msg="Dynamic LLM libraries [cpu cpu_avx cpu_avx2 cuda_v11.3 rocm_v5.7]"
time=2024-06-11T10:55:02.005+08:00 level=INFO source=types.go:71 msg="inference compute" id=GPU-6ccc095a-61cb-a3f8-99a0-1a09a42f8770 library=cuda compute=8.6 driver=12.2 name="NVIDIA GeForce RTX 3050 OEM" total="8.0 GiB" available="7.0 GiB"
[GIN] 2024/06/11 - 10:55:02 | 200 | 512.1µs | 127.0.0.1 | HEAD "/"
[GIN] 2024/06/11 - 10:55:02 | 200 | 1.5467ms | 127.0.0.1 | POST "/api/show"
[GIN] 2024/06/11 - 10:55:02 | 200 | 1.0364ms | 127.0.0.1 | POST "/api/show"
time=2024-06-11T10:55:03.695+08:00 level=INFO source=memory.go:133 msg="offload to gpu" layers.requested=-1 layers.real=33 memory.available="7.0 GiB" memory.required.full="5.0 GiB" memory.required.partial="5.0 GiB" memory.required.kv="256.0 MiB" memory.weights.total="4.1 GiB" memory.weights.repeating="3.7 GiB" memory.weights.nonrepeating="411.0 MiB" memory.graph.full="164.0 MiB" memory.graph.partial="677.5 MiB"
time=2024-06-11T10:55:03.695+08:00 level=INFO source=memory.go:133 msg="offload to gpu" layers.requested=-1 layers.real=33 memory.available="7.0 GiB" memory.required.full="5.0 GiB" memory.required.partial="5.0 GiB" memory.required.kv="256.0 MiB" memory.weights.total="4.1 GiB" memory.weights.repeating="3.7 GiB" memory.weights.nonrepeating="411.0 MiB" memory.graph.full="164.0 MiB" memory.graph.partial="677.5 MiB"
time=2024-06-11T10:55:03.701+08:00 level=INFO source=server.go:341 msg="starting llama server" cmd="C:\Users\EDY\AppData\Local\Programs\Ollama\ollama_runners\cuda_v11.3\ollama_llama_server.exe --model C:\Users\EDY\.ollama\models\blobs\sha256-6a0746a1ec1aef3e7ec53868f220ff6e389f6f8ef87a01d77c96807de94ca2aa --ctx-size 2048 --batch-size 512 --embedding --log-disable --n-gpu-layers 33 --parallel 1 --port 54739"
time=2024-06-11T10:55:03.703+08:00 level=INFO source=sched.go:338 msg="loaded runners" count=1
time=2024-06-11T10:55:03.703+08:00 level=INFO source=server.go:529 msg="waiting for llama runner to start responding"
time=2024-06-11T10:55:03.703+08:00 level=INFO source=server.go:567 msg="waiting for server to become available" status="llm server error"
time=2024-06-11T10:55:03.954+08:00 level=ERROR source=sched.go:344 msg="error loading llama server" error="llama runner process has terminated: exit status 0xc0000022 "
[GIN] 2024/06/11 - 10:55:03 | 500 | 1.7530836s | 127.0.0.1 | POST "/api/chat"

OS

Windows

GPU

Nvidia

CPU

Intel

Ollama version

0.1.41;0.1.42

Originally created by @qq775862807 on GitHub (Jun 11, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/4970 ### What is the issue? models:qwen2;Llama 3 2024/06/11 10:55:01 routes.go:1011: INFO server config env="map[OLLAMA_DEBUG:false OLLAMA_FLASH_ATTENTION:false OLLAMA_HOST: OLLAMA_KEEP_ALIVE: OLLAMA_LLM_LIBRARY: OLLAMA_MAX_LOADED_MODELS:1 OLLAMA_MAX_QUEUE:512 OLLAMA_MAX_VRAM:0 OLLAMA_MODELS: OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:1 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://*] OLLAMA_RUNNERS_DIR:C:\\Users\\EDY\\AppData\\Local\\Programs\\Ollama\\ollama_runners OLLAMA_TMPDIR:]" time=2024-06-11T10:55:01.880+08:00 level=INFO source=images.go:740 msg="total blobs: 10" time=2024-06-11T10:55:01.881+08:00 level=INFO source=images.go:747 msg="total unused blobs removed: 0" time=2024-06-11T10:55:01.882+08:00 level=INFO source=routes.go:1057 msg="Listening on 127.0.0.1:11434 (version 0.1.42)" time=2024-06-11T10:55:01.882+08:00 level=INFO source=payload.go:44 msg="Dynamic LLM libraries [cpu cpu_avx cpu_avx2 cuda_v11.3 rocm_v5.7]" time=2024-06-11T10:55:02.005+08:00 level=INFO source=types.go:71 msg="inference compute" id=GPU-6ccc095a-61cb-a3f8-99a0-1a09a42f8770 library=cuda compute=8.6 driver=12.2 name="NVIDIA GeForce RTX 3050 OEM" total="8.0 GiB" available="7.0 GiB" [GIN] 2024/06/11 - 10:55:02 | 200 | 512.1µs | 127.0.0.1 | HEAD "/" [GIN] 2024/06/11 - 10:55:02 | 200 | 1.5467ms | 127.0.0.1 | POST "/api/show" [GIN] 2024/06/11 - 10:55:02 | 200 | 1.0364ms | 127.0.0.1 | POST "/api/show" time=2024-06-11T10:55:03.695+08:00 level=INFO source=memory.go:133 msg="offload to gpu" layers.requested=-1 layers.real=33 memory.available="7.0 GiB" memory.required.full="5.0 GiB" memory.required.partial="5.0 GiB" memory.required.kv="256.0 MiB" memory.weights.total="4.1 GiB" memory.weights.repeating="3.7 GiB" memory.weights.nonrepeating="411.0 MiB" memory.graph.full="164.0 MiB" memory.graph.partial="677.5 MiB" time=2024-06-11T10:55:03.695+08:00 level=INFO source=memory.go:133 msg="offload to gpu" layers.requested=-1 layers.real=33 memory.available="7.0 GiB" memory.required.full="5.0 GiB" memory.required.partial="5.0 GiB" memory.required.kv="256.0 MiB" memory.weights.total="4.1 GiB" memory.weights.repeating="3.7 GiB" memory.weights.nonrepeating="411.0 MiB" memory.graph.full="164.0 MiB" memory.graph.partial="677.5 MiB" time=2024-06-11T10:55:03.701+08:00 level=INFO source=server.go:341 msg="starting llama server" cmd="C:\\Users\\EDY\\AppData\\Local\\Programs\\Ollama\\ollama_runners\\cuda_v11.3\\ollama_llama_server.exe --model C:\\Users\\EDY\\.ollama\\models\\blobs\\sha256-6a0746a1ec1aef3e7ec53868f220ff6e389f6f8ef87a01d77c96807de94ca2aa --ctx-size 2048 --batch-size 512 --embedding --log-disable --n-gpu-layers 33 --parallel 1 --port 54739" time=2024-06-11T10:55:03.703+08:00 level=INFO source=sched.go:338 msg="loaded runners" count=1 time=2024-06-11T10:55:03.703+08:00 level=INFO source=server.go:529 msg="waiting for llama runner to start responding" time=2024-06-11T10:55:03.703+08:00 level=INFO source=server.go:567 msg="waiting for server to become available" status="llm server error" time=2024-06-11T10:55:03.954+08:00 level=ERROR source=sched.go:344 msg="error loading llama server" error="llama runner process has terminated: exit status 0xc0000022 " [GIN] 2024/06/11 - 10:55:03 | 500 | 1.7530836s | 127.0.0.1 | POST "/api/chat" ### OS Windows ### GPU Nvidia ### CPU Intel ### Ollama version 0.1.41;0.1.42
GiteaMirror added the bug label 2026-04-28 12:29:45 -05:00
Author
Owner

@qq775862807 commented on GitHub (Jun 11, 2024):

Please set the "ollama app.exe" file properties to: Start the program as administrator

<!-- gh-comment-id:2159695830 --> @qq775862807 commented on GitHub (Jun 11, 2024): Please set the "ollama app.exe" file properties to: Start the program as administrator
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#49651