github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-05-07 16:40:08 -05:00
Code Issues 14.5k Packages Projects Releases 120 Wiki Activity

[GH-ISSUE #4765] ollama run deepseek-v2:16b Error: llama runner process has terminated: signal: aborted (core dumped) #28761

New Issue
Closed
opened 2026-04-22 07:17:02 -05:00 by GiteaMirror · 9 comments
GiteaMirror commented 2026-04-22 07:17:02 -05:00
Owner
Copy Link

Originally created by @zhqfdn on GitHub (Jun 1, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/4765

What is the issue?

Error: llama runner process has terminated: signal: aborted (core dumped)

OS

Linux

GPU

Nvidia

CPU

Intel

Ollama version

1.40

Originally created by @zhqfdn on GitHub (Jun 1, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/4765 ### What is the issue? Error: llama runner process has terminated: signal: aborted (core dumped) ### OS Linux ### GPU Nvidia ### CPU Intel ### Ollama version 1.40
GiteaMirror added the bug label 2026-04-22 07:17:02 -05:00
GiteaMirror commented 2026-04-22 07:17:04 -05:00
Author
Owner
Copy Link

@rootcli commented on GitHub (Jun 1, 2024):

same problem, couldn't get it to work

<!-- gh-comment-id:2143491083 --> @rootcli commented on GitHub (Jun 1, 2024): same problem, couldn't get it to work
GiteaMirror commented 2026-04-22 07:17:04 -05:00
Author
Owner
Copy Link

@jmorganca commented on GitHub (Jun 1, 2024):

Hi @rootcli and @zhqfdn this was fixed in the latest pre-release of v0.1.40 uploaded yesterday: https://github.com/ollama/ollama/releases/tag/v0.1.40

<!-- gh-comment-id:2143570040 --> @jmorganca commented on GitHub (Jun 1, 2024): Hi @rootcli and @zhqfdn this was fixed in the latest pre-release of v0.1.40 uploaded yesterday: https://github.com/ollama/ollama/releases/tag/v0.1.40
GiteaMirror commented 2026-04-22 07:17:05 -05:00
Author
Owner
Copy Link

@rootcli commented on GitHub (Jun 2, 2024):

I updated to ollama 1.4 > Didn't work
I repulled deepstack > Didn't work
I deleted the model and redownloaded > Didn't work
I restarted Ollama service > Didn't work
nothing seems work
Until I restarted my system

Now it working 👍🏻
Thank you

<!-- gh-comment-id:2143640341 --> @rootcli commented on GitHub (Jun 2, 2024): I updated to ollama 1.4 > Didn't work I repulled [deepstack](deepseek-v2:latest) > Didn't work I deleted the model and redownloaded > Didn't work I restarted Ollama service > Didn't work nothing seems work Until I restarted my system Now it working 👍🏻 Thank you
GiteaMirror commented 2026-04-22 07:17:06 -05:00
Author
Owner
Copy Link

@rootcli commented on GitHub (Jun 2, 2024):

This model is not stable.
It starts with english then It keeps switching in what I think it's Chines. I had to delete it

<!-- gh-comment-id:2143792018 --> @rootcli commented on GitHub (Jun 2, 2024): This model is not stable. It starts with english then It keeps switching in what I think it's Chines. I had to delete it
GiteaMirror commented 2026-04-22 07:17:06 -05:00
Author
Owner
Copy Link

@imareo commented on GitHub (Jun 2, 2024):

same error... ollama 0.1.41
restart don't help.
Screenshot from 2024-06-02 14-03-31

<!-- gh-comment-id:2143805521 --> @imareo commented on GitHub (Jun 2, 2024): same error... ollama 0.1.41 restart don't help. ![Screenshot from 2024-06-02 14-03-31](https://github.com/ollama/ollama/assets/46757141/bd0f544b-5d83-4d98-ab1d-04bab0714015)
GiteaMirror commented 2026-04-22 07:17:07 -05:00
Author
Owner
Copy Link

@Aurnytoraink commented on GitHub (Jun 2, 2024):

Same error here

  • Model : hhao/openbmb-minicpm-llama3-v-2_5
  • CPU : Intel
  • GPU : None
  • OS : Fedora CoreOS (Linux)
  • Ollama version : 0.1.40 (Docker)
<!-- gh-comment-id:2143810906 --> @Aurnytoraink commented on GitHub (Jun 2, 2024): Same error here - Model : hhao/openbmb-minicpm-llama3-v-2_5 - CPU : Intel - GPU : None - OS : Fedora CoreOS (Linux) - Ollama version : 0.1.40 (Docker)
GiteaMirror commented 2026-04-22 07:17:07 -05:00
Author
Owner
Copy Link

@Aurnytoraink commented on GitHub (Jun 2, 2024):

I tried on another computer, but I still have the issue

  • Model : hhao/openbmb-minicpm-llama3-v-2_5
  • CPU : AMD Ryzen 5 5600
  • GPU : Nvidia GTX 1060
  • OS : Fedora Workstation (Linux)
  • Ollama version : 0.1.41
<!-- gh-comment-id:2143815120 --> @Aurnytoraink commented on GitHub (Jun 2, 2024): I tried on another computer, but I still have the issue - Model : hhao/openbmb-minicpm-llama3-v-2_5 - CPU : AMD Ryzen 5 5600 - GPU : Nvidia GTX 1060 - OS : Fedora Workstation (Linux) - Ollama version : 0.1.41
GiteaMirror commented 2026-04-22 07:17:08 -05:00
Author
Owner
Copy Link

@rootcli commented on GitHub (Jun 2, 2024):

I tried hhao/openbmb-minicpm-llama3-v-2_5
and I got the same error

ollama run hhao/openbmb-minicpm-llama3-v-2_5
Error: llama runner process has terminated: signal: aborted

here is my log after trying to run the model obove
I am running Ollama on a container in proxmox

journalctl -fu ollama
Jun 02 16:45:06 Ai ollama[670252]: time=2024-06-02T16:45:06.182+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]"
Jun 02 16:45:06 Ai ollama[670252]: CUDA driver version: 12.4
Jun 02 16:45:06 Ai ollama[670252]: time=2024-06-02T16:45:06.182+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78
Jun 02 16:45:06 Ai ollama[670252]: time=2024-06-02T16:45:06.182+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2"
Jun 02 16:45:06 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb
Jun 02 16:45:06 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb
Jun 02 16:45:06 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6
Jun 02 16:45:06 Ai ollama[670252]: time=2024-06-02T16:45:06.343+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu"
Jun 02 16:45:06 Ai ollama[670252]: releasing nvcuda library
Jun 02 16:45:06 Ai ollama[670252]: time=2024-06-02T16:45:06.429+03:00 level=WARN source=sched.go:512 msg="gpu VRAM usage didn't recover within timeout" seconds=5.6795858169999995
Jun 02 16:47:26 Ai ollama[670252]: [GIN] 2024/06/02 - 16:47:26 | 200 |      30.673µs |       127.0.0.1 | HEAD     "/"
Jun 02 16:47:26 Ai ollama[670252]: [GIN] 2024/06/02 - 16:47:26 | 200 |     751.867µs |       127.0.0.1 | POST     "/api/show"
Jun 02 16:47:26 Ai ollama[670252]: [GIN] 2024/06/02 - 16:47:26 | 200 |     496.318µs |       127.0.0.1 | POST     "/api/show"
Jun 02 16:47:26 Ai ollama[670252]: time=2024-06-02T16:47:26.498+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs"
Jun 02 16:47:26 Ai ollama[670252]: time=2024-06-02T16:47:26.498+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so*
Jun 02 16:47:26 Ai ollama[670252]: time=2024-06-02T16:47:26.498+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]"
Jun 02 16:47:26 Ai ollama[670252]: time=2024-06-02T16:47:26.500+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]"
Jun 02 16:47:26 Ai ollama[670252]: CUDA driver version: 12.4
Jun 02 16:47:26 Ai ollama[670252]: time=2024-06-02T16:47:26.501+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78
Jun 02 16:47:26 Ai ollama[670252]: time=2024-06-02T16:47:26.501+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2"
Jun 02 16:47:26 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb
Jun 02 16:47:26 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb
Jun 02 16:47:26 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6
Jun 02 16:47:26 Ai ollama[670252]: time=2024-06-02T16:47:26.689+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu"
Jun 02 16:47:26 Ai ollama[670252]: releasing nvcuda library
Jun 02 16:47:26 Ai ollama[670252]: time=2024-06-02T16:47:26.689+03:00 level=DEBUG source=gguf.go:57 msg="model = &llm.gguf{containerGGUF:(*llm.containerGGUF)(0xc0002f4a40), kv:llm.KV{}, tensors:[]*llm.Tensor(nil), parameters:0x0}"
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.026+03:00 level=DEBUG source=sched.go:153 msg="loading first model" model=/Models/models/blobs/sha256-010ec3ba94cb5ad2d9c8f95f46f01c6d80f83deab9df0a0831334ea45afff3e2
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.026+03:00 level=DEBUG source=memory.go:44 msg=evaluating library=cuda gpu_count=1 available="9.3 GiB"
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.026+03:00 level=DEBUG source=gguf.go:57 msg="model = &llm.gguf{containerGGUF:(*llm.containerGGUF)(0xc0002f40c0), kv:llm.KV{}, tensors:[]*llm.Tensor(nil), parameters:0x0}"
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.030+03:00 level=INFO source=memory.go:133 msg="offload to gpu" layers.requested=-1 layers.real=33 memory.available="9.3 GiB" memory.required.full="7.0 GiB" memory.required.partial="7.0 GiB" memory.required.kv="768.0 MiB" memory.weights.total="4.3 GiB" memory.weights.repeating="3.9 GiB" memory.weights.nonrepeating="411.0 MiB" memory.graph.full="428.0 MiB" memory.graph.partial="677.5 MiB"
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.030+03:00 level=DEBUG source=sched.go:565 msg="new model will fit in available VRAM in single GPU, loading" model=/Models/models/blobs/sha256-010ec3ba94cb5ad2d9c8f95f46f01c6d80f83deab9df0a0831334ea45afff3e2 gpu=GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe available=9997254656 required="7.0 GiB"
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.030+03:00 level=DEBUG source=memory.go:44 msg=evaluating library=cuda gpu_count=1 available="9.3 GiB"
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.030+03:00 level=DEBUG source=gguf.go:57 msg="model = &llm.gguf{containerGGUF:(*llm.containerGGUF)(0xc000558480), kv:llm.KV{}, tensors:[]*llm.Tensor(nil), parameters:0x0}"
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.034+03:00 level=INFO source=memory.go:133 msg="offload to gpu" layers.requested=-1 layers.real=33 memory.available="9.3 GiB" memory.required.full="7.0 GiB" memory.required.partial="7.0 GiB" memory.required.kv="768.0 MiB" memory.weights.total="4.3 GiB" memory.weights.repeating="3.9 GiB" memory.weights.nonrepeating="411.0 MiB" memory.graph.full="428.0 MiB" memory.graph.partial="677.5 MiB"
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.034+03:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama737324783/runners/cpu
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.034+03:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama737324783/runners/cpu_avx
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.034+03:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama737324783/runners/cpu_avx2
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.034+03:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama737324783/runners/cuda_v11
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.034+03:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama737324783/runners/rocm_v60002
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.034+03:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama737324783/runners/cpu
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.034+03:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama737324783/runners/cpu_avx
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.034+03:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama737324783/runners/cpu_avx2
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.034+03:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama737324783/runners/cuda_v11
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.034+03:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama737324783/runners/rocm_v60002
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.034+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2"
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.034+03:00 level=WARN source=server.go:230 msg="multimodal models don't support parallel requests yet"
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.034+03:00 level=INFO source=server.go:341 msg="starting llama server" cmd="/tmp/ollama737324783/runners/cuda_v11/ollama_llama_server --model /Models/models/blobs/sha256-010ec3ba94cb5ad2d9c8f95f46f01c6d80f83deab9df0a0831334ea45afff3e2 --ctx-size 6144 --batch-size 512 --embedding --log-disable --n-gpu-layers 33 --verbose --mmproj /Models/models/blobs/sha256-391d11736c3cd24a90417c47b0c88975e86918fcddb1b00494c4d715b08af13e --parallel 1 --port 38305"
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.034+03:00 level=DEBUG source=server.go:356 msg=subprocess environment="[PATH=/root/miniconda3/bin:/root/miniconda3/condabin:/root/.nvm/versions/node/v21.7.3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin LD_LIBRARY_PATH=/tmp/ollama737324783/runners/cuda_v11 CUDA_VISIBLE_DEVICES=GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe]"
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.035+03:00 level=INFO source=sched.go:338 msg="loaded runners" count=1
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.035+03:00 level=INFO source=server.go:529 msg="waiting for llama runner to start responding"
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.035+03:00 level=INFO source=server.go:567 msg="waiting for server to become available" status="llm server error"
Jun 02 16:47:28 Ai ollama[671968]: INFO [main] build info | build=1 commit="5921b8f" tid="138018617298944" timestamp=1717336048
Jun 02 16:47:28 Ai ollama[671968]: INFO [main] system info | n_threads=40 n_threads_batch=-1 system_info="AVX = 1 | AVX_VNNI = 0 | AVX2 = 0 | AVX512 = 0 | AVX512_VBMI = 0 | AVX512_VNNI = 0 | AVX512_BF16 = 0 | FMA = 0 | NEON = 0 | SVE = 0 | ARM_FMA = 0 | F16C = 0 | FP16_VA = 0 | WASM_SIMD = 0 | BLAS = 1 | SSE3 = 1 | SSSE3 = 1 | VSX = 0 | MATMUL_INT8 = 0 | LLAMAFILE = 1 | " tid="138018617298944" timestamp=1717336048 total_threads=64
Jun 02 16:47:28 Ai ollama[671968]: INFO [main] HTTP server listening | hostname="127.0.0.1" n_threads_http="63" port="38305" tid="138018617298944" timestamp=1717336048
Jun 02 16:47:28 Ai ollama[671968]: DEBUG [load_model] Multi Modal Mode Enabled | tid="138018617298944" timestamp=1717336048
Jun 02 16:47:28 Ai ollama[670252]: ggml_cuda_init: GGML_CUDA_FORCE_MMQ:   yes
Jun 02 16:47:28 Ai ollama[670252]: ggml_cuda_init: CUDA_USE_TENSOR_CORES: no
Jun 02 16:47:28 Ai ollama[670252]: ggml_cuda_init: found 1 CUDA devices:
Jun 02 16:47:28 Ai ollama[670252]:   Device 0: NVIDIA GeForce RTX 3060, compute capability 8.6, VMM: yes
Jun 02 16:47:28 Ai ollama[670252]: GGML_ASSERT: /go/src/github.com/ollama/ollama/llm/llama.cpp/examples/llava/clip.cpp:1024: new_clip->has_llava_projector
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.287+03:00 level=ERROR source=sched.go:344 msg="error loading llama server" error="llama runner process has terminated: signal: aborted "
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.287+03:00 level=DEBUG source=sched.go:347 msg="triggering expiration for failed load" model=/Models/models/blobs/sha256-010ec3ba94cb5ad2d9c8f95f46f01c6d80f83deab9df0a0831334ea45afff3e2
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.287+03:00 level=DEBUG source=sched.go:258 msg="runner expired event received" modelPath=/Models/models/blobs/sha256-010ec3ba94cb5ad2d9c8f95f46f01c6d80f83deab9df0a0831334ea45afff3e2
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.287+03:00 level=DEBUG source=sched.go:274 msg="got lock to unload" modelPath=/Models/models/blobs/sha256-010ec3ba94cb5ad2d9c8f95f46f01c6d80f83deab9df0a0831334ea45afff3e2
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.287+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs"
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.287+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so*
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.287+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]"
Jun 02 16:47:28 Ai ollama[670252]: [GIN] 2024/06/02 - 16:47:28 | 500 |  1.789362982s |       127.0.0.1 | POST     "/api/chat"
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.290+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]"
Jun 02 16:47:28 Ai ollama[670252]: CUDA driver version: 12.4
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.290+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.290+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2"
Jun 02 16:47:28 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb
Jun 02 16:47:28 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb
Jun 02 16:47:28 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.485+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu"
Jun 02 16:47:28 Ai ollama[670252]: releasing nvcuda library
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.485+03:00 level=DEBUG source=server.go:990 msg="stopping llama server"
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.485+03:00 level=DEBUG source=sched.go:279 msg="runner released" modelPath=/Models/models/blobs/sha256-010ec3ba94cb5ad2d9c8f95f46f01c6d80f83deab9df0a0831334ea45afff3e2
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.735+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs"
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.735+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so*
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.735+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]"
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.738+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]"
Jun 02 16:47:28 Ai ollama[670252]: CUDA driver version: 12.4
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.738+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.738+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2"
Jun 02 16:47:28 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb
Jun 02 16:47:28 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb
Jun 02 16:47:28 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.893+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu"
Jun 02 16:47:28 Ai ollama[670252]: releasing nvcuda library
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.986+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs"
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.986+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so*
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.986+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]"
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.988+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]"
Jun 02 16:47:28 Ai ollama[670252]: CUDA driver version: 12.4
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.988+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78
Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.988+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2"
Jun 02 16:47:29 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb
Jun 02 16:47:29 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb
Jun 02 16:47:29 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6
Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.156+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu"
Jun 02 16:47:29 Ai ollama[670252]: releasing nvcuda library
Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.236+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs"
Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.236+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so*
Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.236+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]"
Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.238+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]"
Jun 02 16:47:29 Ai ollama[670252]: CUDA driver version: 12.4
Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.238+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78
Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.238+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2"
Jun 02 16:47:29 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb
Jun 02 16:47:29 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb
Jun 02 16:47:29 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6
Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.408+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu"
Jun 02 16:47:29 Ai ollama[670252]: releasing nvcuda library
Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.486+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs"
Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.486+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so*
Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.486+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]"
Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.488+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]"
Jun 02 16:47:29 Ai ollama[670252]: CUDA driver version: 12.4
Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.488+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78
Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.488+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2"
Jun 02 16:47:29 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb
Jun 02 16:47:29 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb
Jun 02 16:47:29 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6
Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.640+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu"
Jun 02 16:47:29 Ai ollama[670252]: releasing nvcuda library
Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.735+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs"
Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.736+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so*
Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.736+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]"
Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.738+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]"
Jun 02 16:47:29 Ai ollama[670252]: CUDA driver version: 12.4
Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.738+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78
Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.738+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2"
Jun 02 16:47:29 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb
Jun 02 16:47:29 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb
Jun 02 16:47:29 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6
Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.888+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu"
Jun 02 16:47:29 Ai ollama[670252]: releasing nvcuda library
Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.985+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs"
Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.986+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so*
Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.986+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]"
Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.988+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]"
Jun 02 16:47:29 Ai ollama[670252]: CUDA driver version: 12.4
Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.988+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78
Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.988+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2"
Jun 02 16:47:30 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb
Jun 02 16:47:30 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb
Jun 02 16:47:30 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6
Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.154+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu"
Jun 02 16:47:30 Ai ollama[670252]: releasing nvcuda library
Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.235+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs"
Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.236+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so*
Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.236+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]"
Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.238+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]"
Jun 02 16:47:30 Ai ollama[670252]: CUDA driver version: 12.4
Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.238+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78
Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.238+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2"
Jun 02 16:47:30 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb
Jun 02 16:47:30 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb
Jun 02 16:47:30 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6
Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.405+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu"
Jun 02 16:47:30 Ai ollama[670252]: releasing nvcuda library
Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.485+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs"
Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.485+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so*
Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.485+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]"
Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.487+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]"
Jun 02 16:47:30 Ai ollama[670252]: CUDA driver version: 12.4
Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.487+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78
Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.487+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2"
Jun 02 16:47:30 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb
Jun 02 16:47:30 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb
Jun 02 16:47:30 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6
Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.639+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu"
Jun 02 16:47:30 Ai ollama[670252]: releasing nvcuda library
Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.735+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs"
Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.735+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so*
Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.735+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]"
Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.738+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]"
Jun 02 16:47:30 Ai ollama[670252]: CUDA driver version: 12.4
Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.738+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78
Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.738+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2"
Jun 02 16:47:30 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb
Jun 02 16:47:30 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb
Jun 02 16:47:30 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6
Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.892+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu"
Jun 02 16:47:30 Ai ollama[670252]: releasing nvcuda library
Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.986+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs"
Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.986+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so*
Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.986+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]"
Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.988+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]"
Jun 02 16:47:30 Ai ollama[670252]: CUDA driver version: 12.4
Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.988+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78
Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.988+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2"
Jun 02 16:47:31 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb
Jun 02 16:47:31 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb
Jun 02 16:47:31 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6
Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.155+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu"
Jun 02 16:47:31 Ai ollama[670252]: releasing nvcuda library
Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.235+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs"
Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.235+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so*
Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.235+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]"
Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.238+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]"
Jun 02 16:47:31 Ai ollama[670252]: CUDA driver version: 12.4
Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.238+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78
Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.238+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2"
Jun 02 16:47:31 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb
Jun 02 16:47:31 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb
Jun 02 16:47:31 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6
Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.400+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu"
Jun 02 16:47:31 Ai ollama[670252]: releasing nvcuda library
Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.486+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs"
Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.486+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so*
Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.486+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]"
Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.488+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]"
Jun 02 16:47:31 Ai ollama[670252]: CUDA driver version: 12.4
Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.488+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78
Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.488+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2"
Jun 02 16:47:31 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb
Jun 02 16:47:31 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb
Jun 02 16:47:31 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6
Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.650+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu"
Jun 02 16:47:31 Ai ollama[670252]: releasing nvcuda library
Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.736+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs"
Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.736+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so*
Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.736+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]"
Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.738+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]"
Jun 02 16:47:31 Ai ollama[670252]: CUDA driver version: 12.4
Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.738+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78
Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.738+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2"
Jun 02 16:47:31 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb
Jun 02 16:47:31 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb
Jun 02 16:47:31 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6
Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.883+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu"
Jun 02 16:47:31 Ai ollama[670252]: releasing nvcuda library
Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.985+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs"
Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.986+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so*
Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.986+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]"
Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.988+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]"
Jun 02 16:47:31 Ai ollama[670252]: CUDA driver version: 12.4
Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.988+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78
Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.988+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2"
Jun 02 16:47:32 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb
Jun 02 16:47:32 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb
Jun 02 16:47:32 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6
Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.150+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu"
Jun 02 16:47:32 Ai ollama[670252]: releasing nvcuda library
Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.235+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs"
Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.235+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so*
Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.235+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]"
Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.237+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]"
Jun 02 16:47:32 Ai ollama[670252]: CUDA driver version: 12.4
Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.238+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78
Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.238+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2"
Jun 02 16:47:32 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb
Jun 02 16:47:32 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb
Jun 02 16:47:32 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6
Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.405+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu"
Jun 02 16:47:32 Ai ollama[670252]: releasing nvcuda library
Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.486+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs"
Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.486+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so*
Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.486+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]"
Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.488+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]"
Jun 02 16:47:32 Ai ollama[670252]: CUDA driver version: 12.4
Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.488+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78
Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.488+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2"
Jun 02 16:47:32 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb
Jun 02 16:47:32 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb
Jun 02 16:47:32 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6
Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.657+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu"
Jun 02 16:47:32 Ai ollama[670252]: releasing nvcuda library
Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.736+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs"
Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.736+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so*
Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.736+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]"
Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.738+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]"
Jun 02 16:47:32 Ai ollama[670252]: CUDA driver version: 12.4
Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.738+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78
Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.738+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2"
Jun 02 16:47:32 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb
Jun 02 16:47:32 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb
Jun 02 16:47:32 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6
Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.894+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu"
Jun 02 16:47:32 Ai ollama[670252]: releasing nvcuda library
Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.985+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs"
Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.986+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so*
Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.986+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]"
Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.988+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]"
Jun 02 16:47:32 Ai ollama[670252]: CUDA driver version: 12.4
Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.988+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78
Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.988+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2"
Jun 02 16:47:33 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb
Jun 02 16:47:33 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb
Jun 02 16:47:33 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6
Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.155+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu"
Jun 02 16:47:33 Ai ollama[670252]: releasing nvcuda library
Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.235+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs"
Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.235+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so*
Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.235+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]"
Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.238+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]"
Jun 02 16:47:33 Ai ollama[670252]: CUDA driver version: 12.4
Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.238+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78
Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.238+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2"
Jun 02 16:47:33 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb
Jun 02 16:47:33 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb
Jun 02 16:47:33 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6
Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.404+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu"
Jun 02 16:47:33 Ai ollama[670252]: releasing nvcuda library
Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.486+03:00 level=WARN source=sched.go:512 msg="gpu VRAM usage didn't recover within timeout" seconds=5.199123819
Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.486+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs"
Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.486+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so*
Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.486+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]"
Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.486+03:00 level=DEBUG source=sched.go:283 msg="sending an unloaded event" modelPath=/Models/models/blobs/sha256-010ec3ba94cb5ad2d9c8f95f46f01c6d80f83deab9df0a0831334ea45afff3e2
Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.486+03:00 level=DEBUG source=sched.go:206 msg="ignoring unload event with no pending requests"
Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.488+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]"
Jun 02 16:47:33 Ai ollama[670252]: CUDA driver version: 12.4
Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.488+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78
Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.488+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2"
Jun 02 16:47:33 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb
Jun 02 16:47:33 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb
Jun 02 16:47:33 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6
Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.634+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu"
Jun 02 16:47:33 Ai ollama[670252]: releasing nvcuda library
Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.736+03:00 level=WARN source=sched.go:512 msg="gpu VRAM usage didn't recover within timeout" seconds=5.448901251
Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.736+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs"
Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.736+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so*
Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.736+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]"
Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.738+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]"
Jun 02 16:47:33 Ai ollama[670252]: CUDA driver version: 12.4
Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.738+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78
Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.738+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2"
Jun 02 16:47:33 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb
Jun 02 16:47:33 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb
Jun 02 16:47:33 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6
Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.896+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu"
Jun 02 16:47:33 Ai ollama[670252]: releasing nvcuda library
Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.985+03:00 level=WARN source=sched.go:512 msg="gpu VRAM usage didn't recover within timeout" seconds=5.698670655
<!-- gh-comment-id:2143860463 --> @rootcli commented on GitHub (Jun 2, 2024): I tried hhao/openbmb-minicpm-llama3-v-2_5 and I got the same error ``` ollama run hhao/openbmb-minicpm-llama3-v-2_5 Error: llama runner process has terminated: signal: aborted ``` here is my log after trying to run the model obove I am running Ollama on a container in proxmox ``` journalctl -fu ollama Jun 02 16:45:06 Ai ollama[670252]: time=2024-06-02T16:45:06.182+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]" Jun 02 16:45:06 Ai ollama[670252]: CUDA driver version: 12.4 Jun 02 16:45:06 Ai ollama[670252]: time=2024-06-02T16:45:06.182+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 Jun 02 16:45:06 Ai ollama[670252]: time=2024-06-02T16:45:06.182+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2" Jun 02 16:45:06 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb Jun 02 16:45:06 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb Jun 02 16:45:06 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6 Jun 02 16:45:06 Ai ollama[670252]: time=2024-06-02T16:45:06.343+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu" Jun 02 16:45:06 Ai ollama[670252]: releasing nvcuda library Jun 02 16:45:06 Ai ollama[670252]: time=2024-06-02T16:45:06.429+03:00 level=WARN source=sched.go:512 msg="gpu VRAM usage didn't recover within timeout" seconds=5.6795858169999995 Jun 02 16:47:26 Ai ollama[670252]: [GIN] 2024/06/02 - 16:47:26 | 200 | 30.673µs | 127.0.0.1 | HEAD "/" Jun 02 16:47:26 Ai ollama[670252]: [GIN] 2024/06/02 - 16:47:26 | 200 | 751.867µs | 127.0.0.1 | POST "/api/show" Jun 02 16:47:26 Ai ollama[670252]: [GIN] 2024/06/02 - 16:47:26 | 200 | 496.318µs | 127.0.0.1 | POST "/api/show" Jun 02 16:47:26 Ai ollama[670252]: time=2024-06-02T16:47:26.498+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs" Jun 02 16:47:26 Ai ollama[670252]: time=2024-06-02T16:47:26.498+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so* Jun 02 16:47:26 Ai ollama[670252]: time=2024-06-02T16:47:26.498+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]" Jun 02 16:47:26 Ai ollama[670252]: time=2024-06-02T16:47:26.500+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]" Jun 02 16:47:26 Ai ollama[670252]: CUDA driver version: 12.4 Jun 02 16:47:26 Ai ollama[670252]: time=2024-06-02T16:47:26.501+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 Jun 02 16:47:26 Ai ollama[670252]: time=2024-06-02T16:47:26.501+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2" Jun 02 16:47:26 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb Jun 02 16:47:26 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb Jun 02 16:47:26 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6 Jun 02 16:47:26 Ai ollama[670252]: time=2024-06-02T16:47:26.689+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu" Jun 02 16:47:26 Ai ollama[670252]: releasing nvcuda library Jun 02 16:47:26 Ai ollama[670252]: time=2024-06-02T16:47:26.689+03:00 level=DEBUG source=gguf.go:57 msg="model = &llm.gguf{containerGGUF:(*llm.containerGGUF)(0xc0002f4a40), kv:llm.KV{}, tensors:[]*llm.Tensor(nil), parameters:0x0}" Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.026+03:00 level=DEBUG source=sched.go:153 msg="loading first model" model=/Models/models/blobs/sha256-010ec3ba94cb5ad2d9c8f95f46f01c6d80f83deab9df0a0831334ea45afff3e2 Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.026+03:00 level=DEBUG source=memory.go:44 msg=evaluating library=cuda gpu_count=1 available="9.3 GiB" Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.026+03:00 level=DEBUG source=gguf.go:57 msg="model = &llm.gguf{containerGGUF:(*llm.containerGGUF)(0xc0002f40c0), kv:llm.KV{}, tensors:[]*llm.Tensor(nil), parameters:0x0}" Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.030+03:00 level=INFO source=memory.go:133 msg="offload to gpu" layers.requested=-1 layers.real=33 memory.available="9.3 GiB" memory.required.full="7.0 GiB" memory.required.partial="7.0 GiB" memory.required.kv="768.0 MiB" memory.weights.total="4.3 GiB" memory.weights.repeating="3.9 GiB" memory.weights.nonrepeating="411.0 MiB" memory.graph.full="428.0 MiB" memory.graph.partial="677.5 MiB" Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.030+03:00 level=DEBUG source=sched.go:565 msg="new model will fit in available VRAM in single GPU, loading" model=/Models/models/blobs/sha256-010ec3ba94cb5ad2d9c8f95f46f01c6d80f83deab9df0a0831334ea45afff3e2 gpu=GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe available=9997254656 required="7.0 GiB" Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.030+03:00 level=DEBUG source=memory.go:44 msg=evaluating library=cuda gpu_count=1 available="9.3 GiB" Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.030+03:00 level=DEBUG source=gguf.go:57 msg="model = &llm.gguf{containerGGUF:(*llm.containerGGUF)(0xc000558480), kv:llm.KV{}, tensors:[]*llm.Tensor(nil), parameters:0x0}" Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.034+03:00 level=INFO source=memory.go:133 msg="offload to gpu" layers.requested=-1 layers.real=33 memory.available="9.3 GiB" memory.required.full="7.0 GiB" memory.required.partial="7.0 GiB" memory.required.kv="768.0 MiB" memory.weights.total="4.3 GiB" memory.weights.repeating="3.9 GiB" memory.weights.nonrepeating="411.0 MiB" memory.graph.full="428.0 MiB" memory.graph.partial="677.5 MiB" Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.034+03:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama737324783/runners/cpu Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.034+03:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama737324783/runners/cpu_avx Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.034+03:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama737324783/runners/cpu_avx2 Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.034+03:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama737324783/runners/cuda_v11 Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.034+03:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama737324783/runners/rocm_v60002 Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.034+03:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama737324783/runners/cpu Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.034+03:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama737324783/runners/cpu_avx Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.034+03:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama737324783/runners/cpu_avx2 Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.034+03:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama737324783/runners/cuda_v11 Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.034+03:00 level=DEBUG source=payload.go:71 msg="availableServers : found" file=/tmp/ollama737324783/runners/rocm_v60002 Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.034+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2" Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.034+03:00 level=WARN source=server.go:230 msg="multimodal models don't support parallel requests yet" Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.034+03:00 level=INFO source=server.go:341 msg="starting llama server" cmd="/tmp/ollama737324783/runners/cuda_v11/ollama_llama_server --model /Models/models/blobs/sha256-010ec3ba94cb5ad2d9c8f95f46f01c6d80f83deab9df0a0831334ea45afff3e2 --ctx-size 6144 --batch-size 512 --embedding --log-disable --n-gpu-layers 33 --verbose --mmproj /Models/models/blobs/sha256-391d11736c3cd24a90417c47b0c88975e86918fcddb1b00494c4d715b08af13e --parallel 1 --port 38305" Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.034+03:00 level=DEBUG source=server.go:356 msg=subprocess environment="[PATH=/root/miniconda3/bin:/root/miniconda3/condabin:/root/.nvm/versions/node/v21.7.3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin LD_LIBRARY_PATH=/tmp/ollama737324783/runners/cuda_v11 CUDA_VISIBLE_DEVICES=GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe]" Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.035+03:00 level=INFO source=sched.go:338 msg="loaded runners" count=1 Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.035+03:00 level=INFO source=server.go:529 msg="waiting for llama runner to start responding" Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.035+03:00 level=INFO source=server.go:567 msg="waiting for server to become available" status="llm server error" Jun 02 16:47:28 Ai ollama[671968]: INFO [main] build info | build=1 commit="5921b8f" tid="138018617298944" timestamp=1717336048 Jun 02 16:47:28 Ai ollama[671968]: INFO [main] system info | n_threads=40 n_threads_batch=-1 system_info="AVX = 1 | AVX_VNNI = 0 | AVX2 = 0 | AVX512 = 0 | AVX512_VBMI = 0 | AVX512_VNNI = 0 | AVX512_BF16 = 0 | FMA = 0 | NEON = 0 | SVE = 0 | ARM_FMA = 0 | F16C = 0 | FP16_VA = 0 | WASM_SIMD = 0 | BLAS = 1 | SSE3 = 1 | SSSE3 = 1 | VSX = 0 | MATMUL_INT8 = 0 | LLAMAFILE = 1 | " tid="138018617298944" timestamp=1717336048 total_threads=64 Jun 02 16:47:28 Ai ollama[671968]: INFO [main] HTTP server listening | hostname="127.0.0.1" n_threads_http="63" port="38305" tid="138018617298944" timestamp=1717336048 Jun 02 16:47:28 Ai ollama[671968]: DEBUG [load_model] Multi Modal Mode Enabled | tid="138018617298944" timestamp=1717336048 Jun 02 16:47:28 Ai ollama[670252]: ggml_cuda_init: GGML_CUDA_FORCE_MMQ: yes Jun 02 16:47:28 Ai ollama[670252]: ggml_cuda_init: CUDA_USE_TENSOR_CORES: no Jun 02 16:47:28 Ai ollama[670252]: ggml_cuda_init: found 1 CUDA devices: Jun 02 16:47:28 Ai ollama[670252]: Device 0: NVIDIA GeForce RTX 3060, compute capability 8.6, VMM: yes Jun 02 16:47:28 Ai ollama[670252]: GGML_ASSERT: /go/src/github.com/ollama/ollama/llm/llama.cpp/examples/llava/clip.cpp:1024: new_clip->has_llava_projector Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.287+03:00 level=ERROR source=sched.go:344 msg="error loading llama server" error="llama runner process has terminated: signal: aborted " Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.287+03:00 level=DEBUG source=sched.go:347 msg="triggering expiration for failed load" model=/Models/models/blobs/sha256-010ec3ba94cb5ad2d9c8f95f46f01c6d80f83deab9df0a0831334ea45afff3e2 Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.287+03:00 level=DEBUG source=sched.go:258 msg="runner expired event received" modelPath=/Models/models/blobs/sha256-010ec3ba94cb5ad2d9c8f95f46f01c6d80f83deab9df0a0831334ea45afff3e2 Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.287+03:00 level=DEBUG source=sched.go:274 msg="got lock to unload" modelPath=/Models/models/blobs/sha256-010ec3ba94cb5ad2d9c8f95f46f01c6d80f83deab9df0a0831334ea45afff3e2 Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.287+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs" Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.287+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so* Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.287+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]" Jun 02 16:47:28 Ai ollama[670252]: [GIN] 2024/06/02 - 16:47:28 | 500 | 1.789362982s | 127.0.0.1 | POST "/api/chat" Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.290+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]" Jun 02 16:47:28 Ai ollama[670252]: CUDA driver version: 12.4 Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.290+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.290+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2" Jun 02 16:47:28 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb Jun 02 16:47:28 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb Jun 02 16:47:28 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6 Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.485+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu" Jun 02 16:47:28 Ai ollama[670252]: releasing nvcuda library Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.485+03:00 level=DEBUG source=server.go:990 msg="stopping llama server" Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.485+03:00 level=DEBUG source=sched.go:279 msg="runner released" modelPath=/Models/models/blobs/sha256-010ec3ba94cb5ad2d9c8f95f46f01c6d80f83deab9df0a0831334ea45afff3e2 Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.735+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs" Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.735+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so* Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.735+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]" Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.738+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]" Jun 02 16:47:28 Ai ollama[670252]: CUDA driver version: 12.4 Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.738+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.738+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2" Jun 02 16:47:28 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb Jun 02 16:47:28 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb Jun 02 16:47:28 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6 Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.893+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu" Jun 02 16:47:28 Ai ollama[670252]: releasing nvcuda library Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.986+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs" Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.986+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so* Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.986+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]" Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.988+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]" Jun 02 16:47:28 Ai ollama[670252]: CUDA driver version: 12.4 Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.988+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 Jun 02 16:47:28 Ai ollama[670252]: time=2024-06-02T16:47:28.988+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2" Jun 02 16:47:29 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb Jun 02 16:47:29 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb Jun 02 16:47:29 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6 Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.156+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu" Jun 02 16:47:29 Ai ollama[670252]: releasing nvcuda library Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.236+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs" Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.236+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so* Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.236+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]" Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.238+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]" Jun 02 16:47:29 Ai ollama[670252]: CUDA driver version: 12.4 Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.238+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.238+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2" Jun 02 16:47:29 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb Jun 02 16:47:29 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb Jun 02 16:47:29 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6 Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.408+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu" Jun 02 16:47:29 Ai ollama[670252]: releasing nvcuda library Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.486+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs" Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.486+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so* Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.486+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]" Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.488+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]" Jun 02 16:47:29 Ai ollama[670252]: CUDA driver version: 12.4 Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.488+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.488+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2" Jun 02 16:47:29 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb Jun 02 16:47:29 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb Jun 02 16:47:29 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6 Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.640+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu" Jun 02 16:47:29 Ai ollama[670252]: releasing nvcuda library Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.735+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs" Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.736+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so* Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.736+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]" Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.738+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]" Jun 02 16:47:29 Ai ollama[670252]: CUDA driver version: 12.4 Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.738+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.738+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2" Jun 02 16:47:29 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb Jun 02 16:47:29 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb Jun 02 16:47:29 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6 Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.888+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu" Jun 02 16:47:29 Ai ollama[670252]: releasing nvcuda library Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.985+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs" Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.986+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so* Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.986+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]" Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.988+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]" Jun 02 16:47:29 Ai ollama[670252]: CUDA driver version: 12.4 Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.988+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 Jun 02 16:47:29 Ai ollama[670252]: time=2024-06-02T16:47:29.988+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2" Jun 02 16:47:30 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb Jun 02 16:47:30 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb Jun 02 16:47:30 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6 Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.154+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu" Jun 02 16:47:30 Ai ollama[670252]: releasing nvcuda library Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.235+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs" Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.236+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so* Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.236+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]" Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.238+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]" Jun 02 16:47:30 Ai ollama[670252]: CUDA driver version: 12.4 Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.238+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.238+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2" Jun 02 16:47:30 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb Jun 02 16:47:30 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb Jun 02 16:47:30 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6 Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.405+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu" Jun 02 16:47:30 Ai ollama[670252]: releasing nvcuda library Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.485+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs" Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.485+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so* Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.485+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]" Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.487+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]" Jun 02 16:47:30 Ai ollama[670252]: CUDA driver version: 12.4 Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.487+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.487+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2" Jun 02 16:47:30 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb Jun 02 16:47:30 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb Jun 02 16:47:30 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6 Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.639+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu" Jun 02 16:47:30 Ai ollama[670252]: releasing nvcuda library Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.735+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs" Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.735+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so* Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.735+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]" Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.738+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]" Jun 02 16:47:30 Ai ollama[670252]: CUDA driver version: 12.4 Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.738+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.738+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2" Jun 02 16:47:30 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb Jun 02 16:47:30 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb Jun 02 16:47:30 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6 Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.892+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu" Jun 02 16:47:30 Ai ollama[670252]: releasing nvcuda library Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.986+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs" Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.986+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so* Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.986+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]" Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.988+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]" Jun 02 16:47:30 Ai ollama[670252]: CUDA driver version: 12.4 Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.988+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 Jun 02 16:47:30 Ai ollama[670252]: time=2024-06-02T16:47:30.988+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2" Jun 02 16:47:31 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb Jun 02 16:47:31 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb Jun 02 16:47:31 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6 Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.155+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu" Jun 02 16:47:31 Ai ollama[670252]: releasing nvcuda library Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.235+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs" Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.235+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so* Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.235+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]" Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.238+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]" Jun 02 16:47:31 Ai ollama[670252]: CUDA driver version: 12.4 Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.238+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.238+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2" Jun 02 16:47:31 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb Jun 02 16:47:31 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb Jun 02 16:47:31 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6 Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.400+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu" Jun 02 16:47:31 Ai ollama[670252]: releasing nvcuda library Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.486+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs" Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.486+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so* Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.486+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]" Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.488+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]" Jun 02 16:47:31 Ai ollama[670252]: CUDA driver version: 12.4 Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.488+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.488+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2" Jun 02 16:47:31 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb Jun 02 16:47:31 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb Jun 02 16:47:31 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6 Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.650+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu" Jun 02 16:47:31 Ai ollama[670252]: releasing nvcuda library Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.736+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs" Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.736+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so* Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.736+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]" Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.738+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]" Jun 02 16:47:31 Ai ollama[670252]: CUDA driver version: 12.4 Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.738+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.738+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2" Jun 02 16:47:31 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb Jun 02 16:47:31 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb Jun 02 16:47:31 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6 Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.883+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu" Jun 02 16:47:31 Ai ollama[670252]: releasing nvcuda library Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.985+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs" Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.986+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so* Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.986+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]" Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.988+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]" Jun 02 16:47:31 Ai ollama[670252]: CUDA driver version: 12.4 Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.988+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 Jun 02 16:47:31 Ai ollama[670252]: time=2024-06-02T16:47:31.988+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2" Jun 02 16:47:32 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb Jun 02 16:47:32 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb Jun 02 16:47:32 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6 Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.150+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu" Jun 02 16:47:32 Ai ollama[670252]: releasing nvcuda library Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.235+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs" Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.235+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so* Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.235+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]" Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.237+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]" Jun 02 16:47:32 Ai ollama[670252]: CUDA driver version: 12.4 Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.238+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.238+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2" Jun 02 16:47:32 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb Jun 02 16:47:32 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb Jun 02 16:47:32 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6 Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.405+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu" Jun 02 16:47:32 Ai ollama[670252]: releasing nvcuda library Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.486+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs" Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.486+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so* Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.486+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]" Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.488+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]" Jun 02 16:47:32 Ai ollama[670252]: CUDA driver version: 12.4 Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.488+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.488+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2" Jun 02 16:47:32 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb Jun 02 16:47:32 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb Jun 02 16:47:32 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6 Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.657+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu" Jun 02 16:47:32 Ai ollama[670252]: releasing nvcuda library Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.736+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs" Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.736+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so* Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.736+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]" Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.738+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]" Jun 02 16:47:32 Ai ollama[670252]: CUDA driver version: 12.4 Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.738+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.738+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2" Jun 02 16:47:32 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb Jun 02 16:47:32 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb Jun 02 16:47:32 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6 Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.894+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu" Jun 02 16:47:32 Ai ollama[670252]: releasing nvcuda library Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.985+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs" Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.986+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so* Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.986+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]" Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.988+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]" Jun 02 16:47:32 Ai ollama[670252]: CUDA driver version: 12.4 Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.988+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 Jun 02 16:47:32 Ai ollama[670252]: time=2024-06-02T16:47:32.988+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2" Jun 02 16:47:33 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb Jun 02 16:47:33 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb Jun 02 16:47:33 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6 Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.155+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu" Jun 02 16:47:33 Ai ollama[670252]: releasing nvcuda library Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.235+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs" Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.235+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so* Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.235+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]" Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.238+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]" Jun 02 16:47:33 Ai ollama[670252]: CUDA driver version: 12.4 Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.238+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.238+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2" Jun 02 16:47:33 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb Jun 02 16:47:33 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb Jun 02 16:47:33 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6 Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.404+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu" Jun 02 16:47:33 Ai ollama[670252]: releasing nvcuda library Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.486+03:00 level=WARN source=sched.go:512 msg="gpu VRAM usage didn't recover within timeout" seconds=5.199123819 Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.486+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs" Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.486+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so* Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.486+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]" Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.486+03:00 level=DEBUG source=sched.go:283 msg="sending an unloaded event" modelPath=/Models/models/blobs/sha256-010ec3ba94cb5ad2d9c8f95f46f01c6d80f83deab9df0a0831334ea45afff3e2 Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.486+03:00 level=DEBUG source=sched.go:206 msg="ignoring unload event with no pending requests" Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.488+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]" Jun 02 16:47:33 Ai ollama[670252]: CUDA driver version: 12.4 Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.488+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.488+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2" Jun 02 16:47:33 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb Jun 02 16:47:33 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb Jun 02 16:47:33 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6 Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.634+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu" Jun 02 16:47:33 Ai ollama[670252]: releasing nvcuda library Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.736+03:00 level=WARN source=sched.go:512 msg="gpu VRAM usage didn't recover within timeout" seconds=5.448901251 Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.736+03:00 level=DEBUG source=gpu.go:132 msg="Detecting GPUs" Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.736+03:00 level=DEBUG source=gpu.go:274 msg="Searching for GPU library" name=libcuda.so* Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.736+03:00 level=DEBUG source=gpu.go:293 msg="gpu library search" globs="[/libcuda.so** /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]" Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.738+03:00 level=DEBUG source=gpu.go:326 msg="discovered GPU libraries" paths="[/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 /usr/lib32/libcuda.so.550.78]" Jun 02 16:47:33 Ai ollama[670252]: CUDA driver version: 12.4 Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.738+03:00 level=DEBUG source=gpu.go:137 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.78 Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.738+03:00 level=DEBUG source=cpu_common.go:11 msg="CPU has AVX2" Jun 02 16:47:33 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA totalMem 12037 mb Jun 02 16:47:33 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] CUDA freeMem 9534 mb Jun 02 16:47:33 Ai ollama[670252]: [GPU-7bdbeb9f-0254-922f-e41b-a3c737bad3fe] Compute Capability 8.6 Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.896+03:00 level=DEBUG source=amd_linux.go:322 msg="amdgpu driver not detected /sys/module/amdgpu" Jun 02 16:47:33 Ai ollama[670252]: releasing nvcuda library Jun 02 16:47:33 Ai ollama[670252]: time=2024-06-02T16:47:33.985+03:00 level=WARN source=sched.go:512 msg="gpu VRAM usage didn't recover within timeout" seconds=5.698670655 ```
GiteaMirror commented 2026-04-22 07:17:09 -05:00
Author
Owner
Copy Link

@rick-github commented on GitHub (Jun 5, 2024):

One cause of this is because ollama tries to offload too many layers to the GPU. See https://github.com/ollama/ollama/issues/4799#issuecomment-2148573008 on ways to mitigate.

<!-- gh-comment-id:2151012725 --> @rick-github commented on GitHub (Jun 5, 2024): One cause of this is because ollama tries to offload too many layers to the GPU. See https://github.com/ollama/ollama/issues/4799#issuecomment-2148573008 on ways to mitigate.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
 python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
No Label bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#28761
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?