github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-05-22 05:31:43 -05:00
Code Issues 16.9k Packages Projects Releases 122 Wiki Activity

[GH-ISSUE #15174] GGML_ASSERT(i01 >= 0 && i01 < ne01) failed #35473

New Issue
Open
opened 2026-04-22 19:58:30 -05:00 by GiteaMirror · 5 comments
GiteaMirror commented 2026-04-22 19:58:30 -05:00
Owner
Copy Link

Originally created by @n4s3r on GitHub (Mar 31, 2026).
Original GitHub issue: https://github.com/ollama/ollama/issues/15174

What is the issue?

https://github.com/nearai/ironclaw/issues/1827 is this error caused by Ollama or by ironclaw?

Relevant log output

ggml_vulkan: Found 2 Vulkan devices:
ggml_vulkan: 0 = NVIDIA GeForce RTX 3050 Ti Laptop GPU (NVIDIA) | uma: 0 | fp16: 1 | bf16: 1 | warp size: 32 | shared memory: 49152 | int dot: 1 | matrix cores: NV_coopmat2
ggml_vulkan: 1 = Intel(R) Iris(R) Xe Graphics (Intel Corporation) | uma: 1 | fp16: 1 | bf16: 0 | warp size: 32 | shared memory: 32768 | int dot: 1 | matrix cores: none
load_backend: loaded Vulkan backend from C:\Users\user\AppData\Local\Programs\Ollama\lib\ollama\vulkan\ggml-vulkan.dll
time=2026-03-31T16:06:28.272+02:00 level=INFO source=ggml.go:104 msg=system CPU.0.SSE3=1 CPU.0.SSSE3=1 CPU.0.AVX=1 CPU.0.AVX_VNNI=1 CPU.0.AVX2=1 CPU.0.F16C=1 CPU.0.FMA=1 CPU.0.BMI2=1 CPU.0.LLAMAFILE=1 CPU.1.LLAMAFILE=1 CUDA.0.ARCHS=750,800,860,870,890,900,1000,1030,1100,1200,1210 CUDA.0.USE_GRAPHS=1 CUDA.0.PEER_MAX_BATCH_SIZE=128 compiler=cgo(clang)
ggml_backend_vk_get_device_memory called: uuid a4f6355b-902f-14e3-2b28-2189eb9ad638
ggml_backend_vk_get_device_memory called: luid 0x0000000000013583
ggml_dxgi_pdh_init called
DXGI + PDH Initialized. Getting GPU free memory info
[DXGI] Adapter Description: NVIDIA GeForce RTX 3050 Ti Laptop GPU, LUID: 0x0000000000013583, Dedicated: 3.87 GB, Shared: 7.85 GB
[DXGI] Adapter Description: Intel(R) Iris(R) Xe Graphics, LUID: 0x0000000000013232, Dedicated: 0.12 GB, Shared: 7.85 GB
[DXGI] Adapter Description: Microsoft Basic Render Driver, LUID: 0x0000000000013510, Dedicated: 0.00 GB, Shared: 7.85 GB
Discrete GPU (NVIDIA GeForce RTX 3050 Ti Laptop GPU) with LUID 0x0000000000013583 detected. Dedicated Total: 4157603840.00 bytes (3.87 GB), Dedicated Usage: 161857536.00 bytes (0.15 GB)
ggml_backend_vk_get_device_memory utilizing DXGI + PDH memory reporting free: 3995746304 total: 4157603840
ggml_backend_vk_get_device_memory called: uuid 8680a646-0c00-0000-0000-000000000000
ggml_backend_vk_get_device_memory called: luid 0x0000000000013232
ggml_dxgi_pdh_init called
DXGI + PDH Initialized. Getting GPU free memory info
[DXGI] Adapter Description: NVIDIA GeForce RTX 3050 Ti Laptop GPU, LUID: 0x0000000000013583, Dedicated: 3.87 GB, Shared: 7.85 GB
[DXGI] Adapter Description: Intel(R) Iris(R) Xe Graphics, LUID: 0x0000000000013232, Dedicated: 0.12 GB, Shared: 7.85 GB
[DXGI] Adapter Description: Microsoft Basic Render Driver, LUID: 0x0000000000013510, Dedicated: 0.00 GB, Shared: 7.85 GB
Integrated GPU (Intel(R) Iris(R) Xe Graphics) with LUID 0x0000000000013232 detected. Shared Total: 8433055744.00 bytes (7.85 GB), Shared Usage: 3236061184.00 bytes (3.01 GB), Dedicated Total: 134217728.00 bytes (0.12 GB), Dedicated Usage: 0.00 bytes (0.00 GB)
ggml_backend_vk_get_device_memory utilizing DXGI + PDH memory reporting free: 5331212288 total: 8567273472
time=2026-03-31T16:06:29.943+02:00 level=INFO source=runner.go:1284 msg=load request="{Operation:alloc LoraPath:[] Parallel:1 BatchSize:512 FlashAttention:Disabled KvSize:512 KvCacheType: NumThreads:6 GPULayers:13[ID:GPU-a4f6355b-902f-14e3-2b28-2189eb9ad638 Layers:13(0..12)] MultiUserCache:false ProjectorPath: MainGPU:0 UseMmap:false}"
ggml_backend_vk_get_device_memory called: uuid a4f6355b-902f-14e3-2b28-2189eb9ad638
ggml_backend_vk_get_device_memory called: luid 0x0000000000013583
ggml_dxgi_pdh_init called
DXGI + PDH Initialized. Getting GPU free memory info
[DXGI] Adapter Description: NVIDIA GeForce RTX 3050 Ti Laptop GPU, LUID: 0x0000000000013583, Dedicated: 3.87 GB, Shared: 7.85 GB
[DXGI] Adapter Description: Intel(R) Iris(R) Xe Graphics, LUID: 0x0000000000013232, Dedicated: 0.12 GB, Shared: 7.85 GB
[DXGI] Adapter Description: Microsoft Basic Render Driver, LUID: 0x0000000000013510, Dedicated: 0.00 GB, Shared: 7.85 GB
Discrete GPU (NVIDIA GeForce RTX 3050 Ti Laptop GPU) with LUID 0x0000000000013583 detected. Dedicated Total: 4157603840.00 bytes (3.87 GB), Dedicated Usage: 176545792.00 bytes (0.16 GB)
ggml_backend_vk_get_device_memory utilizing DXGI + PDH memory reporting free: 3981058048 total: 4157603840
ggml_backend_vk_get_device_memory called: uuid 8680a646-0c00-0000-0000-000000000000
ggml_backend_vk_get_device_memory called: luid 0x0000000000013232
ggml_dxgi_pdh_init called
DXGI + PDH Initialized. Getting GPU free memory info
[DXGI] Adapter Description: NVIDIA GeForce RTX 3050 Ti Laptop GPU, LUID: 0x0000000000013583, Dedicated: 3.87 GB, Shared: 7.85 GB
[DXGI] Adapter Description: Intel(R) Iris(R) Xe Graphics, LUID: 0x0000000000013232, Dedicated: 0.12 GB, Shared: 7.85 GB
[DXGI] Adapter Description: Microsoft Basic Render Driver, LUID: 0x0000000000013510, Dedicated: 0.00 GB, Shared: 7.85 GB
Integrated GPU (Intel(R) Iris(R) Xe Graphics) with LUID 0x0000000000013232 detected. Shared Total: 8433055744.00 bytes (7.85 GB), Shared Usage: 3225890816.00 bytes (3.00 GB), Dedicated Total: 134217728.00 bytes (0.12 GB), Dedicated Usage: 0.00 bytes (0.00 GB)
ggml_backend_vk_get_device_memory utilizing DXGI + PDH memory reporting free: 5341382656 total: 8567273472
time=2026-03-31T16:06:30.824+02:00 level=INFO source=runner.go:1284 msg=load request="{Operation:commit LoraPath:[] Parallel:1 BatchSize:512 FlashAttention:Disabled KvSize:512 KvCacheType: NumThreads:6 GPULayers:13[ID:GPU-a4f6355b-902f-14e3-2b28-2189eb9ad638 Layers:13(0..12)] MultiUserCache:false ProjectorPath: MainGPU:0 UseMmap:false}"
time=2026-03-31T16:06:30.824+02:00 level=INFO source=device.go:240 msg="model weights" device=CUDA0 size="906.8 MiB"
time=2026-03-31T16:06:30.825+02:00 level=INFO source=device.go:245 msg="model weights" device=CPU size="366.3 MiB"
time=2026-03-31T16:06:30.825+02:00 level=INFO source=device.go:262 msg="compute graph" device=CUDA0 size="28.0 MiB"
time=2026-03-31T16:06:30.825+02:00 level=INFO source=device.go:267 msg="compute graph" device=CPU size="1.5 MiB"
time=2026-03-31T16:06:30.825+02:00 level=INFO source=device.go:272 msg="total memory" size="1.3 GiB"
time=2026-03-31T16:06:30.825+02:00 level=INFO source=sched.go:561 msg="loaded runners" count=1
time=2026-03-31T16:06:30.824+02:00 level=INFO source=ggml.go:482 msg="offloading 12 repeating layers to GPU"
time=2026-03-31T16:06:30.840+02:00 level=INFO source=ggml.go:489 msg="offloading output layer to GPU"
time=2026-03-31T16:06:30.840+02:00 level=INFO source=ggml.go:494 msg="offloaded 13/13 layers to GPU"
time=2026-03-31T16:06:30.839+02:00 level=INFO source=server.go:1352 msg="waiting for llama runner to start responding"
time=2026-03-31T16:06:30.853+02:00 level=INFO source=server.go:1386 msg="waiting for server to become available" status="llm server loading model"
time=2026-03-31T16:06:36.400+02:00 level=INFO source=server.go:1390 msg="llama runner started in 18.25 seconds"
C:/a/ollama/ollama/ml/backend/ggml/ggml/src/ggml-cpu/ops.cpp:4666: GGML_ASSERT(i01 >= 0 && i01 < ne01) failed
[GIN] 2026/03/31 - 16:06:37 | 400 |   32.0813551s |       127.0.0.1 | POST     "/api/embed"
time=2026-03-31T16:06:37.493+02:00 level=ERROR source=server.go:304 msg="llama runner terminated" error="exit status 1"

OS

Windows

GPU

Intel, Nvidia

CPU

Intel

Ollama version

0.18.3

Originally created by @n4s3r on GitHub (Mar 31, 2026). Original GitHub issue: https://github.com/ollama/ollama/issues/15174 ### What is the issue? https://github.com/nearai/ironclaw/issues/1827 is this error caused by Ollama or by ironclaw? ### Relevant log output ```shell ggml_vulkan: Found 2 Vulkan devices: ggml_vulkan: 0 = NVIDIA GeForce RTX 3050 Ti Laptop GPU (NVIDIA) | uma: 0 | fp16: 1 | bf16: 1 | warp size: 32 | shared memory: 49152 | int dot: 1 | matrix cores: NV_coopmat2 ggml_vulkan: 1 = Intel(R) Iris(R) Xe Graphics (Intel Corporation) | uma: 1 | fp16: 1 | bf16: 0 | warp size: 32 | shared memory: 32768 | int dot: 1 | matrix cores: none load_backend: loaded Vulkan backend from C:\Users\user\AppData\Local\Programs\Ollama\lib\ollama\vulkan\ggml-vulkan.dll time=2026-03-31T16:06:28.272+02:00 level=INFO source=ggml.go:104 msg=system CPU.0.SSE3=1 CPU.0.SSSE3=1 CPU.0.AVX=1 CPU.0.AVX_VNNI=1 CPU.0.AVX2=1 CPU.0.F16C=1 CPU.0.FMA=1 CPU.0.BMI2=1 CPU.0.LLAMAFILE=1 CPU.1.LLAMAFILE=1 CUDA.0.ARCHS=750,800,860,870,890,900,1000,1030,1100,1200,1210 CUDA.0.USE_GRAPHS=1 CUDA.0.PEER_MAX_BATCH_SIZE=128 compiler=cgo(clang) ggml_backend_vk_get_device_memory called: uuid a4f6355b-902f-14e3-2b28-2189eb9ad638 ggml_backend_vk_get_device_memory called: luid 0x0000000000013583 ggml_dxgi_pdh_init called DXGI + PDH Initialized. Getting GPU free memory info [DXGI] Adapter Description: NVIDIA GeForce RTX 3050 Ti Laptop GPU, LUID: 0x0000000000013583, Dedicated: 3.87 GB, Shared: 7.85 GB [DXGI] Adapter Description: Intel(R) Iris(R) Xe Graphics, LUID: 0x0000000000013232, Dedicated: 0.12 GB, Shared: 7.85 GB [DXGI] Adapter Description: Microsoft Basic Render Driver, LUID: 0x0000000000013510, Dedicated: 0.00 GB, Shared: 7.85 GB Discrete GPU (NVIDIA GeForce RTX 3050 Ti Laptop GPU) with LUID 0x0000000000013583 detected. Dedicated Total: 4157603840.00 bytes (3.87 GB), Dedicated Usage: 161857536.00 bytes (0.15 GB) ggml_backend_vk_get_device_memory utilizing DXGI + PDH memory reporting free: 3995746304 total: 4157603840 ggml_backend_vk_get_device_memory called: uuid 8680a646-0c00-0000-0000-000000000000 ggml_backend_vk_get_device_memory called: luid 0x0000000000013232 ggml_dxgi_pdh_init called DXGI + PDH Initialized. Getting GPU free memory info [DXGI] Adapter Description: NVIDIA GeForce RTX 3050 Ti Laptop GPU, LUID: 0x0000000000013583, Dedicated: 3.87 GB, Shared: 7.85 GB [DXGI] Adapter Description: Intel(R) Iris(R) Xe Graphics, LUID: 0x0000000000013232, Dedicated: 0.12 GB, Shared: 7.85 GB [DXGI] Adapter Description: Microsoft Basic Render Driver, LUID: 0x0000000000013510, Dedicated: 0.00 GB, Shared: 7.85 GB Integrated GPU (Intel(R) Iris(R) Xe Graphics) with LUID 0x0000000000013232 detected. Shared Total: 8433055744.00 bytes (7.85 GB), Shared Usage: 3236061184.00 bytes (3.01 GB), Dedicated Total: 134217728.00 bytes (0.12 GB), Dedicated Usage: 0.00 bytes (0.00 GB) ggml_backend_vk_get_device_memory utilizing DXGI + PDH memory reporting free: 5331212288 total: 8567273472 time=2026-03-31T16:06:29.943+02:00 level=INFO source=runner.go:1284 msg=load request="{Operation:alloc LoraPath:[] Parallel:1 BatchSize:512 FlashAttention:Disabled KvSize:512 KvCacheType: NumThreads:6 GPULayers:13[ID:GPU-a4f6355b-902f-14e3-2b28-2189eb9ad638 Layers:13(0..12)] MultiUserCache:false ProjectorPath: MainGPU:0 UseMmap:false}" ggml_backend_vk_get_device_memory called: uuid a4f6355b-902f-14e3-2b28-2189eb9ad638 ggml_backend_vk_get_device_memory called: luid 0x0000000000013583 ggml_dxgi_pdh_init called DXGI + PDH Initialized. Getting GPU free memory info [DXGI] Adapter Description: NVIDIA GeForce RTX 3050 Ti Laptop GPU, LUID: 0x0000000000013583, Dedicated: 3.87 GB, Shared: 7.85 GB [DXGI] Adapter Description: Intel(R) Iris(R) Xe Graphics, LUID: 0x0000000000013232, Dedicated: 0.12 GB, Shared: 7.85 GB [DXGI] Adapter Description: Microsoft Basic Render Driver, LUID: 0x0000000000013510, Dedicated: 0.00 GB, Shared: 7.85 GB Discrete GPU (NVIDIA GeForce RTX 3050 Ti Laptop GPU) with LUID 0x0000000000013583 detected. Dedicated Total: 4157603840.00 bytes (3.87 GB), Dedicated Usage: 176545792.00 bytes (0.16 GB) ggml_backend_vk_get_device_memory utilizing DXGI + PDH memory reporting free: 3981058048 total: 4157603840 ggml_backend_vk_get_device_memory called: uuid 8680a646-0c00-0000-0000-000000000000 ggml_backend_vk_get_device_memory called: luid 0x0000000000013232 ggml_dxgi_pdh_init called DXGI + PDH Initialized. Getting GPU free memory info [DXGI] Adapter Description: NVIDIA GeForce RTX 3050 Ti Laptop GPU, LUID: 0x0000000000013583, Dedicated: 3.87 GB, Shared: 7.85 GB [DXGI] Adapter Description: Intel(R) Iris(R) Xe Graphics, LUID: 0x0000000000013232, Dedicated: 0.12 GB, Shared: 7.85 GB [DXGI] Adapter Description: Microsoft Basic Render Driver, LUID: 0x0000000000013510, Dedicated: 0.00 GB, Shared: 7.85 GB Integrated GPU (Intel(R) Iris(R) Xe Graphics) with LUID 0x0000000000013232 detected. Shared Total: 8433055744.00 bytes (7.85 GB), Shared Usage: 3225890816.00 bytes (3.00 GB), Dedicated Total: 134217728.00 bytes (0.12 GB), Dedicated Usage: 0.00 bytes (0.00 GB) ggml_backend_vk_get_device_memory utilizing DXGI + PDH memory reporting free: 5341382656 total: 8567273472 time=2026-03-31T16:06:30.824+02:00 level=INFO source=runner.go:1284 msg=load request="{Operation:commit LoraPath:[] Parallel:1 BatchSize:512 FlashAttention:Disabled KvSize:512 KvCacheType: NumThreads:6 GPULayers:13[ID:GPU-a4f6355b-902f-14e3-2b28-2189eb9ad638 Layers:13(0..12)] MultiUserCache:false ProjectorPath: MainGPU:0 UseMmap:false}" time=2026-03-31T16:06:30.824+02:00 level=INFO source=device.go:240 msg="model weights" device=CUDA0 size="906.8 MiB" time=2026-03-31T16:06:30.825+02:00 level=INFO source=device.go:245 msg="model weights" device=CPU size="366.3 MiB" time=2026-03-31T16:06:30.825+02:00 level=INFO source=device.go:262 msg="compute graph" device=CUDA0 size="28.0 MiB" time=2026-03-31T16:06:30.825+02:00 level=INFO source=device.go:267 msg="compute graph" device=CPU size="1.5 MiB" time=2026-03-31T16:06:30.825+02:00 level=INFO source=device.go:272 msg="total memory" size="1.3 GiB" time=2026-03-31T16:06:30.825+02:00 level=INFO source=sched.go:561 msg="loaded runners" count=1 time=2026-03-31T16:06:30.824+02:00 level=INFO source=ggml.go:482 msg="offloading 12 repeating layers to GPU" time=2026-03-31T16:06:30.840+02:00 level=INFO source=ggml.go:489 msg="offloading output layer to GPU" time=2026-03-31T16:06:30.840+02:00 level=INFO source=ggml.go:494 msg="offloaded 13/13 layers to GPU" time=2026-03-31T16:06:30.839+02:00 level=INFO source=server.go:1352 msg="waiting for llama runner to start responding" time=2026-03-31T16:06:30.853+02:00 level=INFO source=server.go:1386 msg="waiting for server to become available" status="llm server loading model" time=2026-03-31T16:06:36.400+02:00 level=INFO source=server.go:1390 msg="llama runner started in 18.25 seconds" C:/a/ollama/ollama/ml/backend/ggml/ggml/src/ggml-cpu/ops.cpp:4666: GGML_ASSERT(i01 >= 0 && i01 < ne01) failed [GIN] 2026/03/31 - 16:06:37 | 400 | 32.0813551s | 127.0.0.1 | POST "/api/embed" time=2026-03-31T16:06:37.493+02:00 level=ERROR source=server.go:304 msg="llama runner terminated" error="exit status 1" ``` ### OS Windows ### GPU Intel, Nvidia ### CPU Intel ### Ollama version 0.18.3
GiteaMirror added the bug label 2026-04-22 19:58:30 -05:00
GiteaMirror commented 2026-04-22 19:58:31 -05:00
Author
Owner
Copy Link

@rick-github commented on GitHub (Mar 31, 2026):

Which model?

<!-- gh-comment-id:4163034038 --> @rick-github commented on GitHub (Mar 31, 2026): Which model?
GiteaMirror commented 2026-04-22 19:58:31 -05:00
Author
Owner
Copy Link

@n4s3r commented on GitHub (Mar 31, 2026):

nomic-embed-text-v2-moe:latest.
I tried testing the model with "ollama run" with no errors.

<!-- gh-comment-id:4163050064 --> @n4s3r commented on GitHub (Mar 31, 2026): nomic-embed-text-v2-moe:latest. I tried testing the model with "ollama run" with no errors.
GiteaMirror commented 2026-04-22 19:58:31 -05:00
Author
Owner
Copy Link

@n4s3r commented on GitHub (Apr 6, 2026):

Here a is extended version of the logs (with OLLAMA_DEBUG=1):

[DXGI] Adapter Description: NVIDIA GeForce RTX 3050 Ti Laptop GPU, LUID: 0x0000000000012AB7, Dedicated: 3.87 GB, Shared: 7.85 GB
[DXGI] Adapter Description: Intel(R) Iris(R) Xe Graphics, LUID: 0x00000000000126D6, Dedicated: 0.12 GB, Shared: 7.85 GB
[DXGI] Adapter Description: Microsoft Basic Render Driver, LUID: 0x0000000000012A29, Dedicated: 0.00 GB, Shared: 7.85 GB
Integrated GPU (Intel(R) Iris(R) Xe Graphics) with LUID 0x00000000000126d6 detected. Shared Total: 8433055744.00 bytes (7.85 GB), Shared Usage: 1710690304.00 bytes (1.59 GB), Dedicated Total: 134217728.00 bytes (0.12 GB), Dedicated Usage: 0.00 bytes (0.00 GB)
ggml_backend_vk_get_device_memory utilizing DXGI + PDH memory reporting free: 6856583168 total: 8567273472
time=2026-04-06T15:34:50.190+02:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=tokenizer.ggml.cls_token_id default=0
time=2026-04-06T15:34:50.190+02:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=tokenizer.ggml.separator_token_id default=0
time=2026-04-06T15:34:50.190+02:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=nomic-bert-moe.normalize_embeddings default=false
time=2026-04-06T15:34:50.194+02:00 level=DEBUG source=ggml.go:852 msg="compute graph" nodes=467 splits=4
time=2026-04-06T15:34:50.196+02:00 level=DEBUG source=ggml.go:852 msg="compute graph" nodes=467 splits=2
time=2026-04-06T15:34:50.196+02:00 level=DEBUG source=device.go:240 msg="model weights" device=CUDA0 size="906.8 MiB"
time=2026-04-06T15:34:50.197+02:00 level=DEBUG source=device.go:245 msg="model weights" device=CPU size="366.3 MiB"
time=2026-04-06T15:34:50.197+02:00 level=DEBUG source=device.go:262 msg="compute graph" device=CUDA0 size="28.0 MiB"
time=2026-04-06T15:34:50.197+02:00 level=DEBUG source=device.go:267 msg="compute graph" device=CPU size="1.5 MiB"
time=2026-04-06T15:34:50.197+02:00 level=DEBUG source=device.go:272 msg="total memory" size="1.3 GiB"
time=2026-04-06T15:34:50.197+02:00 level=DEBUG source=server.go:784 msg=memory success=true required.InputWeights=384082944 required.CPU.Graph=1572864 required.CUDA0.ID=GPU-a4f6355b-902f-14e3-2b28-2189eb9ad638 required.CUDA0.Weights="[14195712 80265216 14195712 80265216 14195712 80265216 14195712 80265216 14195712 80265216 14195712 80265216 384073728]" required.CUDA0.Graph=29360128
time=2026-04-06T15:34:50.197+02:00 level=DEBUG source=server.go:978 msg="available gpu" id=GPU-a4f6355b-902f-14e3-2b28-2189eb9ad638 library=CUDA "available layer vram"="3.2 GiB" backoff=0.00 minimum="457.0 MiB" overhead="0 B" graph="28.0 MiB"
time=2026-04-06T15:34:50.197+02:00 level=DEBUG source=server.go:978 msg="available gpu" id=8680a646-0c00-0000-0000-000000000000 library=Vulkan "available layer vram"="6.2 GiB" backoff=0.00 minimum="457.0 MiB" overhead="0 B" graph="0 B"
time=2026-04-06T15:34:50.197+02:00 level=DEBUG source=server.go:795 msg="new layout created" layers="13[ID:GPU-a4f6355b-902f-14e3-2b28-2189eb9ad638 Layers:13(0..12)]"
time=2026-04-06T15:34:50.198+02:00 level=INFO source=runner.go:1284 msg=load request="{Operation:commit LoraPath:[] Parallel:1 BatchSize:512 FlashAttention:Disabled KvSize:512 KvCacheType: NumThreads:6 GPULayers:13[ID:GPU-a4f6355b-902f-14e3-2b28-2189eb9ad638 Layers:13(0..12)] MultiUserCache:false ProjectorPath: MainGPU:0 UseMmap:false}"
time=2026-04-06T15:34:50.198+02:00 level=INFO source=ggml.go:482 msg="offloading 12 repeating layers to GPU"
time=2026-04-06T15:34:50.198+02:00 level=INFO source=ggml.go:489 msg="offloading output layer to GPU"
time=2026-04-06T15:34:50.198+02:00 level=INFO source=ggml.go:494 msg="offloaded 13/13 layers to GPU"
time=2026-04-06T15:34:50.198+02:00 level=INFO source=device.go:240 msg="model weights" device=CUDA0 size="906.8 MiB"
time=2026-04-06T15:34:50.199+02:00 level=INFO source=device.go:245 msg="model weights" device=CPU size="366.3 MiB"
time=2026-04-06T15:34:50.199+02:00 level=INFO source=device.go:262 msg="compute graph" device=CUDA0 size="28.0 MiB"
time=2026-04-06T15:34:50.200+02:00 level=INFO source=device.go:267 msg="compute graph" device=CPU size="1.5 MiB"
time=2026-04-06T15:34:50.200+02:00 level=INFO source=device.go:272 msg="total memory" size="1.3 GiB"
time=2026-04-06T15:34:50.213+02:00 level=INFO source=sched.go:561 msg="loaded runners" count=1
time=2026-04-06T15:34:50.220+02:00 level=INFO source=server.go:1352 msg="waiting for llama runner to start responding"
time=2026-04-06T15:34:50.220+02:00 level=INFO source=server.go:1386 msg="waiting for server to become available" status="llm server loading model"
time=2026-04-06T15:34:50.221+02:00 level=DEBUG source=server.go:1396 msg="model load progress 0.00"
time=2026-04-06T15:34:50.473+02:00 level=DEBUG source=server.go:1396 msg="model load progress 0.07"
time=2026-04-06T15:34:50.726+02:00 level=DEBUG source=server.go:1396 msg="model load progress 0.14"
time=2026-04-06T15:34:50.978+02:00 level=DEBUG source=server.go:1396 msg="model load progress 0.21"
time=2026-04-06T15:34:51.231+02:00 level=DEBUG source=server.go:1396 msg="model load progress 0.29"
time=2026-04-06T15:34:51.482+02:00 level=DEBUG source=server.go:1396 msg="model load progress 0.36"
time=2026-04-06T15:34:51.733+02:00 level=DEBUG source=server.go:1396 msg="model load progress 0.44"
time=2026-04-06T15:34:51.984+02:00 level=DEBUG source=server.go:1396 msg="model load progress 0.52"
time=2026-04-06T15:34:52.235+02:00 level=DEBUG source=server.go:1396 msg="model load progress 0.59"
time=2026-04-06T15:34:52.488+02:00 level=DEBUG source=server.go:1396 msg="model load progress 0.67"
time=2026-04-06T15:34:52.740+02:00 level=DEBUG source=server.go:1396 msg="model load progress 0.74"
time=2026-04-06T15:34:52.990+02:00 level=DEBUG source=server.go:1396 msg="model load progress 0.80"
time=2026-04-06T15:34:53.241+02:00 level=DEBUG source=server.go:1396 msg="model load progress 0.88"
time=2026-04-06T15:34:53.492+02:00 level=DEBUG source=server.go:1396 msg="model load progress 0.96"
time=2026-04-06T15:34:53.744+02:00 level=INFO source=server.go:1390 msg="llama runner started in 6.34 seconds"
time=2026-04-06T15:34:53.746+02:00 level=DEBUG source=sched.go:573 msg="finished setting up" runner.name=registry.ollama.ai/library/nomic-embed-text-v2-moe:latest runner.inference="[{ID:GPU-a4f6355b-902f-14e3-2b28-2189eb9ad638 Library:CUDA}]" runner.size="1.3 GiB" runner.vram="1.3 GiB" runner.parallel=1 runner.pid=6268 runner.model=C:\Users\user.ollama\models\blobs\sha256-a5db3381f2e514d3490a3a31fe70eb1a65e95016c85c6c2c23223b810806594f runner.num_ctx=4096
time=2026-04-06T15:34:53.924+02:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=general.alignment default=32
time=2026-04-06T15:34:53.947+02:00 level=DEBUG source=vocabulary.go:52 msg="adding bos token to prompt" id=0
time=2026-04-06T15:34:53.947+02:00 level=DEBUG source=vocabulary.go:61 msg="adding eos token to prompt" id=2
time=2026-04-06T15:34:53.947+02:00 level=DEBUG source=cache.go:151 msg="loading cache slot" id=0 cache=0 prompt=336 used=0 remaining=336
C:/a/ollama/ollama/ml/backend/ggml/ggml/src/ggml-cpu/ops.cpp:4666: GGML_ASSERT(i01 >= 0 && i01 < ne01) failed
[GIN] 2026/04/06 - 15:34:54 | 400 | 10.7645135s | 127.0.0.1 | POST "/api/embed"
time=2026-04-06T15:34:54.355+02:00 level=DEBUG source=sched.go:581 msg="context for request finished"
time=2026-04-06T15:34:54.355+02:00 level=DEBUG source=sched.go:309 msg="runner with non-zero duration has gone idle, adding timer" runner.name=registry.ollama.ai/library/nomic-embed-text-v2-moe:latest runner.inference="[{ID:GPU-a4f6355b-902f-14e3-2b28-2189eb9ad638 Library:CUDA}]" runner.size="1.3 GiB" runner.vram="1.3 GiB" runner.parallel=1 runner.pid=6268 runner.model=C:\Users\user.ollama\models\blobs\sha256-a5db3381f2e514d3490a3a31fe70eb1a65e95016c85c6c2c23223b810806594f runner.num_ctx=4096 duration=15m0s
time=2026-04-06T15:34:54.357+02:00 level=DEBUG source=sched.go:327 msg="after processing request finished event" runner.name=registry.ollama.ai/library/nomic-embed-text-v2-moe:latest runner.inference="[{ID:GPU-a4f6355b-902f-14e3-2b28-2189eb9ad638 Library:CUDA}]" runner.size="1.3 GiB" runner.vram="1.3 GiB" runner.parallel=1 runner.pid=6268 runner.model=C:\Users\user.ollama\models\blobs\sha256-a5db3381f2e514d3490a3a31fe70eb1a65e95016c85c6c2c23223b810806594f runner.num_ctx=4096 refCount=0
time=2026-04-06T15:34:54.459+02:00 level=ERROR source=server.go:304 msg="llama runner terminated" error="exit status 1"

<!-- gh-comment-id:4192548156 --> @n4s3r commented on GitHub (Apr 6, 2026): Here a is extended version of the logs (with OLLAMA_DEBUG=1): [DXGI] Adapter Description: NVIDIA GeForce RTX 3050 Ti Laptop GPU, LUID: 0x0000000000012AB7, Dedicated: 3.87 GB, Shared: 7.85 GB [DXGI] Adapter Description: Intel(R) Iris(R) Xe Graphics, LUID: 0x00000000000126D6, Dedicated: 0.12 GB, Shared: 7.85 GB [DXGI] Adapter Description: Microsoft Basic Render Driver, LUID: 0x0000000000012A29, Dedicated: 0.00 GB, Shared: 7.85 GB Integrated GPU (Intel(R) Iris(R) Xe Graphics) with LUID 0x00000000000126d6 detected. Shared Total: 8433055744.00 bytes (7.85 GB), Shared Usage: 1710690304.00 bytes (1.59 GB), Dedicated Total: 134217728.00 bytes (0.12 GB), Dedicated Usage: 0.00 bytes (0.00 GB) ggml_backend_vk_get_device_memory utilizing DXGI + PDH memory reporting free: 6856583168 total: 8567273472 time=2026-04-06T15:34:50.190+02:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=tokenizer.ggml.cls_token_id default=0 time=2026-04-06T15:34:50.190+02:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=tokenizer.ggml.separator_token_id default=0 time=2026-04-06T15:34:50.190+02:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=nomic-bert-moe.normalize_embeddings default=false time=2026-04-06T15:34:50.194+02:00 level=DEBUG source=ggml.go:852 msg="compute graph" nodes=467 splits=4 time=2026-04-06T15:34:50.196+02:00 level=DEBUG source=ggml.go:852 msg="compute graph" nodes=467 splits=2 time=2026-04-06T15:34:50.196+02:00 level=DEBUG source=device.go:240 msg="model weights" device=CUDA0 size="906.8 MiB" time=2026-04-06T15:34:50.197+02:00 level=DEBUG source=device.go:245 msg="model weights" device=CPU size="366.3 MiB" time=2026-04-06T15:34:50.197+02:00 level=DEBUG source=device.go:262 msg="compute graph" device=CUDA0 size="28.0 MiB" time=2026-04-06T15:34:50.197+02:00 level=DEBUG source=device.go:267 msg="compute graph" device=CPU size="1.5 MiB" time=2026-04-06T15:34:50.197+02:00 level=DEBUG source=device.go:272 msg="total memory" size="1.3 GiB" time=2026-04-06T15:34:50.197+02:00 level=DEBUG source=server.go:784 msg=memory success=true required.InputWeights=384082944 required.CPU.Graph=1572864 required.CUDA0.ID=GPU-a4f6355b-902f-14e3-2b28-2189eb9ad638 required.CUDA0.Weights="[14195712 80265216 14195712 80265216 14195712 80265216 14195712 80265216 14195712 80265216 14195712 80265216 384073728]" required.CUDA0.Graph=29360128 time=2026-04-06T15:34:50.197+02:00 level=DEBUG source=server.go:978 msg="available gpu" id=GPU-a4f6355b-902f-14e3-2b28-2189eb9ad638 library=CUDA "available layer vram"="3.2 GiB" backoff=0.00 minimum="457.0 MiB" overhead="0 B" graph="28.0 MiB" time=2026-04-06T15:34:50.197+02:00 level=DEBUG source=server.go:978 msg="available gpu" id=8680a646-0c00-0000-0000-000000000000 library=Vulkan "available layer vram"="6.2 GiB" backoff=0.00 minimum="457.0 MiB" overhead="0 B" graph="0 B" time=2026-04-06T15:34:50.197+02:00 level=DEBUG source=server.go:795 msg="new layout created" layers="13[ID:GPU-a4f6355b-902f-14e3-2b28-2189eb9ad638 Layers:13(0..12)]" time=2026-04-06T15:34:50.198+02:00 level=INFO source=runner.go:1284 msg=load request="{Operation:commit LoraPath:[] Parallel:1 BatchSize:512 FlashAttention:Disabled KvSize:512 KvCacheType: NumThreads:6 GPULayers:13[ID:GPU-a4f6355b-902f-14e3-2b28-2189eb9ad638 Layers:13(0..12)] MultiUserCache:false ProjectorPath: MainGPU:0 UseMmap:false}" time=2026-04-06T15:34:50.198+02:00 level=INFO source=ggml.go:482 msg="offloading 12 repeating layers to GPU" time=2026-04-06T15:34:50.198+02:00 level=INFO source=ggml.go:489 msg="offloading output layer to GPU" time=2026-04-06T15:34:50.198+02:00 level=INFO source=ggml.go:494 msg="offloaded 13/13 layers to GPU" time=2026-04-06T15:34:50.198+02:00 level=INFO source=device.go:240 msg="model weights" device=CUDA0 size="906.8 MiB" time=2026-04-06T15:34:50.199+02:00 level=INFO source=device.go:245 msg="model weights" device=CPU size="366.3 MiB" time=2026-04-06T15:34:50.199+02:00 level=INFO source=device.go:262 msg="compute graph" device=CUDA0 size="28.0 MiB" time=2026-04-06T15:34:50.200+02:00 level=INFO source=device.go:267 msg="compute graph" device=CPU size="1.5 MiB" time=2026-04-06T15:34:50.200+02:00 level=INFO source=device.go:272 msg="total memory" size="1.3 GiB" time=2026-04-06T15:34:50.213+02:00 level=INFO source=sched.go:561 msg="loaded runners" count=1 time=2026-04-06T15:34:50.220+02:00 level=INFO source=server.go:1352 msg="waiting for llama runner to start responding" time=2026-04-06T15:34:50.220+02:00 level=INFO source=server.go:1386 msg="waiting for server to become available" status="llm server loading model" time=2026-04-06T15:34:50.221+02:00 level=DEBUG source=server.go:1396 msg="model load progress 0.00" time=2026-04-06T15:34:50.473+02:00 level=DEBUG source=server.go:1396 msg="model load progress 0.07" time=2026-04-06T15:34:50.726+02:00 level=DEBUG source=server.go:1396 msg="model load progress 0.14" time=2026-04-06T15:34:50.978+02:00 level=DEBUG source=server.go:1396 msg="model load progress 0.21" time=2026-04-06T15:34:51.231+02:00 level=DEBUG source=server.go:1396 msg="model load progress 0.29" time=2026-04-06T15:34:51.482+02:00 level=DEBUG source=server.go:1396 msg="model load progress 0.36" time=2026-04-06T15:34:51.733+02:00 level=DEBUG source=server.go:1396 msg="model load progress 0.44" time=2026-04-06T15:34:51.984+02:00 level=DEBUG source=server.go:1396 msg="model load progress 0.52" time=2026-04-06T15:34:52.235+02:00 level=DEBUG source=server.go:1396 msg="model load progress 0.59" time=2026-04-06T15:34:52.488+02:00 level=DEBUG source=server.go:1396 msg="model load progress 0.67" time=2026-04-06T15:34:52.740+02:00 level=DEBUG source=server.go:1396 msg="model load progress 0.74" time=2026-04-06T15:34:52.990+02:00 level=DEBUG source=server.go:1396 msg="model load progress 0.80" time=2026-04-06T15:34:53.241+02:00 level=DEBUG source=server.go:1396 msg="model load progress 0.88" time=2026-04-06T15:34:53.492+02:00 level=DEBUG source=server.go:1396 msg="model load progress 0.96" time=2026-04-06T15:34:53.744+02:00 level=INFO source=server.go:1390 msg="llama runner started in 6.34 seconds" time=2026-04-06T15:34:53.746+02:00 level=DEBUG source=sched.go:573 msg="finished setting up" runner.name=registry.ollama.ai/library/nomic-embed-text-v2-moe:latest runner.inference="[{ID:GPU-a4f6355b-902f-14e3-2b28-2189eb9ad638 Library:CUDA}]" runner.size="1.3 GiB" runner.vram="1.3 GiB" runner.parallel=1 runner.pid=6268 runner.model=C:\Users\user\.ollama\models\blobs\sha256-a5db3381f2e514d3490a3a31fe70eb1a65e95016c85c6c2c23223b810806594f runner.num_ctx=4096 time=2026-04-06T15:34:53.924+02:00 level=DEBUG source=ggml.go:324 msg="key with type not found" key=general.alignment default=32 time=2026-04-06T15:34:53.947+02:00 level=DEBUG source=vocabulary.go:52 msg="adding bos token to prompt" id=0 time=2026-04-06T15:34:53.947+02:00 level=DEBUG source=vocabulary.go:61 msg="adding eos token to prompt" id=2 time=2026-04-06T15:34:53.947+02:00 level=DEBUG source=cache.go:151 msg="loading cache slot" id=0 cache=0 prompt=336 used=0 remaining=336 C:/a/ollama/ollama/ml/backend/ggml/ggml/src/ggml-cpu/ops.cpp:4666: GGML_ASSERT(i01 >= 0 && i01 < ne01) failed [GIN] 2026/04/06 - 15:34:54 | 400 | 10.7645135s | 127.0.0.1 | POST "/api/embed" time=2026-04-06T15:34:54.355+02:00 level=DEBUG source=sched.go:581 msg="context for request finished" time=2026-04-06T15:34:54.355+02:00 level=DEBUG source=sched.go:309 msg="runner with non-zero duration has gone idle, adding timer" runner.name=registry.ollama.ai/library/nomic-embed-text-v2-moe:latest runner.inference="[{ID:GPU-a4f6355b-902f-14e3-2b28-2189eb9ad638 Library:CUDA}]" runner.size="1.3 GiB" runner.vram="1.3 GiB" runner.parallel=1 runner.pid=6268 runner.model=C:\Users\user\.ollama\models\blobs\sha256-a5db3381f2e514d3490a3a31fe70eb1a65e95016c85c6c2c23223b810806594f runner.num_ctx=4096 duration=15m0s time=2026-04-06T15:34:54.357+02:00 level=DEBUG source=sched.go:327 msg="after processing request finished event" runner.name=registry.ollama.ai/library/nomic-embed-text-v2-moe:latest runner.inference="[{ID:GPU-a4f6355b-902f-14e3-2b28-2189eb9ad638 Library:CUDA}]" runner.size="1.3 GiB" runner.vram="1.3 GiB" runner.parallel=1 runner.pid=6268 runner.model=C:\Users\user\.ollama\models\blobs\sha256-a5db3381f2e514d3490a3a31fe70eb1a65e95016c85c6c2c23223b810806594f runner.num_ctx=4096 refCount=0 time=2026-04-06T15:34:54.459+02:00 level=ERROR source=server.go:304 msg="llama runner terminated" error="exit status 1"
GiteaMirror commented 2026-04-22 19:58:32 -05:00
Author
Owner
Copy Link

@ScaryBeats01 commented on GitHub (Apr 11, 2026):

This only happens with big inputs.

<!-- gh-comment-id:4229417439 --> @ScaryBeats01 commented on GitHub (Apr 11, 2026): This only happens with big inputs.
GiteaMirror commented 2026-04-22 19:58:32 -05:00
Author
Owner
Copy Link

@PureBlissAK commented on GitHub (Apr 18, 2026):

🤖 Automated Triage & Analysis Report

Issue: #15174
Analyzed: 2026-04-18T18:22:58.454184

Analysis

  • Type: unknown
  • Severity: medium
  • Components: unknown

Implementation Plan

  • Effort: medium
  • Steps:

This issue has been triaged and marked for implementation.

<!-- gh-comment-id:4274311007 --> @PureBlissAK commented on GitHub (Apr 18, 2026): <!-- ollama-issue-orchestrator:v1 issue:15174 --> ## 🤖 Automated Triage & Analysis Report **Issue**: #15174 **Analyzed**: 2026-04-18T18:22:58.454184 ### Analysis - **Type**: unknown - **Severity**: medium - **Components**: unknown ### Implementation Plan - **Effort**: medium - **Steps**: *This issue has been triaged and marked for implementation.*
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
 python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
No Label bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#35473
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?