[GH-ISSUE #11671] Loading gpt-oss panics #54232

Closed
opened 2026-04-29 05:25:20 -05:00 by GiteaMirror · 10 comments
Owner

Originally created by @kapolos on GitHub (Aug 5, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/11671

What is the issue?

Version 0.11.0, Windows 11.

Panics when querying /api/chat with gpt-oss:20b.

Relevant log output

time=2025-08-05T20:24:23.328+03:00 level=INFO source=images.go:477 msg="total blobs: 35"
time=2025-08-05T20:24:23.330+03:00 level=INFO source=images.go:484 msg="total unused blobs removed: 0"
time=2025-08-05T20:24:23.332+03:00 level=INFO source=routes.go:1350 msg="Listening on [::]:11434 (version 0.11.0)"
time=2025-08-05T20:24:23.332+03:00 level=INFO source=gpu.go:217 msg="looking for compatible GPUs"
time=2025-08-05T20:24:23.332+03:00 level=INFO source=gpu_windows.go:167 msg=packages count=1
time=2025-08-05T20:24:23.332+03:00 level=INFO source=gpu_windows.go:214 msg="" package=0 cores=16 efficiency=0 threads=32
time=2025-08-05T20:24:23.846+03:00 level=INFO source=amd_windows.go:127 msg="unsupported Radeon iGPU detected skipping" id=0 total="37.1 GiB"
time=2025-08-05T20:24:23.853+03:00 level=INFO source=types.go:130 msg="inference compute" id=GPU-58701cb1-c62d-0fd0-0d37-6db9041c57b7 library=cuda variant=v12 compute=12.0 driver=12.9 name="NVIDIA GeForce RTX 5090" total="31.8 GiB" available="30.1 GiB"
time=2025-08-05T20:24:34.516+03:00 level=INFO source=sched.go:786 msg="new model will fit in available VRAM in single GPU, loading" model=C:\Users\avatar\.ollama\models\blobs\sha256-b112e727c6f18875636c56a779790a590d705aec9e1c0eb5a97d51fc2a778583 gpu=GPU-58701cb1-c62d-0fd0-0d37-6db9041c57b7 parallel=1 available=29754978304 required="14.9 GiB"
time=2025-08-05T20:24:34.530+03:00 level=INFO source=server.go:135 msg="system memory" total="93.6 GiB" free="62.3 GiB" free_swap="48.5 GiB"
time=2025-08-05T20:24:34.531+03:00 level=INFO source=server.go:175 msg=offload library=cuda layers.requested=-1 layers.model=25 layers.offload=25 layers.split="" memory.available="[27.7 GiB]" memory.gpu_overhead="0 B" memory.required.full="14.9 GiB" memory.required.partial="14.9 GiB" memory.required.kv="300.0 MiB" memory.required.allocations="[14.9 GiB]" memory.weights.total="11.7 GiB" memory.weights.repeating="10.7 GiB" memory.weights.nonrepeating="1.1 GiB" memory.graph.full="2.0 GiB" memory.graph.partial="4.0 GiB"
time=2025-08-05T20:24:34.573+03:00 level=INFO source=server.go:438 msg="starting llama server" cmd="G:\\data\\ollama\\ollama.exe runner --ollama-engine --model C:\\Users\\avatar\\.ollama\\models\\blobs\\sha256-b112e727c6f18875636c56a779790a590d705aec9e1c0eb5a97d51fc2a778583 --ctx-size 8192 --batch-size 512 --n-gpu-layers 25 --threads 16 --no-mmap --parallel 1 --port 55206"
time=2025-08-05T20:24:34.577+03:00 level=INFO source=sched.go:481 msg="loaded runners" count=1
time=2025-08-05T20:24:34.577+03:00 level=INFO source=server.go:598 msg="waiting for llama runner to start responding"
time=2025-08-05T20:24:34.579+03:00 level=INFO source=server.go:632 msg="waiting for server to become available" status="llm server error"
time=2025-08-05T20:24:34.657+03:00 level=INFO source=runner.go:925 msg="starting ollama engine"
time=2025-08-05T20:24:34.659+03:00 level=INFO source=runner.go:983 msg="Server listening on 127.0.0.1:55206"
time=2025-08-05T20:24:34.688+03:00 level=INFO source=ggml.go:92 msg="" architecture=gptoss file_type=MXFP4 name="" description="" num_tensors=315 num_key_values=30
ggml_cuda_init: GGML_CUDA_FORCE_MMQ:    no
ggml_cuda_init: GGML_CUDA_FORCE_CUBLAS: no
ggml_cuda_init: found 1 CUDA devices:
  Device 0: NVIDIA GeForce RTX 5090, compute capability 12.0, VMM: yes
load_backend: loaded CUDA backend from G:\data\ollama\lib\ollama\ggml-cuda.dll
load_backend: loaded CPU backend from G:\data\ollama\lib\ollama\ggml-cpu-icelake.dll
ggml_cuda_init: GGML_CUDA_FORCE_MMQ:    no
ggml_cuda_init: GGML_CUDA_FORCE_CUBLAS: no
ggml_cuda_init: found 1 CUDA devices:
  Device 0: NVIDIA GeForce RTX 5090, compute capability 12.0, VMM: yes
load_backend: loaded CUDA backend from G:\data\ollama\lib\ollama\cuda_v12\ggml-cuda.dll
time=2025-08-05T20:24:34.795+03:00 level=INFO source=ggml.go:104 msg=system CPU.0.SSE3=1 CPU.0.SSSE3=1 CPU.0.AVX=1 CPU.0.AVX2=1 CPU.0.F16C=1 CPU.0.FMA=1 CPU.0.BMI2=1 CPU.0.AVX512=1 CPU.0.AVX512_VBMI=1 CPU.0.AVX512_VNNI=1 CPU.0.LLAMAFILE=1 CPU.1.LLAMAFILE=1 CUDA.0.ARCHS=500,600,610,700,750,800,860,870,890,900,1200 CUDA.0.USE_GRAPHS=1 CUDA.0.PEER_MAX_BATCH_SIZE=128 CUDA.1.ARCHS=500,600,610,700,750,800,860,870,890,900,1200 CUDA.1.USE_GRAPHS=1 CUDA.1.PEER_MAX_BATCH_SIZE=128 compiler=cgo(clang)
time=2025-08-05T20:24:34.832+03:00 level=INFO source=server.go:632 msg="waiting for server to become available" status="llm server loading model"
unexpected fault address 0x787b00000
fatal error: fault
[signal 0xc0000005 code=0x0 addr=0x787b00000 pc=0x7ff764497180]

goroutine 51 gp=0xc0005868c0 m=11 mp=0xc000680008 [running]:
runtime.throw({0x7ff7656f9c06?, 0xc000056a08?})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/panic.go:1096 +0x4d fp=0xc0000490c8 sp=0xc000049098 pc=0x7ff7645061ed
runtime.sigpanic()
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/signal_windows.go:414 +0xd0 fp=0xc000049110 sp=0xc0000490c8 pc=0x7ff7644e8f10
indexbytebody()
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/internal/bytealg/indexbyte_amd64.s:131 +0xe0 fp=0xc000049118 sp=0xc000049110 pc=0x7ff764497180
runtime.findnull(0xc000049198?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/string.go:577 +0x79 fp=0xc000049170 sp=0xc000049118 pc=0x7ff7644ee039
runtime.gostring(0x787b00000)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/string.go:363 +0x1c fp=0xc0000491a8 sp=0xc000049170 pc=0x7ff764508d5c
github.com/ollama/ollama/ml/backend/ggml._Cfunc_GoString(...)
        _cgo_gotypes.go:307
github.com/ollama/ollama/ml/backend/ggml.New({0xc00003a150, 0x6c}, {0x10, 0x0, 0x19, {0x0, 0x0, 0x0}, 0x0})
        C:/a/ollama-private/ollama-private/ml/backend/ggml/ggml.go:158 +0x1359 fp=0xc000049c18 sp=0xc0000491a8 pc=0x7ff764959579
github.com/ollama/ollama/ml.NewBackend({0xc00003a150, 0x6c}, {0x10, 0x0, 0x19, {0x0, 0x0, 0x0}, 0x0})
        C:/a/ollama-private/ollama-private/ml/backend.go:209 +0xb1 fp=0xc000049c70 sp=0xc000049c18 pc=0x7ff764949751
github.com/ollama/ollama/model.New({0xc00003a150?, 0x0?}, {0x10, 0x0, 0x19, {0x0, 0x0, 0x0}, 0x0})
        C:/a/ollama-private/ollama-private/model/model.go:102 +0x8f fp=0xc000049d68 sp=0xc000049c70 pc=0x7ff764969b8f
github.com/ollama/ollama/runner/ollamarunner.(*Server).initModel(0xc0007cbc20, {0xc00003a150?, 0x0?}, {0x10, 0x0, 0x19, {0x0, 0x0, 0x0}, 0x0}, ...)
        C:/a/ollama-private/ollama-private/runner/ollamarunner/runner.go:841 +0x8d fp=0xc000049dc8 sp=0xc000049d68 pc=0x7ff764a106ed
github.com/ollama/ollama/runner/ollamarunner.(*Server).load(0xc0007cbc20, {0x7ff7658d7d20, 0xc000378320}, {0xc00003a150?, 0x0?}, {0x10, 0x0, 0x19, {0x0, 0x0, ...}, ...}, ...)
        C:/a/ollama-private/ollama-private/runner/ollamarunner/runner.go:878 +0xb8 fp=0xc000049f20 sp=0xc000049dc8 pc=0x7ff764a10a58
github.com/ollama/ollama/runner/ollamarunner.Execute.gowrap1()
        C:/a/ollama-private/ollama-private/runner/ollamarunner/runner.go:959 +0xc7 fp=0xc000049fe0 sp=0xc000049f20 pc=0x7ff764a11e87
runtime.goexit({})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000049fe8 sp=0xc000049fe0 pc=0x7ff76450db01
created by github.com/ollama/ollama/runner/ollamarunner.Execute in goroutine 1
        C:/a/ollama-private/ollama-private/runner/ollamarunner/runner.go:959 +0xa11

goroutine 1 gp=0xc0000021c0 m=nil [IO wait]:
runtime.gopark(0x7ff76450f300?, 0x7ff766231580?, 0x20?, 0xd4?, 0xc00051d4cc?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc00059b508 sp=0xc00059b4e8 pc=0x7ff76450630e
runtime.netpollblock(0x30c?, 0x644a0446?, 0xf7?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/netpoll.go:575 +0xf7 fp=0xc00059b540 sp=0xc00059b508 pc=0x7ff7644cbf37
internal/poll.runtime_pollWait(0x14472624e00, 0x72)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/netpoll.go:351 +0x85 fp=0xc00059b560 sp=0xc00059b540 pc=0x7ff7645054a5
internal/poll.(*pollDesc).wait(0x7ff76459a293?, 0x7ff7644b2776?, 0x0)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc00059b588 sp=0xc00059b560 pc=0x7ff76459b887
internal/poll.execIO(0xc00051d420, 0xc00059b630)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/internal/poll/fd_windows.go:177 +0x105 fp=0xc00059b600 sp=0xc00059b588 pc=0x7ff76459cce5
internal/poll.(*FD).acceptOne(0xc00051d408, 0x4c0, {0xc0000f00f0?, 0x7ff7644bae05?, 0x7ff7662a6760?}, 0x28cdf6a?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/internal/poll/fd_windows.go:946 +0x65 fp=0xc00059b660 sp=0xc00059b600 pc=0x7ff7645a1265
internal/poll.(*FD).Accept(0xc00051d408, 0xc00059b810)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/internal/poll/fd_windows.go:980 +0x1b6 fp=0xc00059b718 sp=0xc00059b660 pc=0x7ff7645a1596
net.(*netFD).accept(0xc00051d408)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/net/fd_windows.go:182 +0x4b fp=0xc00059b830 sp=0xc00059b718 pc=0x7ff7646121ab
net.(*TCPListener).accept(0xc000412180)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/net/tcpsock_posix.go:159 +0x1b fp=0xc00059b880 sp=0xc00059b830 pc=0x7ff7646281fb
net.(*TCPListener).Accept(0xc000412180)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/net/tcpsock.go:380 +0x30 fp=0xc00059b8b0 sp=0xc00059b880 pc=0x7ff764626fb0
net/http.(*onceCloseListener).Accept(0xc000191ef0?)
        <autogenerated>:1 +0x24 fp=0xc00059b8c8 sp=0xc00059b8b0 pc=0x7ff7648403a4
net/http.(*Server).Serve(0xc000050100, {0x7ff7658d5700, 0xc000412180})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/net/http/server.go:3424 +0x30c fp=0xc00059b9f8 sp=0xc00059b8c8 pc=0x7ff764817c6c
github.com/ollama/ollama/runner/ollamarunner.Execute({0xc0000de030, 0xf, 0x1d})
        C:/a/ollama-private/ollama-private/runner/ollamarunner/runner.go:984 +0xe09 fp=0xc00059bd08 sp=0xc00059b9f8 pc=0x7ff764a11ae9
github.com/ollama/ollama/runner.Execute({0xc0000de010?, 0x0?, 0x0?})
        C:/a/ollama-private/ollama-private/runner/runner.go:20 +0xc9 fp=0xc00059bd30 sp=0xc00059bd08 pc=0x7ff764a123e9
github.com/ollama/ollama/cmd.NewCLI.func2(0xc000051600?, {0x7ff7656f87aa?, 0x4?, 0x7ff7656f87ae?})
        C:/a/ollama-private/ollama-private/cmd/cmd.go:1583 +0x45 fp=0xc00059bd58 sp=0xc00059bd30 pc=0x7ff765179045
github.com/spf13/cobra.(*Command).execute(0xc000536f08, {0xc000051800, 0x10, 0x10})
        C:/Users/runneradmin/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:940 +0x85c fp=0xc00059be78 sp=0xc00059bd58 pc=0x7ff76468cc7c
github.com/spf13/cobra.(*Command).ExecuteC(0xc0007df508)
        C:/Users/runneradmin/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:1068 +0x3a5 fp=0xc00059bf30 sp=0xc00059be78 pc=0x7ff76468d4c5
github.com/spf13/cobra.(*Command).Execute(...)
        C:/Users/runneradmin/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:992
github.com/spf13/cobra.(*Command).ExecuteContext(...)
        C:/Users/runneradmin/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:985
main.main()
        C:/a/ollama-private/ollama-private/main.go:12 +0x4d fp=0xc00059bf50 sp=0xc00059bf30 pc=0x7ff765179b2d
runtime.main()
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:283 +0x27d fp=0xc00059bfe0 sp=0xc00059bf50 pc=0x7ff7644d4f1d
runtime.goexit({})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00059bfe8 sp=0xc00059bfe0 pc=0x7ff76450db01

goroutine 2 gp=0xc0000028c0 m=nil [force gc (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc0000a7fa8 sp=0xc0000a7f88 pc=0x7ff76450630e
runtime.goparkunlock(...)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:441
runtime.forcegchelper()
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:348 +0xb8 fp=0xc0000a7fe0 sp=0xc0000a7fa8 pc=0x7ff7644d5238
runtime.goexit({})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000a7fe8 sp=0xc0000a7fe0 pc=0x7ff76450db01
created by runtime.init.7 in goroutine 1
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:336 +0x1a

goroutine 3 gp=0xc000002c40 m=nil [GC sweep wait]:
runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc0000a9f80 sp=0xc0000a9f60 pc=0x7ff76450630e
runtime.goparkunlock(...)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:441
runtime.bgsweep(0xc0000b6000)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgcsweep.go:316 +0xdf fp=0xc0000a9fc8 sp=0xc0000a9f80 pc=0x7ff7644bdfff
runtime.gcenable.gowrap1()
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:204 +0x25 fp=0xc0000a9fe0 sp=0xc0000a9fc8 pc=0x7ff7644b23c5
runtime.goexit({})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000a9fe8 sp=0xc0000a9fe0 pc=0x7ff76450db01
created by runtime.gcenable in goroutine 1
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:204 +0x66

goroutine 4 gp=0xc000002e00 m=nil [GC scavenge wait]:
runtime.gopark(0x10000?, 0x7ff7658c2760?, 0x0?, 0x0?, 0x0?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc0000bdf78 sp=0xc0000bdf58 pc=0x7ff76450630e
runtime.goparkunlock(...)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:441
runtime.(*scavengerState).park(0x7ff766257c80)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgcscavenge.go:425 +0x49 fp=0xc0000bdfa8 sp=0xc0000bdf78 pc=0x7ff7644bba49
runtime.bgscavenge(0xc0000b6000)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgcscavenge.go:658 +0x59 fp=0xc0000bdfc8 sp=0xc0000bdfa8 pc=0x7ff7644bbfd9
runtime.gcenable.gowrap2()
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:205 +0x25 fp=0xc0000bdfe0 sp=0xc0000bdfc8 pc=0x7ff7644b2365
runtime.goexit({})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000bdfe8 sp=0xc0000bdfe0 pc=0x7ff76450db01
created by runtime.gcenable in goroutine 1
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:205 +0xa5

goroutine 5 gp=0xc000003340 m=nil [finalizer wait]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc0000bfe30 sp=0xc0000bfe10 pc=0x7ff76450630e
runtime.runfinq()
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mfinal.go:196 +0x107 fp=0xc0000bffe0 sp=0xc0000bfe30 pc=0x7ff7644b1347
runtime.goexit({})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000bffe8 sp=0xc0000bffe0 pc=0x7ff76450db01
created by runtime.createfing in goroutine 1
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mfinal.go:166 +0x3d

goroutine 6 gp=0xc000003dc0 m=nil [chan receive]:
runtime.gopark(0xc0002275e0?, 0xc0007b0048?, 0x60?, 0xbf?, 0x7ff7645fb0e8?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc0000abf18 sp=0xc0000abef8 pc=0x7ff76450630e
runtime.chanrecv(0xc00003a3f0, 0x0, 0x1)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/chan.go:664 +0x445 fp=0xc0000abf90 sp=0xc0000abf18 pc=0x7ff7644a2d85
runtime.chanrecv1(0x7ff7644d5080?, 0xc0000abf76?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/chan.go:506 +0x12 fp=0xc0000abfb8 sp=0xc0000abf90 pc=0x7ff7644a2912
runtime.unique_runtime_registerUniqueMapCleanup.func2(...)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1796
runtime.unique_runtime_registerUniqueMapCleanup.gowrap1()
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1799 +0x2f fp=0xc0000abfe0 sp=0xc0000abfb8 pc=0x7ff7644b55ef
runtime.goexit({})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000abfe8 sp=0xc0000abfe0 pc=0x7ff76450db01
created by unique.runtime_registerUniqueMapCleanup in goroutine 1
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1794 +0x85

goroutine 7 gp=0xc0004181c0 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc0000b9f38 sp=0xc0000b9f18 pc=0x7ff76450630e
runtime.gcBgMarkWorker(0xc00003b810)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc0000b9fc8 sp=0xc0000b9f38 pc=0x7ff7644b48e9
runtime.gcBgMarkStartWorkers.gowrap1()
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc0000b9fe0 sp=0xc0000b9fc8 pc=0x7ff7644b47c5
runtime.goexit({})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000b9fe8 sp=0xc0000b9fe0 pc=0x7ff76450db01
created by runtime.gcBgMarkStartWorkers in goroutine 1
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105

goroutine 18 gp=0xc0001061c0 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc000113f38 sp=0xc000113f18 pc=0x7ff76450630e
runtime.gcBgMarkWorker(0xc00003b810)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000113fc8 sp=0xc000113f38 pc=0x7ff7644b48e9
runtime.gcBgMarkStartWorkers.gowrap1()
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc000113fe0 sp=0xc000113fc8 pc=0x7ff7644b47c5
runtime.goexit({})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000113fe8 sp=0xc000113fe0 pc=0x7ff76450db01
created by runtime.gcBgMarkStartWorkers in goroutine 1
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105

goroutine 34 gp=0xc000484000 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc00010ff38 sp=0xc00010ff18 pc=0x7ff76450630e
runtime.gcBgMarkWorker(0xc00003b810)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc00010ffc8 sp=0xc00010ff38 pc=0x7ff7644b48e9
runtime.gcBgMarkStartWorkers.gowrap1()
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc00010ffe0 sp=0xc00010ffc8 pc=0x7ff7644b47c5
runtime.goexit({})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00010ffe8 sp=0xc00010ffe0 pc=0x7ff76450db01
created by runtime.gcBgMarkStartWorkers in goroutine 1
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105

goroutine 8 gp=0xc000418380 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc0000bbf38 sp=0xc0000bbf18 pc=0x7ff76450630e
runtime.gcBgMarkWorker(0xc00003b810)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc0000bbfc8 sp=0xc0000bbf38 pc=0x7ff7644b48e9
runtime.gcBgMarkStartWorkers.gowrap1()
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc0000bbfe0 sp=0xc0000bbfc8 pc=0x7ff7644b47c5
runtime.goexit({})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000bbfe8 sp=0xc0000bbfe0 pc=0x7ff76450db01
created by runtime.gcBgMarkStartWorkers in goroutine 1
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105

goroutine 19 gp=0xc000106380 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc000115f38 sp=0xc000115f18 pc=0x7ff76450630e
runtime.gcBgMarkWorker(0xc00003b810)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000115fc8 sp=0xc000115f38 pc=0x7ff7644b48e9
runtime.gcBgMarkStartWorkers.gowrap1()
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc000115fe0 sp=0xc000115fc8 pc=0x7ff7644b47c5
runtime.goexit({})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000115fe8 sp=0xc000115fe0 pc=0x7ff76450db01
created by runtime.gcBgMarkStartWorkers in goroutine 1
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105

goroutine 35 gp=0xc0004841c0 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc000111f38 sp=0xc000111f18 pc=0x7ff76450630e
runtime.gcBgMarkWorker(0xc00003b810)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000111fc8 sp=0xc000111f38 pc=0x7ff7644b48e9
runtime.gcBgMarkStartWorkers.gowrap1()
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc000111fe0 sp=0xc000111fc8 pc=0x7ff7644b47c5
runtime.goexit({})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000111fe8 sp=0xc000111fe0 pc=0x7ff76450db01
created by runtime.gcBgMarkStartWorkers in goroutine 1
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105

goroutine 9 gp=0xc000418540 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc000475f38 sp=0xc000475f18 pc=0x7ff76450630e
runtime.gcBgMarkWorker(0xc00003b810)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000475fc8 sp=0xc000475f38 pc=0x7ff7644b48e9
runtime.gcBgMarkStartWorkers.gowrap1()
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc000475fe0 sp=0xc000475fc8 pc=0x7ff7644b47c5
runtime.goexit({})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000475fe8 sp=0xc000475fe0 pc=0x7ff76450db01
created by runtime.gcBgMarkStartWorkers in goroutine 1
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105

goroutine 20 gp=0xc000106540 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc000471f38 sp=0xc000471f18 pc=0x7ff76450630e
runtime.gcBgMarkWorker(0xc00003b810)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000471fc8 sp=0xc000471f38 pc=0x7ff7644b48e9
runtime.gcBgMarkStartWorkers.gowrap1()
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc000471fe0 sp=0xc000471fc8 pc=0x7ff7644b47c5
runtime.goexit({})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000471fe8 sp=0xc000471fe0 pc=0x7ff76450db01
created by runtime.gcBgMarkStartWorkers in goroutine 1
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105

goroutine 36 gp=0xc000484380 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc00048bf38 sp=0xc00048bf18 pc=0x7ff76450630e
runtime.gcBgMarkWorker(0xc00003b810)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc00048bfc8 sp=0xc00048bf38 pc=0x7ff7644b48e9
runtime.gcBgMarkStartWorkers.gowrap1()
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc00048bfe0 sp=0xc00048bfc8 pc=0x7ff7644b47c5
runtime.goexit({})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00048bfe8 sp=0xc00048bfe0 pc=0x7ff76450db01
created by runtime.gcBgMarkStartWorkers in goroutine 1
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105

goroutine 10 gp=0xc000418700 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc000477f38 sp=0xc000477f18 pc=0x7ff76450630e
runtime.gcBgMarkWorker(0xc00003b810)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000477fc8 sp=0xc000477f38 pc=0x7ff7644b48e9
runtime.gcBgMarkStartWorkers.gowrap1()
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc000477fe0 sp=0xc000477fc8 pc=0x7ff7644b47c5
runtime.goexit({})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000477fe8 sp=0xc000477fe0 pc=0x7ff76450db01
created by runtime.gcBgMarkStartWorkers in goroutine 1
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105

goroutine 21 gp=0xc000106700 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc000473f38 sp=0xc000473f18 pc=0x7ff76450630e
runtime.gcBgMarkWorker(0xc00003b810)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000473fc8 sp=0xc000473f38 pc=0x7ff7644b48e9
runtime.gcBgMarkStartWorkers.gowrap1()
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc000473fe0 sp=0xc000473fc8 pc=0x7ff7644b47c5
runtime.goexit({})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000473fe8 sp=0xc000473fe0 pc=0x7ff76450db01
created by runtime.gcBgMarkStartWorkers in goroutine 1
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105

goroutine 37 gp=0xc000484540 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc00048df38 sp=0xc00048df18 pc=0x7ff76450630e
runtime.gcBgMarkWorker(0xc00003b810)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc00048dfc8 sp=0xc00048df38 pc=0x7ff7644b48e9
runtime.gcBgMarkStartWorkers.gowrap1()
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc00048dfe0 sp=0xc00048dfc8 pc=0x7ff7644b47c5
runtime.goexit({})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00048dfe8 sp=0xc00048dfe0 pc=0x7ff76450db01
created by runtime.gcBgMarkStartWorkers in goroutine 1
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105

goroutine 11 gp=0xc0004188c0 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc000487f38 sp=0xc000487f18 pc=0x7ff76450630e
runtime.gcBgMarkWorker(0xc00003b810)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000487fc8 sp=0xc000487f38 pc=0x7ff7644b48e9
runtime.gcBgMarkStartWorkers.gowrap1()
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc000487fe0 sp=0xc000487fc8 pc=0x7ff7644b47c5
runtime.goexit({})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000487fe8 sp=0xc000487fe0 pc=0x7ff76450db01
created by runtime.gcBgMarkStartWorkers in goroutine 1
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105

goroutine 22 gp=0xc0001068c0 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc00011df38 sp=0xc00011df18 pc=0x7ff76450630e
runtime.gcBgMarkWorker(0xc00003b810)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc00011dfc8 sp=0xc00011df38 pc=0x7ff7644b48e9
runtime.gcBgMarkStartWorkers.gowrap1()
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc00011dfe0 sp=0xc00011dfc8 pc=0x7ff7644b47c5
runtime.goexit({})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00011dfe8 sp=0xc00011dfe0 pc=0x7ff76450db01
created by runtime.gcBgMarkStartWorkers in goroutine 1
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105

goroutine 38 gp=0xc000484700 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc000119f38 sp=0xc000119f18 pc=0x7ff76450630e
runtime.gcBgMarkWorker(0xc00003b810)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000119fc8 sp=0xc000119f38 pc=0x7ff7644b48e9
runtime.gcBgMarkStartWorkers.gowrap1()
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc000119fe0 sp=0xc000119fc8 pc=0x7ff7644b47c5
runtime.goexit({})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000119fe8 sp=0xc000119fe0 pc=0x7ff76450db01
created by runtime.gcBgMarkStartWorkers in goroutine 1
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105

goroutine 12 gp=0xc000418a80 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc000489f38 sp=0xc000489f18 pc=0x7ff76450630e
runtime.gcBgMarkWorker(0xc00003b810)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000489fc8 sp=0xc000489f38 pc=0x7ff7644b48e9
runtime.gcBgMarkStartWorkers.gowrap1()
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc000489fe0 sp=0xc000489fc8 pc=0x7ff7644b47c5
runtime.goexit({})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000489fe8 sp=0xc000489fe0 pc=0x7ff76450db01
created by runtime.gcBgMarkStartWorkers in goroutine 1
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105

goroutine 39 gp=0xc0004848c0 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc00011bf38 sp=0xc00011bf18 pc=0x7ff76450630e
runtime.gcBgMarkWorker(0xc00003b810)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc00011bfc8 sp=0xc00011bf38 pc=0x7ff7644b48e9
runtime.gcBgMarkStartWorkers.gowrap1()
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc00011bfe0 sp=0xc00011bfc8 pc=0x7ff7644b47c5
runtime.goexit({})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00011bfe8 sp=0xc00011bfe0 pc=0x7ff76450db01
created by runtime.gcBgMarkStartWorkers in goroutine 1
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105

goroutine 13 gp=0xc000418c40 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc00047df38 sp=0xc00047df18 pc=0x7ff76450630e
runtime.gcBgMarkWorker(0xc00003b810)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc00047dfc8 sp=0xc00047df38 pc=0x7ff7644b48e9
runtime.gcBgMarkStartWorkers.gowrap1()
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc00047dfe0 sp=0xc00047dfc8 pc=0x7ff7644b47c5
runtime.goexit({})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00047dfe8 sp=0xc00047dfe0 pc=0x7ff76450db01
created by runtime.gcBgMarkStartWorkers in goroutine 1
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105

goroutine 23 gp=0xc000106a80 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc00011ff38 sp=0xc00011ff18 pc=0x7ff76450630e
runtime.gcBgMarkWorker(0xc00003b810)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc00011ffc8 sp=0xc00011ff38 pc=0x7ff7644b48e9
runtime.gcBgMarkStartWorkers.gowrap1()
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc00011ffe0 sp=0xc00011ffc8 pc=0x7ff7644b47c5
runtime.goexit({})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00011ffe8 sp=0xc00011ffe0 pc=0x7ff76450db01
created by runtime.gcBgMarkStartWorkers in goroutine 1
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105

goroutine 40 gp=0xc000484a80 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc000479f38 sp=0xc000479f18 pc=0x7ff76450630e
runtime.gcBgMarkWorker(0xc00003b810)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000479fc8 sp=0xc000479f38 pc=0x7ff7644b48e9
runtime.gcBgMarkStartWorkers.gowrap1()
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc000479fe0 sp=0xc000479fc8 pc=0x7ff7644b47c5
runtime.goexit({})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000479fe8 sp=0xc000479fe0 pc=0x7ff76450db01
created by runtime.gcBgMarkStartWorkers in goroutine 1
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105

goroutine 14 gp=0xc000418e00 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc00047ff38 sp=0xc00047ff18 pc=0x7ff76450630e
runtime.gcBgMarkWorker(0xc00003b810)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc00047ffc8 sp=0xc00047ff38 pc=0x7ff7644b48e9
runtime.gcBgMarkStartWorkers.gowrap1()
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc00047ffe0 sp=0xc00047ffc8 pc=0x7ff7644b47c5
runtime.goexit({})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00047ffe8 sp=0xc00047ffe0 pc=0x7ff76450db01
created by runtime.gcBgMarkStartWorkers in goroutine 1
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105

goroutine 24 gp=0xc000106c40 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc000125f38 sp=0xc000125f18 pc=0x7ff76450630e
runtime.gcBgMarkWorker(0xc00003b810)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000125fc8 sp=0xc000125f38 pc=0x7ff7644b48e9
runtime.gcBgMarkStartWorkers.gowrap1()
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc000125fe0 sp=0xc000125fc8 pc=0x7ff7644b47c5
runtime.goexit({})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000125fe8 sp=0xc000125fe0 pc=0x7ff76450db01
created by runtime.gcBgMarkStartWorkers in goroutine 1
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105

goroutine 41 gp=0xc000484c40 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc00047bf38 sp=0xc00047bf18 pc=0x7ff76450630e
runtime.gcBgMarkWorker(0xc00003b810)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc00047bfc8 sp=0xc00047bf38 pc=0x7ff7644b48e9
runtime.gcBgMarkStartWorkers.gowrap1()
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc00047bfe0 sp=0xc00047bfc8 pc=0x7ff7644b47c5
runtime.goexit({})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00047bfe8 sp=0xc00047bfe0 pc=0x7ff76450db01
created by runtime.gcBgMarkStartWorkers in goroutine 1
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105

goroutine 15 gp=0xc000418fc0 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc000121f38 sp=0xc000121f18 pc=0x7ff76450630e
runtime.gcBgMarkWorker(0xc00003b810)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000121fc8 sp=0xc000121f38 pc=0x7ff7644b48e9
runtime.gcBgMarkStartWorkers.gowrap1()
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc000121fe0 sp=0xc000121fc8 pc=0x7ff7644b47c5
runtime.goexit({})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000121fe8 sp=0xc000121fe0 pc=0x7ff76450db01
created by runtime.gcBgMarkStartWorkers in goroutine 1
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105

goroutine 25 gp=0xc000106e00 m=nil [GC worker (idle)]:
runtime.gopark(0x7ff7662a6760?, 0x1?, 0x7c?, 0x70?, 0x0?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc000127f38 sp=0xc000127f18 pc=0x7ff76450630e
runtime.gcBgMarkWorker(0xc00003b810)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000127fc8 sp=0xc000127f38 pc=0x7ff7644b48e9
runtime.gcBgMarkStartWorkers.gowrap1()
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc000127fe0 sp=0xc000127fc8 pc=0x7ff7644b47c5
runtime.goexit({})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000127fe8 sp=0xc000127fe0 pc=0x7ff76450db01
created by runtime.gcBgMarkStartWorkers in goroutine 1
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105

goroutine 42 gp=0xc000484e00 m=nil [GC worker (idle)]:
runtime.gopark(0x7ff7662a6760?, 0x1?, 0x0?, 0x0?, 0x0?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc000493f38 sp=0xc000493f18 pc=0x7ff76450630e
runtime.gcBgMarkWorker(0xc00003b810)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000493fc8 sp=0xc000493f38 pc=0x7ff7644b48e9
runtime.gcBgMarkStartWorkers.gowrap1()
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc000493fe0 sp=0xc000493fc8 pc=0x7ff7644b47c5
runtime.goexit({})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000493fe8 sp=0xc000493fe0 pc=0x7ff76450db01
created by runtime.gcBgMarkStartWorkers in goroutine 1
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105

goroutine 16 gp=0xc000419180 m=nil [GC worker (idle)]:
runtime.gopark(0x7ff7662a6760?, 0x1?, 0x0?, 0x0?, 0x0?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc000123f38 sp=0xc000123f18 pc=0x7ff76450630e
runtime.gcBgMarkWorker(0xc00003b810)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000123fc8 sp=0xc000123f38 pc=0x7ff7644b48e9
runtime.gcBgMarkStartWorkers.gowrap1()
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc000123fe0 sp=0xc000123fc8 pc=0x7ff7644b47c5
runtime.goexit({})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000123fe8 sp=0xc000123fe0 pc=0x7ff76450db01
created by runtime.gcBgMarkStartWorkers in goroutine 1
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105

goroutine 26 gp=0xc000106fc0 m=nil [GC worker (idle)]:
runtime.gopark(0x19b056b033948?, 0x1?, 0x1c?, 0x27?, 0x0?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc00048ff38 sp=0xc00048ff18 pc=0x7ff76450630e
runtime.gcBgMarkWorker(0xc00003b810)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc00048ffc8 sp=0xc00048ff38 pc=0x7ff7644b48e9
runtime.gcBgMarkStartWorkers.gowrap1()
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc00048ffe0 sp=0xc00048ffc8 pc=0x7ff7644b47c5
runtime.goexit({})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00048ffe8 sp=0xc00048ffe0 pc=0x7ff76450db01
created by runtime.gcBgMarkStartWorkers in goroutine 1
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105

goroutine 43 gp=0xc000484fc0 m=nil [GC worker (idle)]:
runtime.gopark(0x7ff7662a6760?, 0x1?, 0x34?, 0x3c?, 0x0?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc000495f38 sp=0xc000495f18 pc=0x7ff76450630e
runtime.gcBgMarkWorker(0xc00003b810)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000495fc8 sp=0xc000495f38 pc=0x7ff7644b48e9
runtime.gcBgMarkStartWorkers.gowrap1()
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc000495fe0 sp=0xc000495fc8 pc=0x7ff7644b47c5
runtime.goexit({})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000495fe8 sp=0xc000495fe0 pc=0x7ff76450db01
created by runtime.gcBgMarkStartWorkers in goroutine 1
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105

goroutine 50 gp=0xc000419340 m=nil [GC worker (idle)]:
runtime.gopark(0x7ff7662a6760?, 0x1?, 0x0?, 0x0?, 0x0?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc000505f38 sp=0xc000505f18 pc=0x7ff76450630e
runtime.gcBgMarkWorker(0xc00003b810)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000505fc8 sp=0xc000505f38 pc=0x7ff7644b48e9
runtime.gcBgMarkStartWorkers.gowrap1()
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc000505fe0 sp=0xc000505fc8 pc=0x7ff7644b47c5
runtime.goexit({})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000505fe8 sp=0xc000505fe0 pc=0x7ff76450db01
created by runtime.gcBgMarkStartWorkers in goroutine 1
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105

goroutine 27 gp=0xc000107180 m=nil [GC worker (idle)]:
runtime.gopark(0x7ff7662a6760?, 0x1?, 0x34?, 0x3c?, 0x0?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc000491f38 sp=0xc000491f18 pc=0x7ff76450630e
runtime.gcBgMarkWorker(0xc00003b810)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000491fc8 sp=0xc000491f38 pc=0x7ff7644b48e9
runtime.gcBgMarkStartWorkers.gowrap1()
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc000491fe0 sp=0xc000491fc8 pc=0x7ff7644b47c5
runtime.goexit({})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000491fe8 sp=0xc000491fe0 pc=0x7ff76450db01
created by runtime.gcBgMarkStartWorkers in goroutine 1
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105

goroutine 44 gp=0xc000485180 m=nil [GC worker (idle)]:
runtime.gopark(0x19b056b033948?, 0x1?, 0x0?, 0x0?, 0x0?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc000501f38 sp=0xc000501f18 pc=0x7ff76450630e
runtime.gcBgMarkWorker(0xc00003b810)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000501fc8 sp=0xc000501f38 pc=0x7ff7644b48e9
runtime.gcBgMarkStartWorkers.gowrap1()
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc000501fe0 sp=0xc000501fc8 pc=0x7ff7644b47c5
runtime.goexit({})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000501fe8 sp=0xc000501fe0 pc=0x7ff76450db01
created by runtime.gcBgMarkStartWorkers in goroutine 1
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105

goroutine 52 gp=0xc000586a80 m=nil [sync.WaitGroup.Wait]:
runtime.gopark(0x0?, 0x0?, 0x60?, 0x5e?, 0x0?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc000507ed0 sp=0xc000507eb0 pc=0x7ff76450630e
runtime.goparkunlock(...)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:441
runtime.semacquire1(0xc0007cbc28, 0x0, 0x1, 0x0, 0x18)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/sema.go:188 +0x22f fp=0xc000507f38 sp=0xc000507ed0 pc=0x7ff7644e764f
sync.runtime_SemacquireWaitGroup(0x0?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/sema.go:110 +0x25 fp=0xc000507f70 sp=0xc000507f38 pc=0x7ff7645079e5
sync.(*WaitGroup).Wait(0x0?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/sync/waitgroup.go:118 +0x48 fp=0xc000507f98 sp=0xc000507f70 pc=0x7ff76451b9c8
github.com/ollama/ollama/runner/ollamarunner.(*Server).run(0xc0007cbc20, {0x7ff7658d7d20, 0xc000378320})
        C:/a/ollama-private/ollama-private/runner/ollamarunner/runner.go:355 +0x25 fp=0xc000507fb8 sp=0xc000507f98 pc=0x7ff764a0c605
github.com/ollama/ollama/runner/ollamarunner.Execute.gowrap2()
        C:/a/ollama-private/ollama-private/runner/ollamarunner/runner.go:960 +0x28 fp=0xc000507fe0 sp=0xc000507fb8 pc=0x7ff764a11d88
runtime.goexit({})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000507fe8 sp=0xc000507fe0 pc=0x7ff76450db01
created by github.com/ollama/ollama/runner/ollamarunner.Execute in goroutine 1
        C:/a/ollama-private/ollama-private/runner/ollamarunner/runner.go:960 +0xa74

goroutine 28 gp=0xc0001076c0 m=nil [IO wait]:
runtime.gopark(0x0?, 0xc00051d6a0?, 0x48?, 0xd7?, 0xc00051d74c?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc0005978c8 sp=0xc0005978a8 pc=0x7ff76450630e
runtime.netpollblock(0x2f4?, 0x644a0446?, 0xf7?)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/netpoll.go:575 +0xf7 fp=0xc000597900 sp=0xc0005978c8 pc=0x7ff7644cbf37
internal/poll.runtime_pollWait(0x14472624ce8, 0x72)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/netpoll.go:351 +0x85 fp=0xc000597920 sp=0xc000597900 pc=0x7ff7645054a5
internal/poll.(*pollDesc).wait(0x7ff7646cbc57?, 0xc000597970?, 0x0)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc000597948 sp=0xc000597920 pc=0x7ff76459b887
internal/poll.execIO(0xc00051d6a0, 0x7ff76576dd68)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/internal/poll/fd_windows.go:177 +0x105 fp=0xc0005979c0 sp=0xc000597948 pc=0x7ff76459cce5
internal/poll.(*FD).Read(0xc00051d688, {0xc00148a000, 0x1000, 0x1000})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/internal/poll/fd_windows.go:438 +0x29b fp=0xc000597a60 sp=0xc0005979c0 pc=0x7ff76459d9bb
net.(*netFD).Read(0xc00051d688, {0xc00148a000?, 0xc000597ad0?, 0x7ff76459bd45?})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/net/fd_posix.go:55 +0x25 fp=0xc000597aa8 sp=0xc000597a60 pc=0x7ff7646102c5
net.(*conn).Read(0xc0000ae000, {0xc00148a000?, 0x0?, 0x0?})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/net/net.go:194 +0x45 fp=0xc000597af0 sp=0xc000597aa8 pc=0x7ff76461f7a5
net/http.(*connReader).Read(0xc000362330, {0xc00148a000, 0x1000, 0x1000})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/net/http/server.go:798 +0x159 fp=0xc000597b40 sp=0xc000597af0 pc=0x7ff76480cb19
bufio.(*Reader).fill(0xc0007e01e0)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/bufio/bufio.go:113 +0x103 fp=0xc000597b78 sp=0xc000597b40 pc=0x7ff764635fe3
bufio.(*Reader).Peek(0xc0007e01e0, 0x4)
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/bufio/bufio.go:152 +0x53 fp=0xc000597b98 sp=0xc000597b78 pc=0x7ff764636113
net/http.(*conn).serve(0xc000191ef0, {0x7ff7658d7ce8, 0xc0002202a0})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/net/http/server.go:2137 +0x785 fp=0xc000597fb8 sp=0xc000597b98 pc=0x7ff764812905
net/http.(*Server).Serve.gowrap3()
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/net/http/server.go:3454 +0x28 fp=0xc000597fe0 sp=0xc000597fb8 pc=0x7ff764818068
runtime.goexit({})
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000597fe8 sp=0xc000597fe0 pc=0x7ff76450db01
created by net/http.(*Server).Serve in goroutine 1
        C:/hostedtoolcache/windows/go/1.24.0/x64/src/net/http/server.go:3454 +0x485
time=2025-08-05T20:24:34.990+03:00 level=ERROR source=server.go:464 msg="llama runner terminated" error="exit status 2"
time=2025-08-05T20:24:35.082+03:00 level=ERROR source=sched.go:487 msg="error loading llama server" error="llama runner process has terminated: error:fault"
[GIN] 2025/08/05 - 20:24:35 | 500 |    677.4778ms |   172.23.52.248 | POST     "/api/chat"

OS

Windows 11

GPU

5090

CPU

9950X

Ollama version

0.11.0

Originally created by @kapolos on GitHub (Aug 5, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/11671 ### What is the issue? Version 0.11.0, Windows 11. Panics when querying `/api/chat` with `gpt-oss:20b`. ### Relevant log output ```shell time=2025-08-05T20:24:23.328+03:00 level=INFO source=images.go:477 msg="total blobs: 35" time=2025-08-05T20:24:23.330+03:00 level=INFO source=images.go:484 msg="total unused blobs removed: 0" time=2025-08-05T20:24:23.332+03:00 level=INFO source=routes.go:1350 msg="Listening on [::]:11434 (version 0.11.0)" time=2025-08-05T20:24:23.332+03:00 level=INFO source=gpu.go:217 msg="looking for compatible GPUs" time=2025-08-05T20:24:23.332+03:00 level=INFO source=gpu_windows.go:167 msg=packages count=1 time=2025-08-05T20:24:23.332+03:00 level=INFO source=gpu_windows.go:214 msg="" package=0 cores=16 efficiency=0 threads=32 time=2025-08-05T20:24:23.846+03:00 level=INFO source=amd_windows.go:127 msg="unsupported Radeon iGPU detected skipping" id=0 total="37.1 GiB" time=2025-08-05T20:24:23.853+03:00 level=INFO source=types.go:130 msg="inference compute" id=GPU-58701cb1-c62d-0fd0-0d37-6db9041c57b7 library=cuda variant=v12 compute=12.0 driver=12.9 name="NVIDIA GeForce RTX 5090" total="31.8 GiB" available="30.1 GiB" time=2025-08-05T20:24:34.516+03:00 level=INFO source=sched.go:786 msg="new model will fit in available VRAM in single GPU, loading" model=C:\Users\avatar\.ollama\models\blobs\sha256-b112e727c6f18875636c56a779790a590d705aec9e1c0eb5a97d51fc2a778583 gpu=GPU-58701cb1-c62d-0fd0-0d37-6db9041c57b7 parallel=1 available=29754978304 required="14.9 GiB" time=2025-08-05T20:24:34.530+03:00 level=INFO source=server.go:135 msg="system memory" total="93.6 GiB" free="62.3 GiB" free_swap="48.5 GiB" time=2025-08-05T20:24:34.531+03:00 level=INFO source=server.go:175 msg=offload library=cuda layers.requested=-1 layers.model=25 layers.offload=25 layers.split="" memory.available="[27.7 GiB]" memory.gpu_overhead="0 B" memory.required.full="14.9 GiB" memory.required.partial="14.9 GiB" memory.required.kv="300.0 MiB" memory.required.allocations="[14.9 GiB]" memory.weights.total="11.7 GiB" memory.weights.repeating="10.7 GiB" memory.weights.nonrepeating="1.1 GiB" memory.graph.full="2.0 GiB" memory.graph.partial="4.0 GiB" time=2025-08-05T20:24:34.573+03:00 level=INFO source=server.go:438 msg="starting llama server" cmd="G:\\data\\ollama\\ollama.exe runner --ollama-engine --model C:\\Users\\avatar\\.ollama\\models\\blobs\\sha256-b112e727c6f18875636c56a779790a590d705aec9e1c0eb5a97d51fc2a778583 --ctx-size 8192 --batch-size 512 --n-gpu-layers 25 --threads 16 --no-mmap --parallel 1 --port 55206" time=2025-08-05T20:24:34.577+03:00 level=INFO source=sched.go:481 msg="loaded runners" count=1 time=2025-08-05T20:24:34.577+03:00 level=INFO source=server.go:598 msg="waiting for llama runner to start responding" time=2025-08-05T20:24:34.579+03:00 level=INFO source=server.go:632 msg="waiting for server to become available" status="llm server error" time=2025-08-05T20:24:34.657+03:00 level=INFO source=runner.go:925 msg="starting ollama engine" time=2025-08-05T20:24:34.659+03:00 level=INFO source=runner.go:983 msg="Server listening on 127.0.0.1:55206" time=2025-08-05T20:24:34.688+03:00 level=INFO source=ggml.go:92 msg="" architecture=gptoss file_type=MXFP4 name="" description="" num_tensors=315 num_key_values=30 ggml_cuda_init: GGML_CUDA_FORCE_MMQ: no ggml_cuda_init: GGML_CUDA_FORCE_CUBLAS: no ggml_cuda_init: found 1 CUDA devices: Device 0: NVIDIA GeForce RTX 5090, compute capability 12.0, VMM: yes load_backend: loaded CUDA backend from G:\data\ollama\lib\ollama\ggml-cuda.dll load_backend: loaded CPU backend from G:\data\ollama\lib\ollama\ggml-cpu-icelake.dll ggml_cuda_init: GGML_CUDA_FORCE_MMQ: no ggml_cuda_init: GGML_CUDA_FORCE_CUBLAS: no ggml_cuda_init: found 1 CUDA devices: Device 0: NVIDIA GeForce RTX 5090, compute capability 12.0, VMM: yes load_backend: loaded CUDA backend from G:\data\ollama\lib\ollama\cuda_v12\ggml-cuda.dll time=2025-08-05T20:24:34.795+03:00 level=INFO source=ggml.go:104 msg=system CPU.0.SSE3=1 CPU.0.SSSE3=1 CPU.0.AVX=1 CPU.0.AVX2=1 CPU.0.F16C=1 CPU.0.FMA=1 CPU.0.BMI2=1 CPU.0.AVX512=1 CPU.0.AVX512_VBMI=1 CPU.0.AVX512_VNNI=1 CPU.0.LLAMAFILE=1 CPU.1.LLAMAFILE=1 CUDA.0.ARCHS=500,600,610,700,750,800,860,870,890,900,1200 CUDA.0.USE_GRAPHS=1 CUDA.0.PEER_MAX_BATCH_SIZE=128 CUDA.1.ARCHS=500,600,610,700,750,800,860,870,890,900,1200 CUDA.1.USE_GRAPHS=1 CUDA.1.PEER_MAX_BATCH_SIZE=128 compiler=cgo(clang) time=2025-08-05T20:24:34.832+03:00 level=INFO source=server.go:632 msg="waiting for server to become available" status="llm server loading model" unexpected fault address 0x787b00000 fatal error: fault [signal 0xc0000005 code=0x0 addr=0x787b00000 pc=0x7ff764497180] goroutine 51 gp=0xc0005868c0 m=11 mp=0xc000680008 [running]: runtime.throw({0x7ff7656f9c06?, 0xc000056a08?}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/panic.go:1096 +0x4d fp=0xc0000490c8 sp=0xc000049098 pc=0x7ff7645061ed runtime.sigpanic() C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/signal_windows.go:414 +0xd0 fp=0xc000049110 sp=0xc0000490c8 pc=0x7ff7644e8f10 indexbytebody() C:/hostedtoolcache/windows/go/1.24.0/x64/src/internal/bytealg/indexbyte_amd64.s:131 +0xe0 fp=0xc000049118 sp=0xc000049110 pc=0x7ff764497180 runtime.findnull(0xc000049198?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/string.go:577 +0x79 fp=0xc000049170 sp=0xc000049118 pc=0x7ff7644ee039 runtime.gostring(0x787b00000) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/string.go:363 +0x1c fp=0xc0000491a8 sp=0xc000049170 pc=0x7ff764508d5c github.com/ollama/ollama/ml/backend/ggml._Cfunc_GoString(...) _cgo_gotypes.go:307 github.com/ollama/ollama/ml/backend/ggml.New({0xc00003a150, 0x6c}, {0x10, 0x0, 0x19, {0x0, 0x0, 0x0}, 0x0}) C:/a/ollama-private/ollama-private/ml/backend/ggml/ggml.go:158 +0x1359 fp=0xc000049c18 sp=0xc0000491a8 pc=0x7ff764959579 github.com/ollama/ollama/ml.NewBackend({0xc00003a150, 0x6c}, {0x10, 0x0, 0x19, {0x0, 0x0, 0x0}, 0x0}) C:/a/ollama-private/ollama-private/ml/backend.go:209 +0xb1 fp=0xc000049c70 sp=0xc000049c18 pc=0x7ff764949751 github.com/ollama/ollama/model.New({0xc00003a150?, 0x0?}, {0x10, 0x0, 0x19, {0x0, 0x0, 0x0}, 0x0}) C:/a/ollama-private/ollama-private/model/model.go:102 +0x8f fp=0xc000049d68 sp=0xc000049c70 pc=0x7ff764969b8f github.com/ollama/ollama/runner/ollamarunner.(*Server).initModel(0xc0007cbc20, {0xc00003a150?, 0x0?}, {0x10, 0x0, 0x19, {0x0, 0x0, 0x0}, 0x0}, ...) C:/a/ollama-private/ollama-private/runner/ollamarunner/runner.go:841 +0x8d fp=0xc000049dc8 sp=0xc000049d68 pc=0x7ff764a106ed github.com/ollama/ollama/runner/ollamarunner.(*Server).load(0xc0007cbc20, {0x7ff7658d7d20, 0xc000378320}, {0xc00003a150?, 0x0?}, {0x10, 0x0, 0x19, {0x0, 0x0, ...}, ...}, ...) C:/a/ollama-private/ollama-private/runner/ollamarunner/runner.go:878 +0xb8 fp=0xc000049f20 sp=0xc000049dc8 pc=0x7ff764a10a58 github.com/ollama/ollama/runner/ollamarunner.Execute.gowrap1() C:/a/ollama-private/ollama-private/runner/ollamarunner/runner.go:959 +0xc7 fp=0xc000049fe0 sp=0xc000049f20 pc=0x7ff764a11e87 runtime.goexit({}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000049fe8 sp=0xc000049fe0 pc=0x7ff76450db01 created by github.com/ollama/ollama/runner/ollamarunner.Execute in goroutine 1 C:/a/ollama-private/ollama-private/runner/ollamarunner/runner.go:959 +0xa11 goroutine 1 gp=0xc0000021c0 m=nil [IO wait]: runtime.gopark(0x7ff76450f300?, 0x7ff766231580?, 0x20?, 0xd4?, 0xc00051d4cc?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc00059b508 sp=0xc00059b4e8 pc=0x7ff76450630e runtime.netpollblock(0x30c?, 0x644a0446?, 0xf7?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/netpoll.go:575 +0xf7 fp=0xc00059b540 sp=0xc00059b508 pc=0x7ff7644cbf37 internal/poll.runtime_pollWait(0x14472624e00, 0x72) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/netpoll.go:351 +0x85 fp=0xc00059b560 sp=0xc00059b540 pc=0x7ff7645054a5 internal/poll.(*pollDesc).wait(0x7ff76459a293?, 0x7ff7644b2776?, 0x0) C:/hostedtoolcache/windows/go/1.24.0/x64/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc00059b588 sp=0xc00059b560 pc=0x7ff76459b887 internal/poll.execIO(0xc00051d420, 0xc00059b630) C:/hostedtoolcache/windows/go/1.24.0/x64/src/internal/poll/fd_windows.go:177 +0x105 fp=0xc00059b600 sp=0xc00059b588 pc=0x7ff76459cce5 internal/poll.(*FD).acceptOne(0xc00051d408, 0x4c0, {0xc0000f00f0?, 0x7ff7644bae05?, 0x7ff7662a6760?}, 0x28cdf6a?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/internal/poll/fd_windows.go:946 +0x65 fp=0xc00059b660 sp=0xc00059b600 pc=0x7ff7645a1265 internal/poll.(*FD).Accept(0xc00051d408, 0xc00059b810) C:/hostedtoolcache/windows/go/1.24.0/x64/src/internal/poll/fd_windows.go:980 +0x1b6 fp=0xc00059b718 sp=0xc00059b660 pc=0x7ff7645a1596 net.(*netFD).accept(0xc00051d408) C:/hostedtoolcache/windows/go/1.24.0/x64/src/net/fd_windows.go:182 +0x4b fp=0xc00059b830 sp=0xc00059b718 pc=0x7ff7646121ab net.(*TCPListener).accept(0xc000412180) C:/hostedtoolcache/windows/go/1.24.0/x64/src/net/tcpsock_posix.go:159 +0x1b fp=0xc00059b880 sp=0xc00059b830 pc=0x7ff7646281fb net.(*TCPListener).Accept(0xc000412180) C:/hostedtoolcache/windows/go/1.24.0/x64/src/net/tcpsock.go:380 +0x30 fp=0xc00059b8b0 sp=0xc00059b880 pc=0x7ff764626fb0 net/http.(*onceCloseListener).Accept(0xc000191ef0?) <autogenerated>:1 +0x24 fp=0xc00059b8c8 sp=0xc00059b8b0 pc=0x7ff7648403a4 net/http.(*Server).Serve(0xc000050100, {0x7ff7658d5700, 0xc000412180}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/net/http/server.go:3424 +0x30c fp=0xc00059b9f8 sp=0xc00059b8c8 pc=0x7ff764817c6c github.com/ollama/ollama/runner/ollamarunner.Execute({0xc0000de030, 0xf, 0x1d}) C:/a/ollama-private/ollama-private/runner/ollamarunner/runner.go:984 +0xe09 fp=0xc00059bd08 sp=0xc00059b9f8 pc=0x7ff764a11ae9 github.com/ollama/ollama/runner.Execute({0xc0000de010?, 0x0?, 0x0?}) C:/a/ollama-private/ollama-private/runner/runner.go:20 +0xc9 fp=0xc00059bd30 sp=0xc00059bd08 pc=0x7ff764a123e9 github.com/ollama/ollama/cmd.NewCLI.func2(0xc000051600?, {0x7ff7656f87aa?, 0x4?, 0x7ff7656f87ae?}) C:/a/ollama-private/ollama-private/cmd/cmd.go:1583 +0x45 fp=0xc00059bd58 sp=0xc00059bd30 pc=0x7ff765179045 github.com/spf13/cobra.(*Command).execute(0xc000536f08, {0xc000051800, 0x10, 0x10}) C:/Users/runneradmin/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:940 +0x85c fp=0xc00059be78 sp=0xc00059bd58 pc=0x7ff76468cc7c github.com/spf13/cobra.(*Command).ExecuteC(0xc0007df508) C:/Users/runneradmin/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:1068 +0x3a5 fp=0xc00059bf30 sp=0xc00059be78 pc=0x7ff76468d4c5 github.com/spf13/cobra.(*Command).Execute(...) C:/Users/runneradmin/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:992 github.com/spf13/cobra.(*Command).ExecuteContext(...) C:/Users/runneradmin/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:985 main.main() C:/a/ollama-private/ollama-private/main.go:12 +0x4d fp=0xc00059bf50 sp=0xc00059bf30 pc=0x7ff765179b2d runtime.main() C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:283 +0x27d fp=0xc00059bfe0 sp=0xc00059bf50 pc=0x7ff7644d4f1d runtime.goexit({}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00059bfe8 sp=0xc00059bfe0 pc=0x7ff76450db01 goroutine 2 gp=0xc0000028c0 m=nil [force gc (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc0000a7fa8 sp=0xc0000a7f88 pc=0x7ff76450630e runtime.goparkunlock(...) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:441 runtime.forcegchelper() C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:348 +0xb8 fp=0xc0000a7fe0 sp=0xc0000a7fa8 pc=0x7ff7644d5238 runtime.goexit({}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000a7fe8 sp=0xc0000a7fe0 pc=0x7ff76450db01 created by runtime.init.7 in goroutine 1 C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:336 +0x1a goroutine 3 gp=0xc000002c40 m=nil [GC sweep wait]: runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc0000a9f80 sp=0xc0000a9f60 pc=0x7ff76450630e runtime.goparkunlock(...) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:441 runtime.bgsweep(0xc0000b6000) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgcsweep.go:316 +0xdf fp=0xc0000a9fc8 sp=0xc0000a9f80 pc=0x7ff7644bdfff runtime.gcenable.gowrap1() C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:204 +0x25 fp=0xc0000a9fe0 sp=0xc0000a9fc8 pc=0x7ff7644b23c5 runtime.goexit({}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000a9fe8 sp=0xc0000a9fe0 pc=0x7ff76450db01 created by runtime.gcenable in goroutine 1 C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:204 +0x66 goroutine 4 gp=0xc000002e00 m=nil [GC scavenge wait]: runtime.gopark(0x10000?, 0x7ff7658c2760?, 0x0?, 0x0?, 0x0?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc0000bdf78 sp=0xc0000bdf58 pc=0x7ff76450630e runtime.goparkunlock(...) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:441 runtime.(*scavengerState).park(0x7ff766257c80) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgcscavenge.go:425 +0x49 fp=0xc0000bdfa8 sp=0xc0000bdf78 pc=0x7ff7644bba49 runtime.bgscavenge(0xc0000b6000) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgcscavenge.go:658 +0x59 fp=0xc0000bdfc8 sp=0xc0000bdfa8 pc=0x7ff7644bbfd9 runtime.gcenable.gowrap2() C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:205 +0x25 fp=0xc0000bdfe0 sp=0xc0000bdfc8 pc=0x7ff7644b2365 runtime.goexit({}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000bdfe8 sp=0xc0000bdfe0 pc=0x7ff76450db01 created by runtime.gcenable in goroutine 1 C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:205 +0xa5 goroutine 5 gp=0xc000003340 m=nil [finalizer wait]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc0000bfe30 sp=0xc0000bfe10 pc=0x7ff76450630e runtime.runfinq() C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mfinal.go:196 +0x107 fp=0xc0000bffe0 sp=0xc0000bfe30 pc=0x7ff7644b1347 runtime.goexit({}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000bffe8 sp=0xc0000bffe0 pc=0x7ff76450db01 created by runtime.createfing in goroutine 1 C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mfinal.go:166 +0x3d goroutine 6 gp=0xc000003dc0 m=nil [chan receive]: runtime.gopark(0xc0002275e0?, 0xc0007b0048?, 0x60?, 0xbf?, 0x7ff7645fb0e8?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc0000abf18 sp=0xc0000abef8 pc=0x7ff76450630e runtime.chanrecv(0xc00003a3f0, 0x0, 0x1) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/chan.go:664 +0x445 fp=0xc0000abf90 sp=0xc0000abf18 pc=0x7ff7644a2d85 runtime.chanrecv1(0x7ff7644d5080?, 0xc0000abf76?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/chan.go:506 +0x12 fp=0xc0000abfb8 sp=0xc0000abf90 pc=0x7ff7644a2912 runtime.unique_runtime_registerUniqueMapCleanup.func2(...) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1796 runtime.unique_runtime_registerUniqueMapCleanup.gowrap1() C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1799 +0x2f fp=0xc0000abfe0 sp=0xc0000abfb8 pc=0x7ff7644b55ef runtime.goexit({}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000abfe8 sp=0xc0000abfe0 pc=0x7ff76450db01 created by unique.runtime_registerUniqueMapCleanup in goroutine 1 C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1794 +0x85 goroutine 7 gp=0xc0004181c0 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc0000b9f38 sp=0xc0000b9f18 pc=0x7ff76450630e runtime.gcBgMarkWorker(0xc00003b810) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc0000b9fc8 sp=0xc0000b9f38 pc=0x7ff7644b48e9 runtime.gcBgMarkStartWorkers.gowrap1() C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc0000b9fe0 sp=0xc0000b9fc8 pc=0x7ff7644b47c5 runtime.goexit({}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000b9fe8 sp=0xc0000b9fe0 pc=0x7ff76450db01 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105 goroutine 18 gp=0xc0001061c0 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc000113f38 sp=0xc000113f18 pc=0x7ff76450630e runtime.gcBgMarkWorker(0xc00003b810) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000113fc8 sp=0xc000113f38 pc=0x7ff7644b48e9 runtime.gcBgMarkStartWorkers.gowrap1() C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc000113fe0 sp=0xc000113fc8 pc=0x7ff7644b47c5 runtime.goexit({}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000113fe8 sp=0xc000113fe0 pc=0x7ff76450db01 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105 goroutine 34 gp=0xc000484000 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc00010ff38 sp=0xc00010ff18 pc=0x7ff76450630e runtime.gcBgMarkWorker(0xc00003b810) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc00010ffc8 sp=0xc00010ff38 pc=0x7ff7644b48e9 runtime.gcBgMarkStartWorkers.gowrap1() C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc00010ffe0 sp=0xc00010ffc8 pc=0x7ff7644b47c5 runtime.goexit({}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00010ffe8 sp=0xc00010ffe0 pc=0x7ff76450db01 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105 goroutine 8 gp=0xc000418380 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc0000bbf38 sp=0xc0000bbf18 pc=0x7ff76450630e runtime.gcBgMarkWorker(0xc00003b810) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc0000bbfc8 sp=0xc0000bbf38 pc=0x7ff7644b48e9 runtime.gcBgMarkStartWorkers.gowrap1() C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc0000bbfe0 sp=0xc0000bbfc8 pc=0x7ff7644b47c5 runtime.goexit({}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000bbfe8 sp=0xc0000bbfe0 pc=0x7ff76450db01 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105 goroutine 19 gp=0xc000106380 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc000115f38 sp=0xc000115f18 pc=0x7ff76450630e runtime.gcBgMarkWorker(0xc00003b810) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000115fc8 sp=0xc000115f38 pc=0x7ff7644b48e9 runtime.gcBgMarkStartWorkers.gowrap1() C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc000115fe0 sp=0xc000115fc8 pc=0x7ff7644b47c5 runtime.goexit({}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000115fe8 sp=0xc000115fe0 pc=0x7ff76450db01 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105 goroutine 35 gp=0xc0004841c0 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc000111f38 sp=0xc000111f18 pc=0x7ff76450630e runtime.gcBgMarkWorker(0xc00003b810) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000111fc8 sp=0xc000111f38 pc=0x7ff7644b48e9 runtime.gcBgMarkStartWorkers.gowrap1() C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc000111fe0 sp=0xc000111fc8 pc=0x7ff7644b47c5 runtime.goexit({}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000111fe8 sp=0xc000111fe0 pc=0x7ff76450db01 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105 goroutine 9 gp=0xc000418540 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc000475f38 sp=0xc000475f18 pc=0x7ff76450630e runtime.gcBgMarkWorker(0xc00003b810) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000475fc8 sp=0xc000475f38 pc=0x7ff7644b48e9 runtime.gcBgMarkStartWorkers.gowrap1() C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc000475fe0 sp=0xc000475fc8 pc=0x7ff7644b47c5 runtime.goexit({}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000475fe8 sp=0xc000475fe0 pc=0x7ff76450db01 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105 goroutine 20 gp=0xc000106540 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc000471f38 sp=0xc000471f18 pc=0x7ff76450630e runtime.gcBgMarkWorker(0xc00003b810) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000471fc8 sp=0xc000471f38 pc=0x7ff7644b48e9 runtime.gcBgMarkStartWorkers.gowrap1() C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc000471fe0 sp=0xc000471fc8 pc=0x7ff7644b47c5 runtime.goexit({}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000471fe8 sp=0xc000471fe0 pc=0x7ff76450db01 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105 goroutine 36 gp=0xc000484380 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc00048bf38 sp=0xc00048bf18 pc=0x7ff76450630e runtime.gcBgMarkWorker(0xc00003b810) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc00048bfc8 sp=0xc00048bf38 pc=0x7ff7644b48e9 runtime.gcBgMarkStartWorkers.gowrap1() C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc00048bfe0 sp=0xc00048bfc8 pc=0x7ff7644b47c5 runtime.goexit({}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00048bfe8 sp=0xc00048bfe0 pc=0x7ff76450db01 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105 goroutine 10 gp=0xc000418700 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc000477f38 sp=0xc000477f18 pc=0x7ff76450630e runtime.gcBgMarkWorker(0xc00003b810) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000477fc8 sp=0xc000477f38 pc=0x7ff7644b48e9 runtime.gcBgMarkStartWorkers.gowrap1() C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc000477fe0 sp=0xc000477fc8 pc=0x7ff7644b47c5 runtime.goexit({}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000477fe8 sp=0xc000477fe0 pc=0x7ff76450db01 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105 goroutine 21 gp=0xc000106700 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc000473f38 sp=0xc000473f18 pc=0x7ff76450630e runtime.gcBgMarkWorker(0xc00003b810) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000473fc8 sp=0xc000473f38 pc=0x7ff7644b48e9 runtime.gcBgMarkStartWorkers.gowrap1() C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc000473fe0 sp=0xc000473fc8 pc=0x7ff7644b47c5 runtime.goexit({}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000473fe8 sp=0xc000473fe0 pc=0x7ff76450db01 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105 goroutine 37 gp=0xc000484540 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc00048df38 sp=0xc00048df18 pc=0x7ff76450630e runtime.gcBgMarkWorker(0xc00003b810) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc00048dfc8 sp=0xc00048df38 pc=0x7ff7644b48e9 runtime.gcBgMarkStartWorkers.gowrap1() C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc00048dfe0 sp=0xc00048dfc8 pc=0x7ff7644b47c5 runtime.goexit({}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00048dfe8 sp=0xc00048dfe0 pc=0x7ff76450db01 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105 goroutine 11 gp=0xc0004188c0 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc000487f38 sp=0xc000487f18 pc=0x7ff76450630e runtime.gcBgMarkWorker(0xc00003b810) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000487fc8 sp=0xc000487f38 pc=0x7ff7644b48e9 runtime.gcBgMarkStartWorkers.gowrap1() C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc000487fe0 sp=0xc000487fc8 pc=0x7ff7644b47c5 runtime.goexit({}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000487fe8 sp=0xc000487fe0 pc=0x7ff76450db01 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105 goroutine 22 gp=0xc0001068c0 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc00011df38 sp=0xc00011df18 pc=0x7ff76450630e runtime.gcBgMarkWorker(0xc00003b810) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc00011dfc8 sp=0xc00011df38 pc=0x7ff7644b48e9 runtime.gcBgMarkStartWorkers.gowrap1() C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc00011dfe0 sp=0xc00011dfc8 pc=0x7ff7644b47c5 runtime.goexit({}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00011dfe8 sp=0xc00011dfe0 pc=0x7ff76450db01 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105 goroutine 38 gp=0xc000484700 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc000119f38 sp=0xc000119f18 pc=0x7ff76450630e runtime.gcBgMarkWorker(0xc00003b810) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000119fc8 sp=0xc000119f38 pc=0x7ff7644b48e9 runtime.gcBgMarkStartWorkers.gowrap1() C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc000119fe0 sp=0xc000119fc8 pc=0x7ff7644b47c5 runtime.goexit({}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000119fe8 sp=0xc000119fe0 pc=0x7ff76450db01 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105 goroutine 12 gp=0xc000418a80 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc000489f38 sp=0xc000489f18 pc=0x7ff76450630e runtime.gcBgMarkWorker(0xc00003b810) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000489fc8 sp=0xc000489f38 pc=0x7ff7644b48e9 runtime.gcBgMarkStartWorkers.gowrap1() C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc000489fe0 sp=0xc000489fc8 pc=0x7ff7644b47c5 runtime.goexit({}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000489fe8 sp=0xc000489fe0 pc=0x7ff76450db01 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105 goroutine 39 gp=0xc0004848c0 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc00011bf38 sp=0xc00011bf18 pc=0x7ff76450630e runtime.gcBgMarkWorker(0xc00003b810) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc00011bfc8 sp=0xc00011bf38 pc=0x7ff7644b48e9 runtime.gcBgMarkStartWorkers.gowrap1() C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc00011bfe0 sp=0xc00011bfc8 pc=0x7ff7644b47c5 runtime.goexit({}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00011bfe8 sp=0xc00011bfe0 pc=0x7ff76450db01 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105 goroutine 13 gp=0xc000418c40 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc00047df38 sp=0xc00047df18 pc=0x7ff76450630e runtime.gcBgMarkWorker(0xc00003b810) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc00047dfc8 sp=0xc00047df38 pc=0x7ff7644b48e9 runtime.gcBgMarkStartWorkers.gowrap1() C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc00047dfe0 sp=0xc00047dfc8 pc=0x7ff7644b47c5 runtime.goexit({}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00047dfe8 sp=0xc00047dfe0 pc=0x7ff76450db01 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105 goroutine 23 gp=0xc000106a80 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc00011ff38 sp=0xc00011ff18 pc=0x7ff76450630e runtime.gcBgMarkWorker(0xc00003b810) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc00011ffc8 sp=0xc00011ff38 pc=0x7ff7644b48e9 runtime.gcBgMarkStartWorkers.gowrap1() C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc00011ffe0 sp=0xc00011ffc8 pc=0x7ff7644b47c5 runtime.goexit({}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00011ffe8 sp=0xc00011ffe0 pc=0x7ff76450db01 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105 goroutine 40 gp=0xc000484a80 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc000479f38 sp=0xc000479f18 pc=0x7ff76450630e runtime.gcBgMarkWorker(0xc00003b810) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000479fc8 sp=0xc000479f38 pc=0x7ff7644b48e9 runtime.gcBgMarkStartWorkers.gowrap1() C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc000479fe0 sp=0xc000479fc8 pc=0x7ff7644b47c5 runtime.goexit({}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000479fe8 sp=0xc000479fe0 pc=0x7ff76450db01 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105 goroutine 14 gp=0xc000418e00 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc00047ff38 sp=0xc00047ff18 pc=0x7ff76450630e runtime.gcBgMarkWorker(0xc00003b810) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc00047ffc8 sp=0xc00047ff38 pc=0x7ff7644b48e9 runtime.gcBgMarkStartWorkers.gowrap1() C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc00047ffe0 sp=0xc00047ffc8 pc=0x7ff7644b47c5 runtime.goexit({}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00047ffe8 sp=0xc00047ffe0 pc=0x7ff76450db01 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105 goroutine 24 gp=0xc000106c40 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc000125f38 sp=0xc000125f18 pc=0x7ff76450630e runtime.gcBgMarkWorker(0xc00003b810) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000125fc8 sp=0xc000125f38 pc=0x7ff7644b48e9 runtime.gcBgMarkStartWorkers.gowrap1() C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc000125fe0 sp=0xc000125fc8 pc=0x7ff7644b47c5 runtime.goexit({}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000125fe8 sp=0xc000125fe0 pc=0x7ff76450db01 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105 goroutine 41 gp=0xc000484c40 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc00047bf38 sp=0xc00047bf18 pc=0x7ff76450630e runtime.gcBgMarkWorker(0xc00003b810) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc00047bfc8 sp=0xc00047bf38 pc=0x7ff7644b48e9 runtime.gcBgMarkStartWorkers.gowrap1() C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc00047bfe0 sp=0xc00047bfc8 pc=0x7ff7644b47c5 runtime.goexit({}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00047bfe8 sp=0xc00047bfe0 pc=0x7ff76450db01 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105 goroutine 15 gp=0xc000418fc0 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc000121f38 sp=0xc000121f18 pc=0x7ff76450630e runtime.gcBgMarkWorker(0xc00003b810) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000121fc8 sp=0xc000121f38 pc=0x7ff7644b48e9 runtime.gcBgMarkStartWorkers.gowrap1() C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc000121fe0 sp=0xc000121fc8 pc=0x7ff7644b47c5 runtime.goexit({}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000121fe8 sp=0xc000121fe0 pc=0x7ff76450db01 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105 goroutine 25 gp=0xc000106e00 m=nil [GC worker (idle)]: runtime.gopark(0x7ff7662a6760?, 0x1?, 0x7c?, 0x70?, 0x0?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc000127f38 sp=0xc000127f18 pc=0x7ff76450630e runtime.gcBgMarkWorker(0xc00003b810) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000127fc8 sp=0xc000127f38 pc=0x7ff7644b48e9 runtime.gcBgMarkStartWorkers.gowrap1() C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc000127fe0 sp=0xc000127fc8 pc=0x7ff7644b47c5 runtime.goexit({}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000127fe8 sp=0xc000127fe0 pc=0x7ff76450db01 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105 goroutine 42 gp=0xc000484e00 m=nil [GC worker (idle)]: runtime.gopark(0x7ff7662a6760?, 0x1?, 0x0?, 0x0?, 0x0?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc000493f38 sp=0xc000493f18 pc=0x7ff76450630e runtime.gcBgMarkWorker(0xc00003b810) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000493fc8 sp=0xc000493f38 pc=0x7ff7644b48e9 runtime.gcBgMarkStartWorkers.gowrap1() C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc000493fe0 sp=0xc000493fc8 pc=0x7ff7644b47c5 runtime.goexit({}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000493fe8 sp=0xc000493fe0 pc=0x7ff76450db01 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105 goroutine 16 gp=0xc000419180 m=nil [GC worker (idle)]: runtime.gopark(0x7ff7662a6760?, 0x1?, 0x0?, 0x0?, 0x0?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc000123f38 sp=0xc000123f18 pc=0x7ff76450630e runtime.gcBgMarkWorker(0xc00003b810) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000123fc8 sp=0xc000123f38 pc=0x7ff7644b48e9 runtime.gcBgMarkStartWorkers.gowrap1() C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc000123fe0 sp=0xc000123fc8 pc=0x7ff7644b47c5 runtime.goexit({}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000123fe8 sp=0xc000123fe0 pc=0x7ff76450db01 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105 goroutine 26 gp=0xc000106fc0 m=nil [GC worker (idle)]: runtime.gopark(0x19b056b033948?, 0x1?, 0x1c?, 0x27?, 0x0?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc00048ff38 sp=0xc00048ff18 pc=0x7ff76450630e runtime.gcBgMarkWorker(0xc00003b810) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc00048ffc8 sp=0xc00048ff38 pc=0x7ff7644b48e9 runtime.gcBgMarkStartWorkers.gowrap1() C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc00048ffe0 sp=0xc00048ffc8 pc=0x7ff7644b47c5 runtime.goexit({}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00048ffe8 sp=0xc00048ffe0 pc=0x7ff76450db01 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105 goroutine 43 gp=0xc000484fc0 m=nil [GC worker (idle)]: runtime.gopark(0x7ff7662a6760?, 0x1?, 0x34?, 0x3c?, 0x0?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc000495f38 sp=0xc000495f18 pc=0x7ff76450630e runtime.gcBgMarkWorker(0xc00003b810) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000495fc8 sp=0xc000495f38 pc=0x7ff7644b48e9 runtime.gcBgMarkStartWorkers.gowrap1() C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc000495fe0 sp=0xc000495fc8 pc=0x7ff7644b47c5 runtime.goexit({}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000495fe8 sp=0xc000495fe0 pc=0x7ff76450db01 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105 goroutine 50 gp=0xc000419340 m=nil [GC worker (idle)]: runtime.gopark(0x7ff7662a6760?, 0x1?, 0x0?, 0x0?, 0x0?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc000505f38 sp=0xc000505f18 pc=0x7ff76450630e runtime.gcBgMarkWorker(0xc00003b810) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000505fc8 sp=0xc000505f38 pc=0x7ff7644b48e9 runtime.gcBgMarkStartWorkers.gowrap1() C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc000505fe0 sp=0xc000505fc8 pc=0x7ff7644b47c5 runtime.goexit({}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000505fe8 sp=0xc000505fe0 pc=0x7ff76450db01 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105 goroutine 27 gp=0xc000107180 m=nil [GC worker (idle)]: runtime.gopark(0x7ff7662a6760?, 0x1?, 0x34?, 0x3c?, 0x0?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc000491f38 sp=0xc000491f18 pc=0x7ff76450630e runtime.gcBgMarkWorker(0xc00003b810) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000491fc8 sp=0xc000491f38 pc=0x7ff7644b48e9 runtime.gcBgMarkStartWorkers.gowrap1() C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc000491fe0 sp=0xc000491fc8 pc=0x7ff7644b47c5 runtime.goexit({}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000491fe8 sp=0xc000491fe0 pc=0x7ff76450db01 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105 goroutine 44 gp=0xc000485180 m=nil [GC worker (idle)]: runtime.gopark(0x19b056b033948?, 0x1?, 0x0?, 0x0?, 0x0?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc000501f38 sp=0xc000501f18 pc=0x7ff76450630e runtime.gcBgMarkWorker(0xc00003b810) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000501fc8 sp=0xc000501f38 pc=0x7ff7644b48e9 runtime.gcBgMarkStartWorkers.gowrap1() C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x25 fp=0xc000501fe0 sp=0xc000501fc8 pc=0x7ff7644b47c5 runtime.goexit({}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000501fe8 sp=0xc000501fe0 pc=0x7ff76450db01 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/mgc.go:1339 +0x105 goroutine 52 gp=0xc000586a80 m=nil [sync.WaitGroup.Wait]: runtime.gopark(0x0?, 0x0?, 0x60?, 0x5e?, 0x0?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc000507ed0 sp=0xc000507eb0 pc=0x7ff76450630e runtime.goparkunlock(...) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:441 runtime.semacquire1(0xc0007cbc28, 0x0, 0x1, 0x0, 0x18) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/sema.go:188 +0x22f fp=0xc000507f38 sp=0xc000507ed0 pc=0x7ff7644e764f sync.runtime_SemacquireWaitGroup(0x0?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/sema.go:110 +0x25 fp=0xc000507f70 sp=0xc000507f38 pc=0x7ff7645079e5 sync.(*WaitGroup).Wait(0x0?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/sync/waitgroup.go:118 +0x48 fp=0xc000507f98 sp=0xc000507f70 pc=0x7ff76451b9c8 github.com/ollama/ollama/runner/ollamarunner.(*Server).run(0xc0007cbc20, {0x7ff7658d7d20, 0xc000378320}) C:/a/ollama-private/ollama-private/runner/ollamarunner/runner.go:355 +0x25 fp=0xc000507fb8 sp=0xc000507f98 pc=0x7ff764a0c605 github.com/ollama/ollama/runner/ollamarunner.Execute.gowrap2() C:/a/ollama-private/ollama-private/runner/ollamarunner/runner.go:960 +0x28 fp=0xc000507fe0 sp=0xc000507fb8 pc=0x7ff764a11d88 runtime.goexit({}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000507fe8 sp=0xc000507fe0 pc=0x7ff76450db01 created by github.com/ollama/ollama/runner/ollamarunner.Execute in goroutine 1 C:/a/ollama-private/ollama-private/runner/ollamarunner/runner.go:960 +0xa74 goroutine 28 gp=0xc0001076c0 m=nil [IO wait]: runtime.gopark(0x0?, 0xc00051d6a0?, 0x48?, 0xd7?, 0xc00051d74c?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/proc.go:435 +0xce fp=0xc0005978c8 sp=0xc0005978a8 pc=0x7ff76450630e runtime.netpollblock(0x2f4?, 0x644a0446?, 0xf7?) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/netpoll.go:575 +0xf7 fp=0xc000597900 sp=0xc0005978c8 pc=0x7ff7644cbf37 internal/poll.runtime_pollWait(0x14472624ce8, 0x72) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/netpoll.go:351 +0x85 fp=0xc000597920 sp=0xc000597900 pc=0x7ff7645054a5 internal/poll.(*pollDesc).wait(0x7ff7646cbc57?, 0xc000597970?, 0x0) C:/hostedtoolcache/windows/go/1.24.0/x64/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc000597948 sp=0xc000597920 pc=0x7ff76459b887 internal/poll.execIO(0xc00051d6a0, 0x7ff76576dd68) C:/hostedtoolcache/windows/go/1.24.0/x64/src/internal/poll/fd_windows.go:177 +0x105 fp=0xc0005979c0 sp=0xc000597948 pc=0x7ff76459cce5 internal/poll.(*FD).Read(0xc00051d688, {0xc00148a000, 0x1000, 0x1000}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/internal/poll/fd_windows.go:438 +0x29b fp=0xc000597a60 sp=0xc0005979c0 pc=0x7ff76459d9bb net.(*netFD).Read(0xc00051d688, {0xc00148a000?, 0xc000597ad0?, 0x7ff76459bd45?}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/net/fd_posix.go:55 +0x25 fp=0xc000597aa8 sp=0xc000597a60 pc=0x7ff7646102c5 net.(*conn).Read(0xc0000ae000, {0xc00148a000?, 0x0?, 0x0?}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/net/net.go:194 +0x45 fp=0xc000597af0 sp=0xc000597aa8 pc=0x7ff76461f7a5 net/http.(*connReader).Read(0xc000362330, {0xc00148a000, 0x1000, 0x1000}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/net/http/server.go:798 +0x159 fp=0xc000597b40 sp=0xc000597af0 pc=0x7ff76480cb19 bufio.(*Reader).fill(0xc0007e01e0) C:/hostedtoolcache/windows/go/1.24.0/x64/src/bufio/bufio.go:113 +0x103 fp=0xc000597b78 sp=0xc000597b40 pc=0x7ff764635fe3 bufio.(*Reader).Peek(0xc0007e01e0, 0x4) C:/hostedtoolcache/windows/go/1.24.0/x64/src/bufio/bufio.go:152 +0x53 fp=0xc000597b98 sp=0xc000597b78 pc=0x7ff764636113 net/http.(*conn).serve(0xc000191ef0, {0x7ff7658d7ce8, 0xc0002202a0}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/net/http/server.go:2137 +0x785 fp=0xc000597fb8 sp=0xc000597b98 pc=0x7ff764812905 net/http.(*Server).Serve.gowrap3() C:/hostedtoolcache/windows/go/1.24.0/x64/src/net/http/server.go:3454 +0x28 fp=0xc000597fe0 sp=0xc000597fb8 pc=0x7ff764818068 runtime.goexit({}) C:/hostedtoolcache/windows/go/1.24.0/x64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000597fe8 sp=0xc000597fe0 pc=0x7ff76450db01 created by net/http.(*Server).Serve in goroutine 1 C:/hostedtoolcache/windows/go/1.24.0/x64/src/net/http/server.go:3454 +0x485 time=2025-08-05T20:24:34.990+03:00 level=ERROR source=server.go:464 msg="llama runner terminated" error="exit status 2" time=2025-08-05T20:24:35.082+03:00 level=ERROR source=sched.go:487 msg="error loading llama server" error="llama runner process has terminated: error:fault" [GIN] 2025/08/05 - 20:24:35 | 500 | 677.4778ms | 172.23.52.248 | POST "/api/chat" ``` ### OS Windows 11 ### GPU 5090 ### CPU 9950X ### Ollama version 0.11.0
GiteaMirror added the bug label 2026-04-29 05:25:20 -05:00
Author
Owner

@lattwood commented on GitHub (Aug 5, 2025):

I'm getting the same thing. In my case, the signal showed up during cgo, while it was in CUDA code. Being on linux, I have a driver error from the kernel which should help w/ reproduction and solving-

This is on an RTX 3090.

Aug 05 17:30:15 skullnix ollama[191267]: [GIN] 2025/08/05 - 17:30:15 | 200 | 13.278820371s |       10.18.1.1 | POST     "/api/generate"
Aug 05 17:30:51 skullnix kernel: NVRM: Xid (PCI:0000:0c:00): 31, pid=191685, name=ollama, Ch 0000000d, intr 00000000. MMU Fault: ENGINE GRAPHICS GPC1 GPCCLIENT_T1_8 faulted @ 0x7f07_2ec28000. Fault is of type FAULT_PTE ACCESS_TYPE_VIRT_WRITE
Aug 05 17:30:51 skullnix ollama[191267]: CUDA error: an illegal memory access was encountered
Aug 05 17:30:51 skullnix ollama[191267]:   current device: 0, in function ggml_cuda_mul_mat_id at //ml/backend/ggml/ggml/src/ggml-cuda/ggml-cuda.cu:2052
Aug 05 17:30:51 skullnix ollama[191267]:   cudaMemcpyAsync(ids_host.data(), ids->data, ggml_nbytes(ids), cudaMemcpyDeviceToHost, stream)
Aug 05 17:30:51 skullnix ollama[191267]: //ml/backend/ggml/ggml/src/ggml-cuda/ggml-cuda.cu:77: CUDA error

I'm running the Docker version

<!-- gh-comment-id:3156028323 --> @lattwood commented on GitHub (Aug 5, 2025): I'm getting the same thing. In my case, the signal showed up during cgo, while it was in CUDA code. Being on linux, I have a driver error from the kernel which should help w/ reproduction and solving- This is on an RTX 3090. ``` Aug 05 17:30:15 skullnix ollama[191267]: [GIN] 2025/08/05 - 17:30:15 | 200 | 13.278820371s | 10.18.1.1 | POST "/api/generate" Aug 05 17:30:51 skullnix kernel: NVRM: Xid (PCI:0000:0c:00): 31, pid=191685, name=ollama, Ch 0000000d, intr 00000000. MMU Fault: ENGINE GRAPHICS GPC1 GPCCLIENT_T1_8 faulted @ 0x7f07_2ec28000. Fault is of type FAULT_PTE ACCESS_TYPE_VIRT_WRITE Aug 05 17:30:51 skullnix ollama[191267]: CUDA error: an illegal memory access was encountered Aug 05 17:30:51 skullnix ollama[191267]: current device: 0, in function ggml_cuda_mul_mat_id at //ml/backend/ggml/ggml/src/ggml-cuda/ggml-cuda.cu:2052 Aug 05 17:30:51 skullnix ollama[191267]: cudaMemcpyAsync(ids_host.data(), ids->data, ggml_nbytes(ids), cudaMemcpyDeviceToHost, stream) Aug 05 17:30:51 skullnix ollama[191267]: //ml/backend/ggml/ggml/src/ggml-cuda/ggml-cuda.cu:77: CUDA error ``` I'm running the Docker version
Author
Owner

@lattwood commented on GitHub (Aug 5, 2025):

Also, cutting a release on tag 0.11.0 when the code isn't accurate is awful.

I take it the head of this branch is actually 0.11.0? https://github.com/ollama/ollama/pull/11672

<!-- gh-comment-id:3156033930 --> @lattwood commented on GitHub (Aug 5, 2025): Also, cutting a release on tag 0.11.0 when the code isn't accurate is awful. I take it the head of this branch is actually 0.11.0? https://github.com/ollama/ollama/pull/11672
Author
Owner

@lattwood commented on GitHub (Aug 5, 2025):

15e06ed91a/ml/backend/ggml/ggml/src/ggml-cuda/ggml-cuda.cu (L2052)

actual line of code the crash is occurring at

<!-- gh-comment-id:3156038138 --> @lattwood commented on GitHub (Aug 5, 2025): https://github.com/ollama/ollama/blob/15e06ed91a04d5f069960583ebe9e1ba80bb744c/ml/backend/ggml/ggml/src/ggml-cuda/ggml-cuda.cu#L2052 actual line of code the crash is occurring at
Author
Owner

@jessegross commented on GitHub (Aug 5, 2025):

@kapolos Your log looks the same as https://github.com/ollama/ollama/issues/11211, please follow the steps there (uninstall and reinstall).

@lattwood Your issue is probably different, please post the full log.

<!-- gh-comment-id:3156055676 --> @jessegross commented on GitHub (Aug 5, 2025): @kapolos Your log looks the same as https://github.com/ollama/ollama/issues/11211, please follow the steps there (uninstall and reinstall). @lattwood Your issue is probably different, please post the full log.
Author
Owner

@mikhail-shevtsov-wiregate commented on GitHub (Aug 5, 2025):

@jessegross Running in Docker v.0.11.0 on RTX 3090

Full log

docker log

docker compose up
[+] Running 1/1
 ✔ Container ollama-ollama-1  Created                                                                                                                             0.0s 
Attaching to ollama-1
ollama-1  | time=2025-08-05T17:57:15.513Z level=INFO source=routes.go:1297 msg="server config" env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_CONTEXT_LENGTH:4096 OLLAMA_DEBUG:DEBUG OLLAMA_FLASH_ATTENTION:true OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://0.0.0.0:11434 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE:q8_0 OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/root/.ollama/models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NEW_ENGINE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:1 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://* vscode-file://*] OLLAMA_SCHED_SPREAD:false ROCR_VISIBLE_DEVICES: http_proxy: https_proxy: no_proxy:]"
ollama-1  | time=2025-08-05T17:57:15.515Z level=INFO source=images.go:477 msg="total blobs: 16"
ollama-1  | time=2025-08-05T17:57:15.515Z level=INFO source=images.go:484 msg="total unused blobs removed: 0"
ollama-1  | time=2025-08-05T17:57:15.516Z level=INFO source=routes.go:1350 msg="Listening on [::]:11434 (version 0.11.0)"
ollama-1  | time=2025-08-05T17:57:15.516Z level=DEBUG source=sched.go:106 msg="starting llm scheduler"
ollama-1  | time=2025-08-05T17:57:15.516Z level=INFO source=gpu.go:217 msg="looking for compatible GPUs"
ollama-1  | time=2025-08-05T17:57:15.518Z level=DEBUG source=gpu.go:98 msg="searching for GPU discovery libraries for NVIDIA"
ollama-1  | time=2025-08-05T17:57:15.518Z level=DEBUG source=gpu.go:501 msg="Searching for GPU library" name=libcuda.so*
ollama-1  | time=2025-08-05T17:57:15.518Z level=DEBUG source=gpu.go:525 msg="gpu library search" globs="[/usr/lib/ollama/libcuda.so* /usr/local/nvidia/lib/libcuda.so* /usr/local/nvidia/lib64/libcuda.so* /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]"
ollama-1  | time=2025-08-05T17:57:15.519Z level=DEBUG source=gpu.go:558 msg="discovered GPU libraries" paths=[/usr/lib/x86_64-linux-gnu/libcuda.so.550.163.01]
ollama-1  | initializing /usr/lib/x86_64-linux-gnu/libcuda.so.550.163.01
ollama-1  | dlsym: cuInit - 0x7d7015e7ce20
ollama-1  | dlsym: cuDriverGetVersion - 0x7d7015e7ce40
ollama-1  | dlsym: cuDeviceGetCount - 0x7d7015e7ce80
ollama-1  | dlsym: cuDeviceGet - 0x7d7015e7ce60
ollama-1  | dlsym: cuDeviceGetAttribute - 0x7d7015e7cf60
ollama-1  | dlsym: cuDeviceGetUuid - 0x7d7015e7cec0
ollama-1  | dlsym: cuDeviceGetName - 0x7d7015e7cea0
ollama-1  | dlsym: cuCtxCreate_v3 - 0x7d7015e7d140
ollama-1  | dlsym: cuMemGetInfo_v2 - 0x7d7015e87080
ollama-1  | dlsym: cuCtxDestroy - 0x7d7015ee19c0
ollama-1  | calling cuInit
ollama-1  | calling cuDriverGetVersion
ollama-1  | raw version 0x2f08
ollama-1  | CUDA driver version: 12.4
ollama-1  | calling cuDeviceGetCount
ollama-1  | device count 1
ollama-1  | time=2025-08-05T17:57:15.525Z level=DEBUG source=gpu.go:125 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.163.01
ollama-1  | [GPU-4a702f36-6e27-c7db-15af-79cfe15ee9df] CUDA totalMem 24252mb
ollama-1  | [GPU-4a702f36-6e27-c7db-15af-79cfe15ee9df] CUDA freeMem 23991mb
ollama-1  | [GPU-4a702f36-6e27-c7db-15af-79cfe15ee9df] Compute Capability 8.6
ollama-1  | time=2025-08-05T17:57:15.670Z level=DEBUG source=amd_linux.go:419 msg="amdgpu driver not detected /sys/module/amdgpu"
ollama-1  | releasing cuda driver library
ollama-1  | time=2025-08-05T17:57:15.670Z level=INFO source=types.go:130 msg="inference compute" id=GPU-4a702f36-6e27-c7db-15af-79cfe15ee9df library=cuda variant=v12 compute=8.6 driver=12.4 name="NVIDIA GeForce RTX 3090" total="23.7 GiB" available="23.4 GiB"
ollama-1  | [GIN] 2025/08/05 - 17:57:21 | 200 |      66.772µs |       127.0.0.1 | HEAD     "/"
ollama-1  | time=2025-08-05T17:57:21.769Z level=DEBUG source=ggml.go:208 msg="key with type not found" key=general.alignment default=32
ollama-1  | [GIN] 2025/08/05 - 17:57:21 | 200 |  129.204587ms |       127.0.0.1 | POST     "/api/show"
ollama-1  | time=2025-08-05T17:57:21.860Z level=DEBUG source=gpu.go:391 msg="updating system memory data" before.total="62.5 GiB" before.free="53.1 GiB" before.free_swap="0 B" now.total="62.5 GiB" now.free="53.1 GiB" now.free_swap="0 B"
ollama-1  | initializing /usr/lib/x86_64-linux-gnu/libcuda.so.550.163.01
ollama-1  | dlsym: cuInit - 0x7d7015e7ce20
ollama-1  | dlsym: cuDriverGetVersion - 0x7d7015e7ce40
ollama-1  | dlsym: cuDeviceGetCount - 0x7d7015e7ce80
ollama-1  | dlsym: cuDeviceGet - 0x7d7015e7ce60
ollama-1  | dlsym: cuDeviceGetAttribute - 0x7d7015e7cf60
ollama-1  | dlsym: cuDeviceGetUuid - 0x7d7015e7cec0
ollama-1  | dlsym: cuDeviceGetName - 0x7d7015e7cea0
ollama-1  | dlsym: cuCtxCreate_v3 - 0x7d7015e7d140
ollama-1  | dlsym: cuMemGetInfo_v2 - 0x7d7015e87080
ollama-1  | dlsym: cuCtxDestroy - 0x7d7015ee19c0
ollama-1  | calling cuInit
ollama-1  | calling cuDriverGetVersion
ollama-1  | raw version 0x2f08
ollama-1  | CUDA driver version: 12.4
ollama-1  | calling cuDeviceGetCount
ollama-1  | device count 1
ollama-1  | time=2025-08-05T17:57:22.008Z level=DEBUG source=gpu.go:441 msg="updating cuda memory data" gpu=GPU-4a702f36-6e27-c7db-15af-79cfe15ee9df name="NVIDIA GeForce RTX 3090" overhead="0 B" before.total="23.7 GiB" before.free="23.4 GiB" now.total="23.7 GiB" now.free="23.4 GiB" now.used="261.1 MiB"
ollama-1  | releasing cuda driver library
ollama-1  | time=2025-08-05T17:57:22.008Z level=DEBUG source=sched.go:183 msg="updating default concurrency" OLLAMA_MAX_LOADED_MODELS=3 gpu_count=1
ollama-1  | time=2025-08-05T17:57:22.047Z level=DEBUG source=ggml.go:208 msg="key with type not found" key=general.alignment default=32
ollama-1  | time=2025-08-05T17:57:22.129Z level=DEBUG source=sched.go:226 msg="loading first model" model=/root/.ollama/models/blobs/sha256-b112e727c6f18875636c56a779790a590d705aec9e1c0eb5a97d51fc2a778583
ollama-1  | time=2025-08-05T17:57:22.129Z level=DEBUG source=memory.go:111 msg=evaluating library=cuda gpu_count=1 available="[23.4 GiB]"
ollama-1  | time=2025-08-05T17:57:22.129Z level=DEBUG source=ggml.go:208 msg="key with type not found" key=gptoss.vision.block_count default=0
ollama-1  | time=2025-08-05T17:57:22.130Z level=DEBUG source=gpu.go:391 msg="updating system memory data" before.total="62.5 GiB" before.free="53.1 GiB" before.free_swap="0 B" now.total="62.5 GiB" now.free="53.0 GiB" now.free_swap="0 B"
ollama-1  | initializing /usr/lib/x86_64-linux-gnu/libcuda.so.550.163.01
ollama-1  | dlsym: cuInit - 0x7d7015e7ce20
ollama-1  | dlsym: cuDriverGetVersion - 0x7d7015e7ce40
ollama-1  | dlsym: cuDeviceGetCount - 0x7d7015e7ce80
ollama-1  | dlsym: cuDeviceGet - 0x7d7015e7ce60
ollama-1  | dlsym: cuDeviceGetAttribute - 0x7d7015e7cf60
ollama-1  | dlsym: cuDeviceGetUuid - 0x7d7015e7cec0
ollama-1  | dlsym: cuDeviceGetName - 0x7d7015e7cea0
ollama-1  | dlsym: cuCtxCreate_v3 - 0x7d7015e7d140
ollama-1  | dlsym: cuMemGetInfo_v2 - 0x7d7015e87080
ollama-1  | dlsym: cuCtxDestroy - 0x7d7015ee19c0
ollama-1  | calling cuInit
ollama-1  | calling cuDriverGetVersion
ollama-1  | raw version 0x2f08
ollama-1  | CUDA driver version: 12.4
ollama-1  | calling cuDeviceGetCount
ollama-1  | device count 1
ollama-1  | time=2025-08-05T17:57:22.260Z level=DEBUG source=gpu.go:441 msg="updating cuda memory data" gpu=GPU-4a702f36-6e27-c7db-15af-79cfe15ee9df name="NVIDIA GeForce RTX 3090" overhead="0 B" before.total="23.7 GiB" before.free="23.4 GiB" now.total="23.7 GiB" now.free="23.4 GiB" now.used="261.1 MiB"
ollama-1  | releasing cuda driver library
ollama-1  | time=2025-08-05T17:57:22.261Z level=INFO source=sched.go:786 msg="new model will fit in available VRAM in single GPU, loading" model=/root/.ollama/models/blobs/sha256-b112e727c6f18875636c56a779790a590d705aec9e1c0eb5a97d51fc2a778583 gpu=GPU-4a702f36-6e27-c7db-15af-79cfe15ee9df parallel=1 available=25157042176 required="13.8 GiB"
ollama-1  | time=2025-08-05T17:57:22.261Z level=DEBUG source=gpu.go:391 msg="updating system memory data" before.total="62.5 GiB" before.free="53.0 GiB" before.free_swap="0 B" now.total="62.5 GiB" now.free="53.0 GiB" now.free_swap="0 B"
ollama-1  | initializing /usr/lib/x86_64-linux-gnu/libcuda.so.550.163.01
ollama-1  | dlsym: cuInit - 0x7d7015e7ce20
ollama-1  | dlsym: cuDriverGetVersion - 0x7d7015e7ce40
ollama-1  | dlsym: cuDeviceGetCount - 0x7d7015e7ce80
ollama-1  | dlsym: cuDeviceGet - 0x7d7015e7ce60
ollama-1  | dlsym: cuDeviceGetAttribute - 0x7d7015e7cf60
ollama-1  | dlsym: cuDeviceGetUuid - 0x7d7015e7cec0
ollama-1  | dlsym: cuDeviceGetName - 0x7d7015e7cea0
ollama-1  | dlsym: cuCtxCreate_v3 - 0x7d7015e7d140
ollama-1  | dlsym: cuMemGetInfo_v2 - 0x7d7015e87080
ollama-1  | dlsym: cuCtxDestroy - 0x7d7015ee19c0
ollama-1  | calling cuInit
ollama-1  | calling cuDriverGetVersion
ollama-1  | raw version 0x2f08
ollama-1  | CUDA driver version: 12.4
ollama-1  | calling cuDeviceGetCount
ollama-1  | device count 1
ollama-1  | time=2025-08-05T17:57:22.390Z level=DEBUG source=gpu.go:441 msg="updating cuda memory data" gpu=GPU-4a702f36-6e27-c7db-15af-79cfe15ee9df name="NVIDIA GeForce RTX 3090" overhead="0 B" before.total="23.7 GiB" before.free="23.4 GiB" now.total="23.7 GiB" now.free="23.4 GiB" now.used="261.1 MiB"
ollama-1  | releasing cuda driver library
ollama-1  | time=2025-08-05T17:57:22.390Z level=INFO source=server.go:135 msg="system memory" total="62.5 GiB" free="53.0 GiB" free_swap="0 B"
ollama-1  | time=2025-08-05T17:57:22.390Z level=DEBUG source=memory.go:111 msg=evaluating library=cuda gpu_count=1 available="[23.4 GiB]"
ollama-1  | time=2025-08-05T17:57:22.390Z level=DEBUG source=ggml.go:208 msg="key with type not found" key=gptoss.vision.block_count default=0
ollama-1  | time=2025-08-05T17:57:22.391Z level=DEBUG source=gpu.go:391 msg="updating system memory data" before.total="62.5 GiB" before.free="53.0 GiB" before.free_swap="0 B" now.total="62.5 GiB" now.free="53.0 GiB" now.free_swap="0 B"
ollama-1  | initializing /usr/lib/x86_64-linux-gnu/libcuda.so.550.163.01
ollama-1  | dlsym: cuInit - 0x7d7015e7ce20
ollama-1  | dlsym: cuDriverGetVersion - 0x7d7015e7ce40
ollama-1  | dlsym: cuDeviceGetCount - 0x7d7015e7ce80
ollama-1  | dlsym: cuDeviceGet - 0x7d7015e7ce60
ollama-1  | dlsym: cuDeviceGetAttribute - 0x7d7015e7cf60
ollama-1  | dlsym: cuDeviceGetUuid - 0x7d7015e7cec0
ollama-1  | dlsym: cuDeviceGetName - 0x7d7015e7cea0
ollama-1  | dlsym: cuCtxCreate_v3 - 0x7d7015e7d140
ollama-1  | dlsym: cuMemGetInfo_v2 - 0x7d7015e87080
ollama-1  | dlsym: cuCtxDestroy - 0x7d7015ee19c0
ollama-1  | calling cuInit
ollama-1  | calling cuDriverGetVersion
ollama-1  | raw version 0x2f08
ollama-1  | CUDA driver version: 12.4
ollama-1  | calling cuDeviceGetCount
ollama-1  | device count 1
ollama-1  | time=2025-08-05T17:57:22.512Z level=DEBUG source=gpu.go:441 msg="updating cuda memory data" gpu=GPU-4a702f36-6e27-c7db-15af-79cfe15ee9df name="NVIDIA GeForce RTX 3090" overhead="0 B" before.total="23.7 GiB" before.free="23.4 GiB" now.total="23.7 GiB" now.free="23.4 GiB" now.used="261.1 MiB"
ollama-1  | releasing cuda driver library
ollama-1  | time=2025-08-05T17:57:22.512Z level=INFO source=server.go:175 msg=offload library=cuda layers.requested=-1 layers.model=25 layers.offload=25 layers.split="" memory.available="[23.4 GiB]" memory.gpu_overhead="0 B" memory.required.full="13.8 GiB" memory.required.partial="13.8 GiB" memory.required.kv="150.0 MiB" memory.required.allocations="[13.8 GiB]" memory.weights.total="11.7 GiB" memory.weights.repeating="10.7 GiB" memory.weights.nonrepeating="1.1 GiB" memory.graph.full="1.0 GiB" memory.graph.partial="2.0 GiB"
ollama-1  | time=2025-08-05T17:57:22.513Z level=INFO source=server.go:218 msg="enabling flash attention"
ollama-1  | time=2025-08-05T17:57:22.513Z level=DEBUG source=server.go:291 msg="compatible gpu libraries" compatible=[]
ollama-1  | time=2025-08-05T17:57:22.582Z level=DEBUG source=ggml.go:208 msg="key with type not found" key=general.alignment default=32
ollama-1  | time=2025-08-05T17:57:22.583Z level=DEBUG source=ggml.go:208 msg="key with type not found" key=tokenizer.ggml.pretokenizer default="[^\\r\\n\\p{L}\\p{N}]?[\\p{Lu}\\p{Lt}\\p{Lm}\\p{Lo}\\p{M}]*[\\p{Ll}\\p{Lm}\\p{Lo}\\p{M}]+(?i:'s|'t|'re|'ve|'m|'ll|'d)?|[^\\r\\n\\p{L}\\p{N}]?[\\p{Lu}\\p{Lt}\\p{Lm}\\p{Lo}\\p{M}]+[\\p{Ll}\\p{Lm}\\p{Lo}\\p{M}]*(?i:'s|'t|'re|'ve|'m|'ll|'d)?|\\p{N}{1,3}| ?[^\\s\\p{L}\\p{N}]+[\\r\\n/]*|\\s*[\\r\\n]+|\\s+(?!\\S)|\\s+"
ollama-1  | time=2025-08-05T17:57:22.583Z level=INFO source=server.go:438 msg="starting llama server" cmd="/usr/bin/ollama runner --ollama-engine --model /root/.ollama/models/blobs/sha256-b112e727c6f18875636c56a779790a590d705aec9e1c0eb5a97d51fc2a778583 --ctx-size 8192 --batch-size 512 --n-gpu-layers 25 --threads 8 --flash-attn --kv-cache-type q8_0 --parallel 1 --port 45347"
ollama-1  | time=2025-08-05T17:57:22.583Z level=DEBUG source=server.go:439 msg=subprocess PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin OLLAMA_FLASH_ATTENTION=1 OLLAMA_KV_CACHE_TYPE=q8_0 OLLAMA_DEBUG=1 LD_LIBRARY_PATH=/usr/lib/ollama:/usr/local/nvidia/lib:/usr/local/nvidia/lib64:/usr/lib/ollama OLLAMA_HOST=0.0.0.0:11434 OLLAMA_MAX_LOADED_MODELS=3 OLLAMA_LIBRARY_PATH=/usr/lib/ollama CUDA_VISIBLE_DEVICES=GPU-4a702f36-6e27-c7db-15af-79cfe15ee9df
ollama-1  | time=2025-08-05T17:57:22.584Z level=INFO source=sched.go:481 msg="loaded runners" count=1
ollama-1  | time=2025-08-05T17:57:22.584Z level=INFO source=server.go:598 msg="waiting for llama runner to start responding"
ollama-1  | time=2025-08-05T17:57:22.584Z level=INFO source=server.go:632 msg="waiting for server to become available" status="llm server not responding"
ollama-1  | time=2025-08-05T17:57:22.598Z level=INFO source=runner.go:925 msg="starting ollama engine"
ollama-1  | time=2025-08-05T17:57:22.599Z level=INFO source=runner.go:983 msg="Server listening on 127.0.0.1:45347"
ollama-1  | time=2025-08-05T17:57:22.672Z level=DEBUG source=ggml.go:208 msg="key with type not found" key=general.alignment default=32
ollama-1  | time=2025-08-05T17:57:22.673Z level=DEBUG source=ggml.go:208 msg="key with type not found" key=general.name default=""
ollama-1  | time=2025-08-05T17:57:22.673Z level=DEBUG source=ggml.go:208 msg="key with type not found" key=general.description default=""
ollama-1  | time=2025-08-05T17:57:22.673Z level=INFO source=ggml.go:92 msg="" architecture=gptoss file_type=MXFP4 name="" description="" num_tensors=315 num_key_values=30
ollama-1  | time=2025-08-05T17:57:22.673Z level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=/usr/lib/ollama
ollama-1  | ggml_cuda_init: GGML_CUDA_FORCE_MMQ:    no
ollama-1  | ggml_cuda_init: GGML_CUDA_FORCE_CUBLAS: no
ollama-1  | ggml_cuda_init: found 1 CUDA devices:
ollama-1  |   Device 0: NVIDIA GeForce RTX 3090, compute capability 8.6, VMM: yes
ollama-1  | load_backend: loaded CUDA backend from /usr/lib/ollama/libggml-cuda.so
ollama-1  | load_backend: loaded CPU backend from /usr/lib/ollama/libggml-cpu-haswell.so
ollama-1  | time=2025-08-05T17:57:22.735Z level=INFO source=ggml.go:104 msg=system CPU.0.SSE3=1 CPU.0.SSSE3=1 CPU.0.AVX=1 CPU.0.AVX2=1 CPU.0.F16C=1 CPU.0.FMA=1 CPU.0.BMI2=1 CPU.0.LLAMAFILE=1 CPU.1.LLAMAFILE=1 CUDA.0.ARCHS=500,600,610,700,750,800,860,870,890,900,1200 CUDA.0.USE_GRAPHS=1 CUDA.0.PEER_MAX_BATCH_SIZE=128 compiler=cgo(gcc)
ollama-1  | time=2025-08-05T17:57:22.819Z level=INFO source=ggml.go:367 msg="offloading 24 repeating layers to GPU"
ollama-1  | time=2025-08-05T17:57:22.819Z level=INFO source=ggml.go:373 msg="offloading output layer to GPU"
ollama-1  | time=2025-08-05T17:57:22.819Z level=INFO source=ggml.go:378 msg="offloaded 25/25 layers to GPU"
ollama-1  | time=2025-08-05T17:57:22.819Z level=INFO source=ggml.go:381 msg="model weights" buffer=CUDA0 size="11.7 GiB"
ollama-1  | time=2025-08-05T17:57:22.819Z level=INFO source=ggml.go:381 msg="model weights" buffer=CPU size="1.1 GiB"
ollama-1  | time=2025-08-05T17:57:22.820Z level=DEBUG source=ggml.go:208 msg="key with type not found" key=tokenizer.ggml.pretokenizer default="[^\\r\\n\\p{L}\\p{N}]?[\\p{Lu}\\p{Lt}\\p{Lm}\\p{Lo}\\p{M}]*[\\p{Ll}\\p{Lm}\\p{Lo}\\p{M}]+(?i:'s|'t|'re|'ve|'m|'ll|'d)?|[^\\r\\n\\p{L}\\p{N}]?[\\p{Lu}\\p{Lt}\\p{Lm}\\p{Lo}\\p{M}]+[\\p{Ll}\\p{Lm}\\p{Lo}\\p{M}]*(?i:'s|'t|'re|'ve|'m|'ll|'d)?|\\p{N}{1,3}| ?[^\\s\\p{L}\\p{N}]+[\\r\\n/]*|\\s*[\\r\\n]+|\\s+(?!\\S)|\\s+"
ollama-1  | time=2025-08-05T17:57:22.835Z level=DEBUG source=ggml.go:654 msg="compute graph" nodes=1847 splits=2
ollama-1  | time=2025-08-05T17:57:22.835Z level=INFO source=ggml.go:672 msg="compute graph" backend=CUDA0 buffer_type=CUDA0 size="2.1 GiB"
ollama-1  | time=2025-08-05T17:57:22.835Z level=INFO source=ggml.go:672 msg="compute graph" backend=CPU buffer_type=CPU size="5.6 MiB"
ollama-1  | time=2025-08-05T17:57:22.835Z level=DEBUG source=runner.go:883 msg=memory allocated.InputWeights=1158266880A allocated.CPU.Graph=5898240A allocated.CUDA0.ID=GPU-4a702f36-6e27-c7db-15af-79cfe15ee9df allocated.CUDA0.Weights="[477075840A 477075840A 477075840A 477075840A 477075840A 477075840A 477075840A 477075840A 477075840A 477075840A 477075840A 477075840A 477075840A 477075840A 477075840A 477075840A 477075840A 477075840A 477075840A 477075840A 477075840A 477075840A 477075840A 477075840A 1158278400A]" allocated.CUDA0.Cache="[5014016A 8913408A 5014016A 8913408A 5014016A 8913408A 5014016A 8913408A 5014016A 8913408A 5014016A 8913408A 5014016A 8913408A 5014016A 8913408A 5014016A 8913408A 5014016A 8913408A 5014016A 8913408A 5014016A 8913408A 0U]" allocated.CUDA0.Graph=2204502272A
ollama-1  | time=2025-08-05T17:57:22.835Z level=INFO source=server.go:632 msg="waiting for server to become available" status="llm server loading model"
ollama-1  | time=2025-08-05T17:57:23.086Z level=DEBUG source=server.go:643 msg="model load progress 0.04"
ollama-1  | time=2025-08-05T17:57:23.337Z level=DEBUG source=server.go:643 msg="model load progress 0.07"
ollama-1  | time=2025-08-05T17:57:23.588Z level=DEBUG source=server.go:643 msg="model load progress 0.10"
ollama-1  | time=2025-08-05T17:57:23.838Z level=DEBUG source=server.go:643 msg="model load progress 0.14"
ollama-1  | time=2025-08-05T17:57:24.089Z level=DEBUG source=server.go:643 msg="model load progress 0.18"
ollama-1  | time=2025-08-05T17:57:24.340Z level=DEBUG source=server.go:643 msg="model load progress 0.21"
ollama-1  | time=2025-08-05T17:57:24.590Z level=DEBUG source=server.go:643 msg="model load progress 0.25"
ollama-1  | time=2025-08-05T17:57:24.841Z level=DEBUG source=server.go:643 msg="model load progress 0.28"
ollama-1  | time=2025-08-05T17:57:25.092Z level=DEBUG source=server.go:643 msg="model load progress 0.32"
ollama-1  | time=2025-08-05T17:57:25.342Z level=DEBUG source=server.go:643 msg="model load progress 0.35"
ollama-1  | time=2025-08-05T17:57:25.593Z level=DEBUG source=server.go:643 msg="model load progress 0.39"
ollama-1  | time=2025-08-05T17:57:25.844Z level=DEBUG source=server.go:643 msg="model load progress 0.43"
ollama-1  | time=2025-08-05T17:57:26.095Z level=DEBUG source=server.go:643 msg="model load progress 0.46"
ollama-1  | time=2025-08-05T17:57:26.345Z level=DEBUG source=server.go:643 msg="model load progress 0.50"
ollama-1  | time=2025-08-05T17:57:26.596Z level=DEBUG source=server.go:643 msg="model load progress 0.53"
ollama-1  | time=2025-08-05T17:57:26.847Z level=DEBUG source=server.go:643 msg="model load progress 0.57"
ollama-1  | time=2025-08-05T17:57:27.097Z level=DEBUG source=server.go:643 msg="model load progress 0.60"
ollama-1  | time=2025-08-05T17:57:27.348Z level=DEBUG source=server.go:643 msg="model load progress 0.64"
ollama-1  | time=2025-08-05T17:57:27.599Z level=DEBUG source=server.go:643 msg="model load progress 0.68"
ollama-1  | time=2025-08-05T17:57:27.849Z level=DEBUG source=server.go:643 msg="model load progress 0.71"
ollama-1  | time=2025-08-05T17:57:28.100Z level=DEBUG source=server.go:643 msg="model load progress 0.77"
ollama-1  | time=2025-08-05T17:57:28.351Z level=DEBUG source=server.go:643 msg="model load progress 0.84"
ollama-1  | time=2025-08-05T17:57:28.602Z level=DEBUG source=server.go:643 msg="model load progress 0.90"
ollama-1  | time=2025-08-05T17:57:28.853Z level=DEBUG source=server.go:643 msg="model load progress 0.94"
ollama-1  | time=2025-08-05T17:57:29.104Z level=DEBUG source=server.go:643 msg="model load progress 0.96"
ollama-1  | time=2025-08-05T17:57:29.355Z level=DEBUG source=server.go:643 msg="model load progress 0.98"
ollama-1  | time=2025-08-05T17:57:29.606Z level=INFO source=server.go:637 msg="llama runner started in 7.02 seconds"
ollama-1  | time=2025-08-05T17:57:29.606Z level=DEBUG source=sched.go:493 msg="finished setting up" runner.name=registry.ollama.ai/library/gpt-oss:20b runner.inference=cuda runner.devices=1 runner.size="13.8 GiB" runner.vram="13.8 GiB" runner.parallel=1 runner.pid=58 runner.model=/root/.ollama/models/blobs/sha256-b112e727c6f18875636c56a779790a590d705aec9e1c0eb5a97d51fc2a778583 runner.num_ctx=8192
ollama-1  | [GIN] 2025/08/05 - 17:57:29 | 200 |  7.833381242s |       127.0.0.1 | POST     "/api/generate"
ollama-1  | time=2025-08-05T17:57:29.606Z level=DEBUG source=sched.go:501 msg="context for request finished"
ollama-1  | time=2025-08-05T17:57:29.606Z level=DEBUG source=sched.go:341 msg="runner with non-zero duration has gone idle, adding timer" runner.name=registry.ollama.ai/library/gpt-oss:20b runner.inference=cuda runner.devices=1 runner.size="13.8 GiB" runner.vram="13.8 GiB" runner.parallel=1 runner.pid=58 runner.model=/root/.ollama/models/blobs/sha256-b112e727c6f18875636c56a779790a590d705aec9e1c0eb5a97d51fc2a778583 runner.num_ctx=8192 duration=5m0s
ollama-1  | time=2025-08-05T17:57:29.606Z level=DEBUG source=sched.go:359 msg="after processing request finished event" runner.name=registry.ollama.ai/library/gpt-oss:20b runner.inference=cuda runner.devices=1 runner.size="13.8 GiB" runner.vram="13.8 GiB" runner.parallel=1 runner.pid=58 runner.model=/root/.ollama/models/blobs/sha256-b112e727c6f18875636c56a779790a590d705aec9e1c0eb5a97d51fc2a778583 runner.num_ctx=8192 refCount=0
ollama-1  | time=2025-08-05T17:57:31.478Z level=DEBUG source=sched.go:613 msg="evaluating already loaded" model=/root/.ollama/models/blobs/sha256-b112e727c6f18875636c56a779790a590d705aec9e1c0eb5a97d51fc2a778583
ollama-1  | time=2025-08-05T17:57:31.479Z level=DEBUG source=server.go:736 msg="completion request" images=0 prompt=315 format=""
ollama-1  | time=2025-08-05T17:57:31.534Z level=DEBUG source=cache.go:136 msg="loading cache slot" id=0 cache=0 prompt=71 used=0 remaining=71
ollama-1  | CUDA error: an illegal memory access was encountered
ollama-1  |   current device: 0, in function ggml_cuda_mul_mat_id at //ml/backend/ggml/ggml/src/ggml-cuda/ggml-cuda.cu:2052
ollama-1  |   cudaMemcpyAsync(ids_host.data(), ids->data, ggml_nbytes(ids), cudaMemcpyDeviceToHost, stream)
ollama-1  | //ml/backend/ggml/ggml/src/ggml-cuda/ggml-cuda.cu:77: CUDA error
ollama-1  | SIGSEGV: segmentation violation
ollama-1  | PC=0x7a2450624fb7 m=15 sigcode=1 addr=0x204a03f7c
ollama-1  | signal arrived during cgo execution
ollama-1  | 
ollama-1  | goroutine 12 gp=0xc000103c00 m=15 mp=0xc000581808 [syscall]:
ollama-1  | runtime.cgocall(0x60f6099ec180, 0xc000125a58)
ollama-1  |     runtime/cgocall.go:167 +0x4b fp=0xc000125a30 sp=0xc0001259f8 pc=0x60f608d1f8cb
ollama-1  | github.com/ollama/ollama/ml/backend/ggml._Cfunc_ggml_backend_sched_graph_compute_async(0x7a2505011170, 0x7a2048004790)
ollama-1  |     _cgo_gotypes.go:886 +0x4a fp=0xc000125a58 sp=0xc000125a30 pc=0x60f6091594ea
ollama-1  | github.com/ollama/ollama/ml/backend/ggml.(*Context).Compute.func1(...)
ollama-1  |     github.com/ollama/ollama/ml/backend/ggml/ggml.go:631
ollama-1  | github.com/ollama/ollama/ml/backend/ggml.(*Context).Compute(0xc000422000, {0xc00059a480, 0x1, 0x0?})
ollama-1  |     github.com/ollama/ollama/ml/backend/ggml/ggml.go:631 +0x9d fp=0xc000125b00 sp=0xc000125a58 pc=0x60f6091649fd
ollama-1  | github.com/ollama/ollama/model.Forward({0x60f60a0a0d30, 0xc000422000}, {0x60f60a097550, 0xc0000e96b0}, {0xc00012a400, 0x47, 0x80}, {{0x60f60a0ab988, 0xc0006ac360}, {0x0, ...}, ...})
ollama-1  |     github.com/ollama/ollama/model/model.go:305 +0x2a7 fp=0xc000125be8 sp=0xc000125b00 pc=0x60f6091729c7
ollama-1  | github.com/ollama/ollama/runner/ollamarunner.(*Server).processBatch(0xc0004ec5a0)
ollama-1  |     github.com/ollama/ollama/runner/ollamarunner/runner.go:480 +0x4c5 fp=0xc000125f98 sp=0xc000125be8 pc=0x60f609213905
ollama-1  | github.com/ollama/ollama/runner/ollamarunner.(*Server).run(0xc0004ec5a0, {0x60f60a098a30, 0xc000690910})
ollama-1  |     github.com/ollama/ollama/runner/ollamarunner/runner.go:362 +0x4e fp=0xc000125fb8 sp=0xc000125f98 pc=0x60f6092133ee
ollama-1  | github.com/ollama/ollama/runner/ollamarunner.Execute.gowrap2()
ollama-1  |     github.com/ollama/ollama/runner/ollamarunner/runner.go:960 +0x28 fp=0xc000125fe0 sp=0xc000125fb8 pc=0x60f609218b48
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc000125fe8 sp=0xc000125fe0 pc=0x60f608d2a481
ollama-1  | created by github.com/ollama/ollama/runner/ollamarunner.Execute in goroutine 1
ollama-1  |     github.com/ollama/ollama/runner/ollamarunner/runner.go:960 +0xa74
ollama-1  | 
ollama-1  | goroutine 1 gp=0xc000002380 m=nil [IO wait]:
ollama-1  | runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc000123650 sp=0xc000123630 pc=0x60f608d22d4e
ollama-1  | runtime.netpollblock(0xc0001236a0?, 0x8cbbb46?, 0xf6?)
ollama-1  |     runtime/netpoll.go:575 +0xf7 fp=0xc000123688 sp=0xc000123650 pc=0x60f608ce7837
ollama-1  | internal/poll.runtime_pollWait(0x7a25134a6eb0, 0x72)
ollama-1  |     runtime/netpoll.go:351 +0x85 fp=0xc0001236a8 sp=0xc000123688 pc=0x60f608d21f65
ollama-1  | internal/poll.(*pollDesc).wait(0xc0006a0480?, 0x900000036?, 0x0)
ollama-1  |     internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc0001236d0 sp=0xc0001236a8 pc=0x60f608da93a7
ollama-1  | internal/poll.(*pollDesc).waitRead(...)
ollama-1  |     internal/poll/fd_poll_runtime.go:89
ollama-1  | internal/poll.(*FD).Accept(0xc0006a0480)
ollama-1  |     internal/poll/fd_unix.go:620 +0x295 fp=0xc000123778 sp=0xc0001236d0 pc=0x60f608dae775
ollama-1  | net.(*netFD).accept(0xc0006a0480)
ollama-1  |     net/fd_unix.go:172 +0x29 fp=0xc000123830 sp=0xc000123778 pc=0x60f608e20d89
ollama-1  | net.(*TCPListener).accept(0xc000422880)
ollama-1  |     net/tcpsock_posix.go:159 +0x1b fp=0xc000123880 sp=0xc000123830 pc=0x60f608e3673b
ollama-1  | net.(*TCPListener).Accept(0xc000422880)
ollama-1  |     net/tcpsock.go:380 +0x30 fp=0xc0001238b0 sp=0xc000123880 pc=0x60f608e355f0
ollama-1  | net/http.(*onceCloseListener).Accept(0xc0004f0360?)
ollama-1  |     <autogenerated>:1 +0x24 fp=0xc0001238c8 sp=0xc0001238b0 pc=0x60f60904cd44
ollama-1  | net/http.(*Server).Serve(0xc00030a000, {0x60f60a096588, 0xc000422880})
ollama-1  |     net/http/server.go:3424 +0x30c fp=0xc0001239f8 sp=0xc0001238c8 pc=0x60f60902460c
ollama-1  | github.com/ollama/ollama/runner/ollamarunner.Execute({0xc000034170, 0x11, 0x11})
ollama-1  |     github.com/ollama/ollama/runner/ollamarunner/runner.go:984 +0xe09 fp=0xc000123d08 sp=0xc0001239f8 pc=0x60f6092188a9
ollama-1  | github.com/ollama/ollama/runner.Execute({0xc000034150?, 0x0?, 0x0?})
ollama-1  |     github.com/ollama/ollama/runner/runner.go:20 +0xc9 fp=0xc000123d30 sp=0xc000123d08 pc=0x60f6092191a9
ollama-1  | github.com/ollama/ollama/cmd.NewCLI.func2(0xc0001fd200?, {0x60f609bd907b?, 0x4?, 0x60f609bd907f?})
ollama-1  |     github.com/ollama/ollama/cmd/cmd.go:1583 +0x45 fp=0xc000123d58 sp=0xc000123d30 pc=0x60f60997e0e5
ollama-1  | github.com/spf13/cobra.(*Command).execute(0xc0004f4f08, {0xc0004ec360, 0x12, 0x12})
ollama-1  |     github.com/spf13/cobra@v1.7.0/command.go:940 +0x85c fp=0xc000123e78 sp=0xc000123d58 pc=0x60f608e9a3dc
ollama-1  | github.com/spf13/cobra.(*Command).ExecuteC(0xc0004d0908)
ollama-1  |     github.com/spf13/cobra@v1.7.0/command.go:1068 +0x3a5 fp=0xc000123f30 sp=0xc000123e78 pc=0x60f608e9ac25
ollama-1  | github.com/spf13/cobra.(*Command).Execute(...)
ollama-1  |     github.com/spf13/cobra@v1.7.0/command.go:992
ollama-1  | github.com/spf13/cobra.(*Command).ExecuteContext(...)
ollama-1  |     github.com/spf13/cobra@v1.7.0/command.go:985
ollama-1  | main.main()
ollama-1  |     github.com/ollama/ollama/main.go:12 +0x4d fp=0xc000123f50 sp=0xc000123f30 pc=0x60f60997ebcd
ollama-1  | runtime.main()
ollama-1  |     runtime/proc.go:283 +0x29d fp=0xc000123fe0 sp=0xc000123f50 pc=0x60f608ceeebd
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc000123fe8 sp=0xc000123fe0 pc=0x60f608d2a481
ollama-1  | 
ollama-1  | goroutine 2 gp=0xc000002e00 m=nil [force gc (idle)]:
ollama-1  | runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc000084fa8 sp=0xc000084f88 pc=0x60f608d22d4e
ollama-1  | runtime.goparkunlock(...)
ollama-1  |     runtime/proc.go:441
ollama-1  | runtime.forcegchelper()
ollama-1  |     runtime/proc.go:348 +0xb8 fp=0xc000084fe0 sp=0xc000084fa8 pc=0x60f608cef1f8
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc000084fe8 sp=0xc000084fe0 pc=0x60f608d2a481
ollama-1  | created by runtime.init.7 in goroutine 1
ollama-1  |     runtime/proc.go:336 +0x1a
ollama-1  | 
ollama-1  | goroutine 3 gp=0xc000003340 m=nil [GC sweep wait]:
ollama-1  | runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc000085780 sp=0xc000085760 pc=0x60f608d22d4e
ollama-1  | runtime.goparkunlock(...)
ollama-1  |     runtime/proc.go:441
ollama-1  | runtime.bgsweep(0xc0000aa000)
ollama-1  |     runtime/mgcsweep.go:316 +0xdf fp=0xc0000857c8 sp=0xc000085780 pc=0x60f608cd999f
ollama-1  | runtime.gcenable.gowrap1()
ollama-1  |     runtime/mgc.go:204 +0x25 fp=0xc0000857e0 sp=0xc0000857c8 pc=0x60f608ccdd85
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc0000857e8 sp=0xc0000857e0 pc=0x60f608d2a481
ollama-1  | created by runtime.gcenable in goroutine 1
ollama-1  |     runtime/mgc.go:204 +0x66
ollama-1  | 
ollama-1  | goroutine 4 gp=0xc000003500 m=nil [GC scavenge wait]:
ollama-1  | runtime.gopark(0x10000?, 0x60f609d9b090?, 0x0?, 0x0?, 0x0?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc000085f78 sp=0xc000085f58 pc=0x60f608d22d4e
ollama-1  | runtime.goparkunlock(...)
ollama-1  |     runtime/proc.go:441
ollama-1  | runtime.(*scavengerState).park(0x60f60a92d9a0)
ollama-1  |     runtime/mgcscavenge.go:425 +0x49 fp=0xc000085fa8 sp=0xc000085f78 pc=0x60f608cd73e9
ollama-1  | runtime.bgscavenge(0xc0000aa000)
ollama-1  |     runtime/mgcscavenge.go:658 +0x59 fp=0xc000085fc8 sp=0xc000085fa8 pc=0x60f608cd7979
ollama-1  | runtime.gcenable.gowrap2()
ollama-1  |     runtime/mgc.go:205 +0x25 fp=0xc000085fe0 sp=0xc000085fc8 pc=0x60f608ccdd25
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc000085fe8 sp=0xc000085fe0 pc=0x60f608d2a481
ollama-1  | created by runtime.gcenable in goroutine 1
ollama-1  |     runtime/mgc.go:205 +0xa5
ollama-1  | 
ollama-1  | goroutine 5 gp=0xc000003dc0 m=nil [finalizer wait]:
ollama-1  | runtime.gopark(0x1b8?, 0xc000002380?, 0x1?, 0x23?, 0xc000084688?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc000084630 sp=0xc000084610 pc=0x60f608d22d4e
ollama-1  | runtime.runfinq()
ollama-1  |     runtime/mfinal.go:196 +0x107 fp=0xc0000847e0 sp=0xc000084630 pc=0x60f608cccd47
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc0000847e8 sp=0xc0000847e0 pc=0x60f608d2a481
ollama-1  | created by runtime.createfing in goroutine 1
ollama-1  |     runtime/mfinal.go:166 +0x3d
ollama-1  | 
ollama-1  | goroutine 6 gp=0xc0001e08c0 m=nil [chan receive]:
ollama-1  | runtime.gopark(0xc0001899a0?, 0xc001aa0048?, 0x60?, 0x67?, 0x60f608e079c8?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc000086718 sp=0xc0000866f8 pc=0x60f608d22d4e
ollama-1  | runtime.chanrecv(0xc0000b8310, 0x0, 0x1)
ollama-1  |     runtime/chan.go:664 +0x445 fp=0xc000086790 sp=0xc000086718 pc=0x60f608cbe725
ollama-1  | runtime.chanrecv1(0x0?, 0x0?)
ollama-1  |     runtime/chan.go:506 +0x12 fp=0xc0000867b8 sp=0xc000086790 pc=0x60f608cbe2b2
ollama-1  | runtime.unique_runtime_registerUniqueMapCleanup.func2(...)
ollama-1  |     runtime/mgc.go:1796
ollama-1  | runtime.unique_runtime_registerUniqueMapCleanup.gowrap1()
ollama-1  |     runtime/mgc.go:1799 +0x2f fp=0xc0000867e0 sp=0xc0000867b8 pc=0x60f608cd0f2f
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc0000867e8 sp=0xc0000867e0 pc=0x60f608d2a481
ollama-1  | created by unique.runtime_registerUniqueMapCleanup in goroutine 1
ollama-1  |     runtime/mgc.go:1794 +0x85
ollama-1  | 
ollama-1  | goroutine 7 gp=0xc0001e0e00 m=nil [GC worker (idle)]:
ollama-1  | runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc000086f38 sp=0xc000086f18 pc=0x60f608d22d4e
ollama-1  | runtime.gcBgMarkWorker(0xc0000b9730)
ollama-1  |     runtime/mgc.go:1423 +0xe9 fp=0xc000086fc8 sp=0xc000086f38 pc=0x60f608cd0249
ollama-1  | runtime.gcBgMarkStartWorkers.gowrap1()
ollama-1  |     runtime/mgc.go:1339 +0x25 fp=0xc000086fe0 sp=0xc000086fc8 pc=0x60f608cd0125
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc000086fe8 sp=0xc000086fe0 pc=0x60f608d2a481
ollama-1  | created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama-1  |     runtime/mgc.go:1339 +0x105
ollama-1  | 
ollama-1  | goroutine 18 gp=0xc000102380 m=nil [GC worker (idle)]:
ollama-1  | runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc000080738 sp=0xc000080718 pc=0x60f608d22d4e
ollama-1  | runtime.gcBgMarkWorker(0xc0000b9730)
ollama-1  |     runtime/mgc.go:1423 +0xe9 fp=0xc0000807c8 sp=0xc000080738 pc=0x60f608cd0249
ollama-1  | runtime.gcBgMarkStartWorkers.gowrap1()
ollama-1  |     runtime/mgc.go:1339 +0x25 fp=0xc0000807e0 sp=0xc0000807c8 pc=0x60f608cd0125
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc0000807e8 sp=0xc0000807e0 pc=0x60f608d2a481
ollama-1  | created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama-1  |     runtime/mgc.go:1339 +0x105
ollama-1  | 
ollama-1  | goroutine 34 gp=0xc000504000 m=nil [GC worker (idle)]:
ollama-1  | runtime.gopark(0x60f60a9dc1e0?, 0x1?, 0x3f?, 0x35?, 0x0?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc00050a738 sp=0xc00050a718 pc=0x60f608d22d4e
ollama-1  | runtime.gcBgMarkWorker(0xc0000b9730)
ollama-1  |     runtime/mgc.go:1423 +0xe9 fp=0xc00050a7c8 sp=0xc00050a738 pc=0x60f608cd0249
ollama-1  | runtime.gcBgMarkStartWorkers.gowrap1()
ollama-1  |     runtime/mgc.go:1339 +0x25 fp=0xc00050a7e0 sp=0xc00050a7c8 pc=0x60f608cd0125
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc00050a7e8 sp=0xc00050a7e0 pc=0x60f608d2a481
ollama-1  | created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama-1  |     runtime/mgc.go:1339 +0x105
ollama-1  | 
ollama-1  | goroutine 8 gp=0xc0001e0fc0 m=nil [GC worker (idle)]:
ollama-1  | runtime.gopark(0x60f60a9dc1e0?, 0x1?, 0x52?, 0xd6?, 0x0?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc000087738 sp=0xc000087718 pc=0x60f608d22d4e
ollama-1  | runtime.gcBgMarkWorker(0xc0000b9730)
ollama-1  |     runtime/mgc.go:1423 +0xe9 fp=0xc0000877c8 sp=0xc000087738 pc=0x60f608cd0249
ollama-1  | runtime.gcBgMarkStartWorkers.gowrap1()
ollama-1  |     runtime/mgc.go:1339 +0x25 fp=0xc0000877e0 sp=0xc0000877c8 pc=0x60f608cd0125
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc0000877e8 sp=0xc0000877e0 pc=0x60f608d2a481
ollama-1  | created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama-1  |     runtime/mgc.go:1339 +0x105
ollama-1  | 
ollama-1  | goroutine 19 gp=0xc000102540 m=nil [GC worker (idle)]:
ollama-1  | runtime.gopark(0x1ca8e8b6ab9c?, 0x0?, 0x0?, 0x0?, 0x0?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc000080f38 sp=0xc000080f18 pc=0x60f608d22d4e
ollama-1  | runtime.gcBgMarkWorker(0xc0000b9730)
ollama-1  |     runtime/mgc.go:1423 +0xe9 fp=0xc000080fc8 sp=0xc000080f38 pc=0x60f608cd0249
ollama-1  | runtime.gcBgMarkStartWorkers.gowrap1()
ollama-1  |     runtime/mgc.go:1339 +0x25 fp=0xc000080fe0 sp=0xc000080fc8 pc=0x60f608cd0125
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc000080fe8 sp=0xc000080fe0 pc=0x60f608d2a481
ollama-1  | created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama-1  |     runtime/mgc.go:1339 +0x105
ollama-1  | 
ollama-1  | goroutine 35 gp=0xc0005041c0 m=nil [GC worker (idle)]:
ollama-1  | runtime.gopark(0x1ca8e8b75bcd?, 0x0?, 0x0?, 0x0?, 0x0?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc00050af38 sp=0xc00050af18 pc=0x60f608d22d4e
ollama-1  | runtime.gcBgMarkWorker(0xc0000b9730)
ollama-1  |     runtime/mgc.go:1423 +0xe9 fp=0xc00050afc8 sp=0xc00050af38 pc=0x60f608cd0249
ollama-1  | runtime.gcBgMarkStartWorkers.gowrap1()
ollama-1  |     runtime/mgc.go:1339 +0x25 fp=0xc00050afe0 sp=0xc00050afc8 pc=0x60f608cd0125
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc00050afe8 sp=0xc00050afe0 pc=0x60f608d2a481
ollama-1  | created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama-1  |     runtime/mgc.go:1339 +0x105
ollama-1  | 
ollama-1  | goroutine 9 gp=0xc0001e1180 m=nil [GC worker (idle)]:
ollama-1  | runtime.gopark(0x1ca8e8fee809?, 0x0?, 0x0?, 0x0?, 0x0?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc000087f38 sp=0xc000087f18 pc=0x60f608d22d4e
ollama-1  | runtime.gcBgMarkWorker(0xc0000b9730)
ollama-1  |     runtime/mgc.go:1423 +0xe9 fp=0xc000087fc8 sp=0xc000087f38 pc=0x60f608cd0249
ollama-1  | runtime.gcBgMarkStartWorkers.gowrap1()
ollama-1  |     runtime/mgc.go:1339 +0x25 fp=0xc000087fe0 sp=0xc000087fc8 pc=0x60f608cd0125
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc000087fe8 sp=0xc000087fe0 pc=0x60f608d2a481
ollama-1  | created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama-1  |     runtime/mgc.go:1339 +0x105
ollama-1  | 
ollama-1  | goroutine 20 gp=0xc000102700 m=nil [GC worker (idle)]:
ollama-1  | runtime.gopark(0x1ca8e8dc93a3?, 0x1?, 0x4f?, 0x1a?, 0x0?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc000081738 sp=0xc000081718 pc=0x60f608d22d4e
ollama-1  | runtime.gcBgMarkWorker(0xc0000b9730)
ollama-1  |     runtime/mgc.go:1423 +0xe9 fp=0xc0000817c8 sp=0xc000081738 pc=0x60f608cd0249
ollama-1  | runtime.gcBgMarkStartWorkers.gowrap1()
ollama-1  |     runtime/mgc.go:1339 +0x25 fp=0xc0000817e0 sp=0xc0000817c8 pc=0x60f608cd0125
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc0000817e8 sp=0xc0000817e0 pc=0x60f608d2a481
ollama-1  | created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama-1  |     runtime/mgc.go:1339 +0x105
ollama-1  | 
ollama-1  | goroutine 36 gp=0xc000504380 m=nil [GC worker (idle)]:
ollama-1  | runtime.gopark(0x1ca8e8fd3a82?, 0x3?, 0x53?, 0x96?, 0x0?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc00050b738 sp=0xc00050b718 pc=0x60f608d22d4e
ollama-1  | runtime.gcBgMarkWorker(0xc0000b9730)
ollama-1  |     runtime/mgc.go:1423 +0xe9 fp=0xc00050b7c8 sp=0xc00050b738 pc=0x60f608cd0249
ollama-1  | runtime.gcBgMarkStartWorkers.gowrap1()
ollama-1  |     runtime/mgc.go:1339 +0x25 fp=0xc00050b7e0 sp=0xc00050b7c8 pc=0x60f608cd0125
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc00050b7e8 sp=0xc00050b7e0 pc=0x60f608d2a481
ollama-1  | created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama-1  |     runtime/mgc.go:1339 +0x105
ollama-1  | 
ollama-1  | goroutine 10 gp=0xc0001e1340 m=nil [GC worker (idle)]:
ollama-1  | runtime.gopark(0x1ca8e8b6da1a?, 0x0?, 0x0?, 0x0?, 0x0?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc000506738 sp=0xc000506718 pc=0x60f608d22d4e
ollama-1  | runtime.gcBgMarkWorker(0xc0000b9730)
ollama-1  |     runtime/mgc.go:1423 +0xe9 fp=0xc0005067c8 sp=0xc000506738 pc=0x60f608cd0249
ollama-1  | runtime.gcBgMarkStartWorkers.gowrap1()
ollama-1  |     runtime/mgc.go:1339 +0x25 fp=0xc0005067e0 sp=0xc0005067c8 pc=0x60f608cd0125
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc0005067e8 sp=0xc0005067e0 pc=0x60f608d2a481
ollama-1  | created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama-1  |     runtime/mgc.go:1339 +0x105
ollama-1  | 
ollama-1  | goroutine 21 gp=0xc0001028c0 m=nil [GC worker (idle)]:
ollama-1  | runtime.gopark(0x60f60a9dc1e0?, 0x1?, 0xfa?, 0x2a?, 0x0?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc000081f38 sp=0xc000081f18 pc=0x60f608d22d4e
ollama-1  | runtime.gcBgMarkWorker(0xc0000b9730)
ollama-1  |     runtime/mgc.go:1423 +0xe9 fp=0xc000081fc8 sp=0xc000081f38 pc=0x60f608cd0249
ollama-1  | runtime.gcBgMarkStartWorkers.gowrap1()
ollama-1  |     runtime/mgc.go:1339 +0x25 fp=0xc000081fe0 sp=0xc000081fc8 pc=0x60f608cd0125
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc000081fe8 sp=0xc000081fe0 pc=0x60f608d2a481
ollama-1  | created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama-1  |     runtime/mgc.go:1339 +0x105
ollama-1  | 
ollama-1  | goroutine 22 gp=0xc000102a80 m=nil [GC worker (idle)]:
ollama-1  | runtime.gopark(0x1ca8e8b763b2?, 0x1?, 0x5e?, 0x67?, 0x0?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc000082738 sp=0xc000082718 pc=0x60f608d22d4e
ollama-1  | runtime.gcBgMarkWorker(0xc0000b9730)
ollama-1  |     runtime/mgc.go:1423 +0xe9 fp=0xc0000827c8 sp=0xc000082738 pc=0x60f608cd0249
ollama-1  | runtime.gcBgMarkStartWorkers.gowrap1()
ollama-1  |     runtime/mgc.go:1339 +0x25 fp=0xc0000827e0 sp=0xc0000827c8 pc=0x60f608cd0125
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc0000827e8 sp=0xc0000827e0 pc=0x60f608d2a481
ollama-1  | created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama-1  |     runtime/mgc.go:1339 +0x105
ollama-1  | 
ollama-1  | goroutine 23 gp=0xc000102c40 m=nil [GC worker (idle)]:
ollama-1  | runtime.gopark(0x1ca8e8dcb342?, 0x3?, 0x55?, 0x45?, 0x0?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc000082f38 sp=0xc000082f18 pc=0x60f608d22d4e
ollama-1  | runtime.gcBgMarkWorker(0xc0000b9730)
ollama-1  |     runtime/mgc.go:1423 +0xe9 fp=0xc000082fc8 sp=0xc000082f38 pc=0x60f608cd0249
ollama-1  | runtime.gcBgMarkStartWorkers.gowrap1()
ollama-1  |     runtime/mgc.go:1339 +0x25 fp=0xc000082fe0 sp=0xc000082fc8 pc=0x60f608cd0125
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc000082fe8 sp=0xc000082fe0 pc=0x60f608d2a481
ollama-1  | created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama-1  |     runtime/mgc.go:1339 +0x105
ollama-1  | 
ollama-1  | goroutine 24 gp=0xc000102e00 m=nil [GC worker (idle)]:
ollama-1  | runtime.gopark(0x1ca8e9018c6b?, 0x3?, 0x19?, 0x32?, 0x0?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc000083738 sp=0xc000083718 pc=0x60f608d22d4e
ollama-1  | runtime.gcBgMarkWorker(0xc0000b9730)
ollama-1  |     runtime/mgc.go:1423 +0xe9 fp=0xc0000837c8 sp=0xc000083738 pc=0x60f608cd0249
ollama-1  | runtime.gcBgMarkStartWorkers.gowrap1()
ollama-1  |     runtime/mgc.go:1339 +0x25 fp=0xc0000837e0 sp=0xc0000837c8 pc=0x60f608cd0125
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc0000837e8 sp=0xc0000837e0 pc=0x60f608d2a481
ollama-1  | created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama-1  |     runtime/mgc.go:1339 +0x105
ollama-1  | 
ollama-1  | goroutine 25 gp=0xc000102fc0 m=nil [GC worker (idle)]:
ollama-1  | runtime.gopark(0x1ca8e8dd9c39?, 0x3?, 0xc8?, 0x52?, 0x0?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc000083f38 sp=0xc000083f18 pc=0x60f608d22d4e
ollama-1  | runtime.gcBgMarkWorker(0xc0000b9730)
ollama-1  |     runtime/mgc.go:1423 +0xe9 fp=0xc000083fc8 sp=0xc000083f38 pc=0x60f608cd0249
ollama-1  | runtime.gcBgMarkStartWorkers.gowrap1()
ollama-1  |     runtime/mgc.go:1339 +0x25 fp=0xc000083fe0 sp=0xc000083fc8 pc=0x60f608cd0125
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc000083fe8 sp=0xc000083fe0 pc=0x60f608d2a481
ollama-1  | created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama-1  |     runtime/mgc.go:1339 +0x105
ollama-1  | 
ollama-1  | goroutine 26 gp=0xc000103180 m=nil [GC worker (idle)]:
ollama-1  | runtime.gopark(0x1ca8e8b87b6c?, 0x3?, 0xe3?, 0xf5?, 0x0?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc00011c738 sp=0xc00011c718 pc=0x60f608d22d4e
ollama-1  | runtime.gcBgMarkWorker(0xc0000b9730)
ollama-1  |     runtime/mgc.go:1423 +0xe9 fp=0xc00011c7c8 sp=0xc00011c738 pc=0x60f608cd0249
ollama-1  | runtime.gcBgMarkStartWorkers.gowrap1()
ollama-1  |     runtime/mgc.go:1339 +0x25 fp=0xc00011c7e0 sp=0xc00011c7c8 pc=0x60f608cd0125
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc00011c7e8 sp=0xc00011c7e0 pc=0x60f608d2a481
ollama-1  | created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama-1  |     runtime/mgc.go:1339 +0x105
ollama-1  | 
ollama-1  | goroutine 27 gp=0xc000582a80 m=nil [select]:
ollama-1  | runtime.gopark(0xc000047a10?, 0x2?, 0x0?, 0x0?, 0xc000047874?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc0000476a0 sp=0xc000047680 pc=0x60f608d22d4e
ollama-1  | runtime.selectgo(0xc000047a10, 0xc000047870, 0x47?, 0x0, 0x4?, 0x1)
ollama-1  |     runtime/select.go:351 +0x837 fp=0xc0000477d8 sp=0xc0000476a0 pc=0x60f608d013b7
ollama-1  | github.com/ollama/ollama/runner/ollamarunner.(*Server).completion(0xc0004ec5a0, {0x60f60a096768, 0xc0014601c0}, 0xc000432280)
ollama-1  |     github.com/ollama/ollama/runner/ollamarunner/runner.go:680 +0xb65 fp=0xc000047ac0 sp=0xc0000477d8 pc=0x60f609215c45
ollama-1  | github.com/ollama/ollama/runner/ollamarunner.(*Server).completion-fm({0x60f60a096768?, 0xc0014601c0?}, 0xc000121b40?)
ollama-1  |     <autogenerated>:1 +0x36 fp=0xc000047af0 sp=0xc000047ac0 pc=0x60f609219016
ollama-1  | net/http.HandlerFunc.ServeHTTP(0xc0004c35c0?, {0x60f60a096768?, 0xc0014601c0?}, 0xc000121b60?)
ollama-1  |     net/http/server.go:2294 +0x29 fp=0xc000047b18 sp=0xc000047af0 pc=0x60f609020c49
ollama-1  | net/http.(*ServeMux).ServeHTTP(0x60f608cc7265?, {0x60f60a096768, 0xc0014601c0}, 0xc000432280)
ollama-1  |     net/http/server.go:2822 +0x1c4 fp=0xc000047b68 sp=0xc000047b18 pc=0x60f609022b44
ollama-1  | net/http.serverHandler.ServeHTTP({0x60f60a092db0?}, {0x60f60a096768?, 0xc0014601c0?}, 0x1?)
ollama-1  |     net/http/server.go:3301 +0x8e fp=0xc000047b98 sp=0xc000047b68 pc=0x60f6090405ce
ollama-1  | net/http.(*conn).serve(0xc0004f0360, {0x60f60a0989f8, 0xc0000ffb60})
ollama-1  |     net/http/server.go:2102 +0x625 fp=0xc000047fb8 sp=0xc000047b98 pc=0x60f60901f145
ollama-1  | net/http.(*Server).Serve.gowrap3()
ollama-1  |     net/http/server.go:3454 +0x28 fp=0xc000047fe0 sp=0xc000047fb8 pc=0x60f609024a08
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc000047fe8 sp=0xc000047fe0 pc=0x60f608d2a481
ollama-1  | created by net/http.(*Server).Serve in goroutine 1
ollama-1  |     net/http/server.go:3454 +0x485
ollama-1  | 
ollama-1  | goroutine 454 gp=0xc000602700 m=nil [IO wait]:
ollama-1  | runtime.gopark(0x100000001?, 0x100000001?, 0x1?, 0x0?, 0xb?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc0014455d8 sp=0xc0014455b8 pc=0x60f608d22d4e
ollama-1  | runtime.netpollblock(0x60f608d460b8?, 0x8cbbb46?, 0xf6?)
ollama-1  |     runtime/netpoll.go:575 +0xf7 fp=0xc001445610 sp=0xc0014455d8 pc=0x60f608ce7837
ollama-1  | internal/poll.runtime_pollWait(0x7a25134a6d98, 0x72)
ollama-1  |     runtime/netpoll.go:351 +0x85 fp=0xc001445630 sp=0xc001445610 pc=0x60f608d21f65
ollama-1  | internal/poll.(*pollDesc).wait(0xc0006a0100?, 0xc001966041?, 0x0)
ollama-1  |     internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc001445658 sp=0xc001445630 pc=0x60f608da93a7
ollama-1  | internal/poll.(*pollDesc).waitRead(...)
ollama-1  |     internal/poll/fd_poll_runtime.go:89
ollama-1  | internal/poll.(*FD).Read(0xc0006a0100, {0xc001966041, 0x1, 0x1})
ollama-1  |     internal/poll/fd_unix.go:165 +0x27a fp=0xc0014456f0 sp=0xc001445658 pc=0x60f608daa69a
ollama-1  | net.(*netFD).Read(0xc0006a0100, {0xc001966041?, 0xc001972098?, 0xc001445770?})
ollama-1  |     net/fd_posix.go:55 +0x25 fp=0xc001445738 sp=0xc0014456f0 pc=0x60f608e1ede5
ollama-1  | net.(*conn).Read(0xc000598020, {0xc001966041?, 0xc0018d42c0?, 0x60f60908a060?})
ollama-1  |     net/net.go:194 +0x45 fp=0xc001445780 sp=0xc001445738 pc=0x60f608e2d1a5
ollama-1  | net/http.(*connReader).backgroundRead(0xc001966030)
ollama-1  |     net/http/server.go:690 +0x37 fp=0xc0014457c8 sp=0xc001445780 pc=0x60f609019017
ollama-1  | net/http.(*connReader).startBackgroundRead.gowrap2()
ollama-1  |     net/http/server.go:686 +0x25 fp=0xc0014457e0 sp=0xc0014457c8 pc=0x60f609018f45
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc0014457e8 sp=0xc0014457e0 pc=0x60f608d2a481
ollama-1  | created by net/http.(*connReader).startBackgroundRead in goroutine 27
ollama-1  |     net/http/server.go:686 +0xb6
ollama-1  | 
ollama-1  | rax    0x204a03f7c
ollama-1  | rbx    0x7a25047b1d60
ollama-1  | rcx    0xfdf
ollama-1  | rdx    0x7a2504649520
ollama-1  | rdi    0x7a2504649530
ollama-1  | rsi    0x0
ollama-1  | rbp    0x7a2442df82d0
ollama-1  | rsp    0x7a2442df82b0
ollama-1  | r8     0x1
ollama-1  | r9     0x7a24f8ed7618
ollama-1  | r10    0x0
ollama-1  | r11    0x246
ollama-1  | r12    0x7a200400e520
ollama-1  | r13    0x7a2504649530
ollama-1  | r14    0x0
ollama-1  | r15    0x7a2504002e80
ollama-1  | rip    0x7a2450624fb7
ollama-1  | rflags 0x10297
ollama-1  | cs     0x33
ollama-1  | fs     0x0
ollama-1  | gs     0x0
ollama-1  | SIGABRT: abort
ollama-1  | PC=0x7a255a819b2c m=15 sigcode=18446744073709551610
ollama-1  | signal arrived during cgo execution
ollama-1  | 
ollama-1  | goroutine 12 gp=0xc000103c00 m=15 mp=0xc000581808 [syscall]:
ollama-1  | runtime.cgocall(0x60f6099ec180, 0xc000125a58)
ollama-1  |     runtime/cgocall.go:167 +0x4b fp=0xc000125a30 sp=0xc0001259f8 pc=0x60f608d1f8cb
ollama-1  | github.com/ollama/ollama/ml/backend/ggml._Cfunc_ggml_backend_sched_graph_compute_async(0x7a2505011170, 0x7a2048004790)
ollama-1  |     _cgo_gotypes.go:886 +0x4a fp=0xc000125a58 sp=0xc000125a30 pc=0x60f6091594ea
ollama-1  | github.com/ollama/ollama/ml/backend/ggml.(*Context).Compute.func1(...)
ollama-1  |     github.com/ollama/ollama/ml/backend/ggml/ggml.go:631
ollama-1  | github.com/ollama/ollama/ml/backend/ggml.(*Context).Compute(0xc000422000, {0xc00059a480, 0x1, 0x0?})
ollama-1  |     github.com/ollama/ollama/ml/backend/ggml/ggml.go:631 +0x9d fp=0xc000125b00 sp=0xc000125a58 pc=0x60f6091649fd
ollama-1  | github.com/ollama/ollama/model.Forward({0x60f60a0a0d30, 0xc000422000}, {0x60f60a097550, 0xc0000e96b0}, {0xc00012a400, 0x47, 0x80}, {{0x60f60a0ab988, 0xc0006ac360}, {0x0, ...}, ...})
ollama-1  |     github.com/ollama/ollama/model/model.go:305 +0x2a7 fp=0xc000125be8 sp=0xc000125b00 pc=0x60f6091729c7
ollama-1  | github.com/ollama/ollama/runner/ollamarunner.(*Server).processBatch(0xc0004ec5a0)
ollama-1  |     github.com/ollama/ollama/runner/ollamarunner/runner.go:480 +0x4c5 fp=0xc000125f98 sp=0xc000125be8 pc=0x60f609213905
ollama-1  | github.com/ollama/ollama/runner/ollamarunner.(*Server).run(0xc0004ec5a0, {0x60f60a098a30, 0xc000690910})
ollama-1  |     github.com/ollama/ollama/runner/ollamarunner/runner.go:362 +0x4e fp=0xc000125fb8 sp=0xc000125f98 pc=0x60f6092133ee
ollama-1  | github.com/ollama/ollama/runner/ollamarunner.Execute.gowrap2()
ollama-1  |     github.com/ollama/ollama/runner/ollamarunner/runner.go:960 +0x28 fp=0xc000125fe0 sp=0xc000125fb8 pc=0x60f609218b48
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc000125fe8 sp=0xc000125fe0 pc=0x60f608d2a481
ollama-1  | created by github.com/ollama/ollama/runner/ollamarunner.Execute in goroutine 1
ollama-1  |     github.com/ollama/ollama/runner/ollamarunner/runner.go:960 +0xa74
ollama-1  | 
ollama-1  | goroutine 1 gp=0xc000002380 m=nil [IO wait]:
ollama-1  | runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc000123650 sp=0xc000123630 pc=0x60f608d22d4e
ollama-1  | runtime.netpollblock(0xc0001236a0?, 0x8cbbb46?, 0xf6?)
ollama-1  |     runtime/netpoll.go:575 +0xf7 fp=0xc000123688 sp=0xc000123650 pc=0x60f608ce7837
ollama-1  | internal/poll.runtime_pollWait(0x7a25134a6eb0, 0x72)
ollama-1  |     runtime/netpoll.go:351 +0x85 fp=0xc0001236a8 sp=0xc000123688 pc=0x60f608d21f65
ollama-1  | internal/poll.(*pollDesc).wait(0xc0006a0480?, 0x900000036?, 0x0)
ollama-1  |     internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc0001236d0 sp=0xc0001236a8 pc=0x60f608da93a7
ollama-1  | internal/poll.(*pollDesc).waitRead(...)
ollama-1  |     internal/poll/fd_poll_runtime.go:89
ollama-1  | internal/poll.(*FD).Accept(0xc0006a0480)
ollama-1  |     internal/poll/fd_unix.go:620 +0x295 fp=0xc000123778 sp=0xc0001236d0 pc=0x60f608dae775
ollama-1  | net.(*netFD).accept(0xc0006a0480)
ollama-1  |     net/fd_unix.go:172 +0x29 fp=0xc000123830 sp=0xc000123778 pc=0x60f608e20d89
ollama-1  | net.(*TCPListener).accept(0xc000422880)
ollama-1  |     net/tcpsock_posix.go:159 +0x1b fp=0xc000123880 sp=0xc000123830 pc=0x60f608e3673b
ollama-1  | net.(*TCPListener).Accept(0xc000422880)
ollama-1  |     net/tcpsock.go:380 +0x30 fp=0xc0001238b0 sp=0xc000123880 pc=0x60f608e355f0
ollama-1  | net/http.(*onceCloseListener).Accept(0xc0004f0360?)
ollama-1  |     <autogenerated>:1 +0x24 fp=0xc0001238c8 sp=0xc0001238b0 pc=0x60f60904cd44
ollama-1  | net/http.(*Server).Serve(0xc00030a000, {0x60f60a096588, 0xc000422880})
ollama-1  |     net/http/server.go:3424 +0x30c fp=0xc0001239f8 sp=0xc0001238c8 pc=0x60f60902460c
ollama-1  | github.com/ollama/ollama/runner/ollamarunner.Execute({0xc000034170, 0x11, 0x11})
ollama-1  |     github.com/ollama/ollama/runner/ollamarunner/runner.go:984 +0xe09 fp=0xc000123d08 sp=0xc0001239f8 pc=0x60f6092188a9
ollama-1  | github.com/ollama/ollama/runner.Execute({0xc000034150?, 0x0?, 0x0?})
ollama-1  |     github.com/ollama/ollama/runner/runner.go:20 +0xc9 fp=0xc000123d30 sp=0xc000123d08 pc=0x60f6092191a9
ollama-1  | github.com/ollama/ollama/cmd.NewCLI.func2(0xc0001fd200?, {0x60f609bd907b?, 0x4?, 0x60f609bd907f?})
ollama-1  |     github.com/ollama/ollama/cmd/cmd.go:1583 +0x45 fp=0xc000123d58 sp=0xc000123d30 pc=0x60f60997e0e5
ollama-1  | github.com/spf13/cobra.(*Command).execute(0xc0004f4f08, {0xc0004ec360, 0x12, 0x12})
ollama-1  |     github.com/spf13/cobra@v1.7.0/command.go:940 +0x85c fp=0xc000123e78 sp=0xc000123d58 pc=0x60f608e9a3dc
ollama-1  | github.com/spf13/cobra.(*Command).ExecuteC(0xc0004d0908)
ollama-1  |     github.com/spf13/cobra@v1.7.0/command.go:1068 +0x3a5 fp=0xc000123f30 sp=0xc000123e78 pc=0x60f608e9ac25
ollama-1  | github.com/spf13/cobra.(*Command).Execute(...)
ollama-1  |     github.com/spf13/cobra@v1.7.0/command.go:992
ollama-1  | github.com/spf13/cobra.(*Command).ExecuteContext(...)
ollama-1  |     github.com/spf13/cobra@v1.7.0/command.go:985
ollama-1  | main.main()
ollama-1  |     github.com/ollama/ollama/main.go:12 +0x4d fp=0xc000123f50 sp=0xc000123f30 pc=0x60f60997ebcd
ollama-1  | runtime.main()
ollama-1  |     runtime/proc.go:283 +0x29d fp=0xc000123fe0 sp=0xc000123f50 pc=0x60f608ceeebd
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc000123fe8 sp=0xc000123fe0 pc=0x60f608d2a481
ollama-1  | 
ollama-1  | goroutine 2 gp=0xc000002e00 m=nil [force gc (idle)]:
ollama-1  | runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc000084fa8 sp=0xc000084f88 pc=0x60f608d22d4e
ollama-1  | runtime.goparkunlock(...)
ollama-1  |     runtime/proc.go:441
ollama-1  | runtime.forcegchelper()
ollama-1  |     runtime/proc.go:348 +0xb8 fp=0xc000084fe0 sp=0xc000084fa8 pc=0x60f608cef1f8
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc000084fe8 sp=0xc000084fe0 pc=0x60f608d2a481
ollama-1  | created by runtime.init.7 in goroutine 1
ollama-1  |     runtime/proc.go:336 +0x1a
ollama-1  | 
ollama-1  | goroutine 3 gp=0xc000003340 m=nil [GC sweep wait]:
ollama-1  | runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc000085780 sp=0xc000085760 pc=0x60f608d22d4e
ollama-1  | runtime.goparkunlock(...)
ollama-1  |     runtime/proc.go:441
ollama-1  | runtime.bgsweep(0xc0000aa000)
ollama-1  |     runtime/mgcsweep.go:316 +0xdf fp=0xc0000857c8 sp=0xc000085780 pc=0x60f608cd999f
ollama-1  | runtime.gcenable.gowrap1()
ollama-1  |     runtime/mgc.go:204 +0x25 fp=0xc0000857e0 sp=0xc0000857c8 pc=0x60f608ccdd85
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc0000857e8 sp=0xc0000857e0 pc=0x60f608d2a481
ollama-1  | created by runtime.gcenable in goroutine 1
ollama-1  |     runtime/mgc.go:204 +0x66
ollama-1  | 
ollama-1  | goroutine 4 gp=0xc000003500 m=nil [GC scavenge wait]:
ollama-1  | runtime.gopark(0x10000?, 0x60f609d9b090?, 0x0?, 0x0?, 0x0?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc000085f78 sp=0xc000085f58 pc=0x60f608d22d4e
ollama-1  | runtime.goparkunlock(...)
ollama-1  |     runtime/proc.go:441
ollama-1  | runtime.(*scavengerState).park(0x60f60a92d9a0)
ollama-1  |     runtime/mgcscavenge.go:425 +0x49 fp=0xc000085fa8 sp=0xc000085f78 pc=0x60f608cd73e9
ollama-1  | runtime.bgscavenge(0xc0000aa000)
ollama-1  |     runtime/mgcscavenge.go:658 +0x59 fp=0xc000085fc8 sp=0xc000085fa8 pc=0x60f608cd7979
ollama-1  | runtime.gcenable.gowrap2()
ollama-1  |     runtime/mgc.go:205 +0x25 fp=0xc000085fe0 sp=0xc000085fc8 pc=0x60f608ccdd25
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc000085fe8 sp=0xc000085fe0 pc=0x60f608d2a481
ollama-1  | created by runtime.gcenable in goroutine 1
ollama-1  |     runtime/mgc.go:205 +0xa5
ollama-1  | 
ollama-1  | goroutine 5 gp=0xc000003dc0 m=nil [finalizer wait]:
ollama-1  | runtime.gopark(0x1b8?, 0xc000002380?, 0x1?, 0x23?, 0xc000084688?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc000084630 sp=0xc000084610 pc=0x60f608d22d4e
ollama-1  | runtime.runfinq()
ollama-1  |     runtime/mfinal.go:196 +0x107 fp=0xc0000847e0 sp=0xc000084630 pc=0x60f608cccd47
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc0000847e8 sp=0xc0000847e0 pc=0x60f608d2a481
ollama-1  | created by runtime.createfing in goroutine 1
ollama-1  |     runtime/mfinal.go:166 +0x3d
ollama-1  | 
ollama-1  | goroutine 6 gp=0xc0001e08c0 m=nil [chan receive]:
ollama-1  | runtime.gopark(0xc0001899a0?, 0xc001aa0048?, 0x60?, 0x67?, 0x60f608e079c8?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc000086718 sp=0xc0000866f8 pc=0x60f608d22d4e
ollama-1  | runtime.chanrecv(0xc0000b8310, 0x0, 0x1)
ollama-1  |     runtime/chan.go:664 +0x445 fp=0xc000086790 sp=0xc000086718 pc=0x60f608cbe725
ollama-1  | runtime.chanrecv1(0x0?, 0x0?)
ollama-1  |     runtime/chan.go:506 +0x12 fp=0xc0000867b8 sp=0xc000086790 pc=0x60f608cbe2b2
ollama-1  | runtime.unique_runtime_registerUniqueMapCleanup.func2(...)
ollama-1  |     runtime/mgc.go:1796
ollama-1  | runtime.unique_runtime_registerUniqueMapCleanup.gowrap1()
ollama-1  |     runtime/mgc.go:1799 +0x2f fp=0xc0000867e0 sp=0xc0000867b8 pc=0x60f608cd0f2f
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc0000867e8 sp=0xc0000867e0 pc=0x60f608d2a481
ollama-1  | created by unique.runtime_registerUniqueMapCleanup in goroutine 1
ollama-1  |     runtime/mgc.go:1794 +0x85
ollama-1  | 
ollama-1  | goroutine 7 gp=0xc0001e0e00 m=nil [GC worker (idle)]:
ollama-1  | runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc000086f38 sp=0xc000086f18 pc=0x60f608d22d4e
ollama-1  | runtime.gcBgMarkWorker(0xc0000b9730)
ollama-1  |     runtime/mgc.go:1423 +0xe9 fp=0xc000086fc8 sp=0xc000086f38 pc=0x60f608cd0249
ollama-1  | runtime.gcBgMarkStartWorkers.gowrap1()
ollama-1  |     runtime/mgc.go:1339 +0x25 fp=0xc000086fe0 sp=0xc000086fc8 pc=0x60f608cd0125
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc000086fe8 sp=0xc000086fe0 pc=0x60f608d2a481
ollama-1  | created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama-1  |     runtime/mgc.go:1339 +0x105
ollama-1  | 
ollama-1  | goroutine 18 gp=0xc000102380 m=nil [GC worker (idle)]:
ollama-1  | runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc000080738 sp=0xc000080718 pc=0x60f608d22d4e
ollama-1  | runtime.gcBgMarkWorker(0xc0000b9730)
ollama-1  |     runtime/mgc.go:1423 +0xe9 fp=0xc0000807c8 sp=0xc000080738 pc=0x60f608cd0249
ollama-1  | runtime.gcBgMarkStartWorkers.gowrap1()
ollama-1  |     runtime/mgc.go:1339 +0x25 fp=0xc0000807e0 sp=0xc0000807c8 pc=0x60f608cd0125
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc0000807e8 sp=0xc0000807e0 pc=0x60f608d2a481
ollama-1  | created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama-1  |     runtime/mgc.go:1339 +0x105
ollama-1  | 
ollama-1  | goroutine 34 gp=0xc000504000 m=nil [GC worker (idle)]:
ollama-1  | runtime.gopark(0x60f60a9dc1e0?, 0x1?, 0x3f?, 0x35?, 0x0?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc00050a738 sp=0xc00050a718 pc=0x60f608d22d4e
ollama-1  | runtime.gcBgMarkWorker(0xc0000b9730)
ollama-1  |     runtime/mgc.go:1423 +0xe9 fp=0xc00050a7c8 sp=0xc00050a738 pc=0x60f608cd0249
ollama-1  | runtime.gcBgMarkStartWorkers.gowrap1()
ollama-1  |     runtime/mgc.go:1339 +0x25 fp=0xc00050a7e0 sp=0xc00050a7c8 pc=0x60f608cd0125
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc00050a7e8 sp=0xc00050a7e0 pc=0x60f608d2a481
ollama-1  | created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama-1  |     runtime/mgc.go:1339 +0x105
ollama-1  | 
ollama-1  | goroutine 8 gp=0xc0001e0fc0 m=nil [GC worker (idle)]:
ollama-1  | runtime.gopark(0x60f60a9dc1e0?, 0x1?, 0x52?, 0xd6?, 0x0?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc000087738 sp=0xc000087718 pc=0x60f608d22d4e
ollama-1  | runtime.gcBgMarkWorker(0xc0000b9730)
ollama-1  |     runtime/mgc.go:1423 +0xe9 fp=0xc0000877c8 sp=0xc000087738 pc=0x60f608cd0249
ollama-1  | runtime.gcBgMarkStartWorkers.gowrap1()
ollama-1  |     runtime/mgc.go:1339 +0x25 fp=0xc0000877e0 sp=0xc0000877c8 pc=0x60f608cd0125
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc0000877e8 sp=0xc0000877e0 pc=0x60f608d2a481
ollama-1  | created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama-1  |     runtime/mgc.go:1339 +0x105
ollama-1  | 
ollama-1  | goroutine 19 gp=0xc000102540 m=nil [GC worker (idle)]:
ollama-1  | runtime.gopark(0x1ca8e8b6ab9c?, 0x0?, 0x0?, 0x0?, 0x0?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc000080f38 sp=0xc000080f18 pc=0x60f608d22d4e
ollama-1  | runtime.gcBgMarkWorker(0xc0000b9730)
ollama-1  |     runtime/mgc.go:1423 +0xe9 fp=0xc000080fc8 sp=0xc000080f38 pc=0x60f608cd0249
ollama-1  | runtime.gcBgMarkStartWorkers.gowrap1()
ollama-1  |     runtime/mgc.go:1339 +0x25 fp=0xc000080fe0 sp=0xc000080fc8 pc=0x60f608cd0125
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc000080fe8 sp=0xc000080fe0 pc=0x60f608d2a481
ollama-1  | created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama-1  |     runtime/mgc.go:1339 +0x105
ollama-1  | 
ollama-1  | goroutine 35 gp=0xc0005041c0 m=nil [GC worker (idle)]:
ollama-1  | runtime.gopark(0x1ca8e8b75bcd?, 0x0?, 0x0?, 0x0?, 0x0?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc00050af38 sp=0xc00050af18 pc=0x60f608d22d4e
ollama-1  | runtime.gcBgMarkWorker(0xc0000b9730)
ollama-1  |     runtime/mgc.go:1423 +0xe9 fp=0xc00050afc8 sp=0xc00050af38 pc=0x60f608cd0249
ollama-1  | runtime.gcBgMarkStartWorkers.gowrap1()
ollama-1  |     runtime/mgc.go:1339 +0x25 fp=0xc00050afe0 sp=0xc00050afc8 pc=0x60f608cd0125
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc00050afe8 sp=0xc00050afe0 pc=0x60f608d2a481
ollama-1  | created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama-1  |     runtime/mgc.go:1339 +0x105
ollama-1  | 
ollama-1  | goroutine 9 gp=0xc0001e1180 m=nil [GC worker (idle)]:
ollama-1  | runtime.gopark(0x1ca8e8fee809?, 0x0?, 0x0?, 0x0?, 0x0?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc000087f38 sp=0xc000087f18 pc=0x60f608d22d4e
ollama-1  | runtime.gcBgMarkWorker(0xc0000b9730)
ollama-1  |     runtime/mgc.go:1423 +0xe9 fp=0xc000087fc8 sp=0xc000087f38 pc=0x60f608cd0249
ollama-1  | runtime.gcBgMarkStartWorkers.gowrap1()
ollama-1  |     runtime/mgc.go:1339 +0x25 fp=0xc000087fe0 sp=0xc000087fc8 pc=0x60f608cd0125
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc000087fe8 sp=0xc000087fe0 pc=0x60f608d2a481
ollama-1  | created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama-1  |     runtime/mgc.go:1339 +0x105
ollama-1  | 
ollama-1  | goroutine 20 gp=0xc000102700 m=nil [GC worker (idle)]:
ollama-1  | runtime.gopark(0x1ca8e8dc93a3?, 0x1?, 0x4f?, 0x1a?, 0x0?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc000081738 sp=0xc000081718 pc=0x60f608d22d4e
ollama-1  | runtime.gcBgMarkWorker(0xc0000b9730)
ollama-1  |     runtime/mgc.go:1423 +0xe9 fp=0xc0000817c8 sp=0xc000081738 pc=0x60f608cd0249
ollama-1  | runtime.gcBgMarkStartWorkers.gowrap1()
ollama-1  |     runtime/mgc.go:1339 +0x25 fp=0xc0000817e0 sp=0xc0000817c8 pc=0x60f608cd0125
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc0000817e8 sp=0xc0000817e0 pc=0x60f608d2a481
ollama-1  | created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama-1  |     runtime/mgc.go:1339 +0x105
ollama-1  | 
ollama-1  | goroutine 36 gp=0xc000504380 m=nil [GC worker (idle)]:
ollama-1  | runtime.gopark(0x1ca8e8fd3a82?, 0x3?, 0x53?, 0x96?, 0x0?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc00050b738 sp=0xc00050b718 pc=0x60f608d22d4e
ollama-1  | runtime.gcBgMarkWorker(0xc0000b9730)
ollama-1  |     runtime/mgc.go:1423 +0xe9 fp=0xc00050b7c8 sp=0xc00050b738 pc=0x60f608cd0249
ollama-1  | runtime.gcBgMarkStartWorkers.gowrap1()
ollama-1  |     runtime/mgc.go:1339 +0x25 fp=0xc00050b7e0 sp=0xc00050b7c8 pc=0x60f608cd0125
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc00050b7e8 sp=0xc00050b7e0 pc=0x60f608d2a481
ollama-1  | created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama-1  |     runtime/mgc.go:1339 +0x105
ollama-1  | 
ollama-1  | goroutine 10 gp=0xc0001e1340 m=nil [GC worker (idle)]:
ollama-1  | runtime.gopark(0x1ca8e8b6da1a?, 0x0?, 0x0?, 0x0?, 0x0?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc000506738 sp=0xc000506718 pc=0x60f608d22d4e
ollama-1  | runtime.gcBgMarkWorker(0xc0000b9730)
ollama-1  |     runtime/mgc.go:1423 +0xe9 fp=0xc0005067c8 sp=0xc000506738 pc=0x60f608cd0249
ollama-1  | runtime.gcBgMarkStartWorkers.gowrap1()
ollama-1  |     runtime/mgc.go:1339 +0x25 fp=0xc0005067e0 sp=0xc0005067c8 pc=0x60f608cd0125
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc0005067e8 sp=0xc0005067e0 pc=0x60f608d2a481
ollama-1  | created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama-1  |     runtime/mgc.go:1339 +0x105
ollama-1  | 
ollama-1  | goroutine 21 gp=0xc0001028c0 m=nil [GC worker (idle)]:
ollama-1  | runtime.gopark(0x60f60a9dc1e0?, 0x1?, 0xfa?, 0x2a?, 0x0?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc000081f38 sp=0xc000081f18 pc=0x60f608d22d4e
ollama-1  | runtime.gcBgMarkWorker(0xc0000b9730)
ollama-1  |     runtime/mgc.go:1423 +0xe9 fp=0xc000081fc8 sp=0xc000081f38 pc=0x60f608cd0249
ollama-1  | runtime.gcBgMarkStartWorkers.gowrap1()
ollama-1  |     runtime/mgc.go:1339 +0x25 fp=0xc000081fe0 sp=0xc000081fc8 pc=0x60f608cd0125
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc000081fe8 sp=0xc000081fe0 pc=0x60f608d2a481
ollama-1  | created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama-1  |     runtime/mgc.go:1339 +0x105
ollama-1  | 
ollama-1  | goroutine 22 gp=0xc000102a80 m=nil [GC worker (idle)]:
ollama-1  | runtime.gopark(0x1ca8e8b763b2?, 0x1?, 0x5e?, 0x67?, 0x0?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc000082738 sp=0xc000082718 pc=0x60f608d22d4e
ollama-1  | runtime.gcBgMarkWorker(0xc0000b9730)
ollama-1  |     runtime/mgc.go:1423 +0xe9 fp=0xc0000827c8 sp=0xc000082738 pc=0x60f608cd0249
ollama-1  | runtime.gcBgMarkStartWorkers.gowrap1()
ollama-1  |     runtime/mgc.go:1339 +0x25 fp=0xc0000827e0 sp=0xc0000827c8 pc=0x60f608cd0125
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc0000827e8 sp=0xc0000827e0 pc=0x60f608d2a481
ollama-1  | created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama-1  |     runtime/mgc.go:1339 +0x105
ollama-1  | 
ollama-1  | goroutine 23 gp=0xc000102c40 m=nil [GC worker (idle)]:
ollama-1  | runtime.gopark(0x1ca8e8dcb342?, 0x3?, 0x55?, 0x45?, 0x0?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc000082f38 sp=0xc000082f18 pc=0x60f608d22d4e
ollama-1  | runtime.gcBgMarkWorker(0xc0000b9730)
ollama-1  |     runtime/mgc.go:1423 +0xe9 fp=0xc000082fc8 sp=0xc000082f38 pc=0x60f608cd0249
ollama-1  | runtime.gcBgMarkStartWorkers.gowrap1()
ollama-1  |     runtime/mgc.go:1339 +0x25 fp=0xc000082fe0 sp=0xc000082fc8 pc=0x60f608cd0125
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc000082fe8 sp=0xc000082fe0 pc=0x60f608d2a481
ollama-1  | created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama-1  |     runtime/mgc.go:1339 +0x105
ollama-1  | 
ollama-1  | goroutine 24 gp=0xc000102e00 m=nil [GC worker (idle)]:
ollama-1  | runtime.gopark(0x1ca8e9018c6b?, 0x3?, 0x19?, 0x32?, 0x0?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc000083738 sp=0xc000083718 pc=0x60f608d22d4e
ollama-1  | runtime.gcBgMarkWorker(0xc0000b9730)
ollama-1  |     runtime/mgc.go:1423 +0xe9 fp=0xc0000837c8 sp=0xc000083738 pc=0x60f608cd0249
ollama-1  | runtime.gcBgMarkStartWorkers.gowrap1()
ollama-1  |     runtime/mgc.go:1339 +0x25 fp=0xc0000837e0 sp=0xc0000837c8 pc=0x60f608cd0125
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc0000837e8 sp=0xc0000837e0 pc=0x60f608d2a481
ollama-1  | created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama-1  |     runtime/mgc.go:1339 +0x105
ollama-1  | 
ollama-1  | goroutine 25 gp=0xc000102fc0 m=nil [GC worker (idle)]:
ollama-1  | runtime.gopark(0x1ca8e8dd9c39?, 0x3?, 0xc8?, 0x52?, 0x0?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc000083f38 sp=0xc000083f18 pc=0x60f608d22d4e
ollama-1  | runtime.gcBgMarkWorker(0xc0000b9730)
ollama-1  |     runtime/mgc.go:1423 +0xe9 fp=0xc000083fc8 sp=0xc000083f38 pc=0x60f608cd0249
ollama-1  | runtime.gcBgMarkStartWorkers.gowrap1()
ollama-1  |     runtime/mgc.go:1339 +0x25 fp=0xc000083fe0 sp=0xc000083fc8 pc=0x60f608cd0125
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc000083fe8 sp=0xc000083fe0 pc=0x60f608d2a481
ollama-1  | created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama-1  |     runtime/mgc.go:1339 +0x105
ollama-1  | 
ollama-1  | goroutine 26 gp=0xc000103180 m=nil [GC worker (idle)]:
ollama-1  | runtime.gopark(0x1ca8e8b87b6c?, 0x3?, 0xe3?, 0xf5?, 0x0?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc00011c738 sp=0xc00011c718 pc=0x60f608d22d4e
ollama-1  | runtime.gcBgMarkWorker(0xc0000b9730)
ollama-1  |     runtime/mgc.go:1423 +0xe9 fp=0xc00011c7c8 sp=0xc00011c738 pc=0x60f608cd0249
ollama-1  | runtime.gcBgMarkStartWorkers.gowrap1()
ollama-1  |     runtime/mgc.go:1339 +0x25 fp=0xc00011c7e0 sp=0xc00011c7c8 pc=0x60f608cd0125
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc00011c7e8 sp=0xc00011c7e0 pc=0x60f608d2a481
ollama-1  | created by runtime.gcBgMarkStartWorkers in goroutine 1
ollama-1  |     runtime/mgc.go:1339 +0x105
ollama-1  | 
ollama-1  | goroutine 27 gp=0xc000582a80 m=nil [select]:
ollama-1  | runtime.gopark(0xc000047a10?, 0x2?, 0x0?, 0x0?, 0xc000047874?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc0000476a0 sp=0xc000047680 pc=0x60f608d22d4e
ollama-1  | runtime.selectgo(0xc000047a10, 0xc000047870, 0x47?, 0x0, 0x4?, 0x1)
ollama-1  |     runtime/select.go:351 +0x837 fp=0xc0000477d8 sp=0xc0000476a0 pc=0x60f608d013b7
ollama-1  | github.com/ollama/ollama/runner/ollamarunner.(*Server).completion(0xc0004ec5a0, {0x60f60a096768, 0xc0014601c0}, 0xc000432280)
ollama-1  |     github.com/ollama/ollama/runner/ollamarunner/runner.go:680 +0xb65 fp=0xc000047ac0 sp=0xc0000477d8 pc=0x60f609215c45
ollama-1  | github.com/ollama/ollama/runner/ollamarunner.(*Server).completion-fm({0x60f60a096768?, 0xc0014601c0?}, 0xc000121b40?)
ollama-1  |     <autogenerated>:1 +0x36 fp=0xc000047af0 sp=0xc000047ac0 pc=0x60f609219016
ollama-1  | net/http.HandlerFunc.ServeHTTP(0xc0004c35c0?, {0x60f60a096768?, 0xc0014601c0?}, 0xc000121b60?)
ollama-1  |     net/http/server.go:2294 +0x29 fp=0xc000047b18 sp=0xc000047af0 pc=0x60f609020c49
ollama-1  | net/http.(*ServeMux).ServeHTTP(0x60f608cc7265?, {0x60f60a096768, 0xc0014601c0}, 0xc000432280)
ollama-1  |     net/http/server.go:2822 +0x1c4 fp=0xc000047b68 sp=0xc000047b18 pc=0x60f609022b44
ollama-1  | net/http.serverHandler.ServeHTTP({0x60f60a092db0?}, {0x60f60a096768?, 0xc0014601c0?}, 0x1?)
ollama-1  |     net/http/server.go:3301 +0x8e fp=0xc000047b98 sp=0xc000047b68 pc=0x60f6090405ce
ollama-1  | net/http.(*conn).serve(0xc0004f0360, {0x60f60a0989f8, 0xc0000ffb60})
ollama-1  |     net/http/server.go:2102 +0x625 fp=0xc000047fb8 sp=0xc000047b98 pc=0x60f60901f145
ollama-1  | net/http.(*Server).Serve.gowrap3()
ollama-1  |     net/http/server.go:3454 +0x28 fp=0xc000047fe0 sp=0xc000047fb8 pc=0x60f609024a08
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc000047fe8 sp=0xc000047fe0 pc=0x60f608d2a481
ollama-1  | created by net/http.(*Server).Serve in goroutine 1
ollama-1  |     net/http/server.go:3454 +0x485
ollama-1  | 
ollama-1  | goroutine 454 gp=0xc000602700 m=nil [IO wait]:
ollama-1  | runtime.gopark(0x100000001?, 0x100000001?, 0x1?, 0x0?, 0xb?)
ollama-1  |     runtime/proc.go:435 +0xce fp=0xc0014455d8 sp=0xc0014455b8 pc=0x60f608d22d4e
ollama-1  | runtime.netpollblock(0x60f608d460b8?, 0x8cbbb46?, 0xf6?)
ollama-1  |     runtime/netpoll.go:575 +0xf7 fp=0xc001445610 sp=0xc0014455d8 pc=0x60f608ce7837
ollama-1  | internal/poll.runtime_pollWait(0x7a25134a6d98, 0x72)
ollama-1  |     runtime/netpoll.go:351 +0x85 fp=0xc001445630 sp=0xc001445610 pc=0x60f608d21f65
ollama-1  | internal/poll.(*pollDesc).wait(0xc0006a0100?, 0xc001966041?, 0x0)
ollama-1  |     internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc001445658 sp=0xc001445630 pc=0x60f608da93a7
ollama-1  | internal/poll.(*pollDesc).waitRead(...)
ollama-1  |     internal/poll/fd_poll_runtime.go:89
ollama-1  | internal/poll.(*FD).Read(0xc0006a0100, {0xc001966041, 0x1, 0x1})
ollama-1  |     internal/poll/fd_unix.go:165 +0x27a fp=0xc0014456f0 sp=0xc001445658 pc=0x60f608daa69a
ollama-1  | net.(*netFD).Read(0xc0006a0100, {0xc001966041?, 0xc001972098?, 0xc001445770?})
ollama-1  |     net/fd_posix.go:55 +0x25 fp=0xc001445738 sp=0xc0014456f0 pc=0x60f608e1ede5
ollama-1  | net.(*conn).Read(0xc000598020, {0xc001966041?, 0xc0018d42c0?, 0x60f60908a060?})
ollama-1  |     net/net.go:194 +0x45 fp=0xc001445780 sp=0xc001445738 pc=0x60f608e2d1a5
ollama-1  | net/http.(*connReader).backgroundRead(0xc001966030)
ollama-1  |     net/http/server.go:690 +0x37 fp=0xc0014457c8 sp=0xc001445780 pc=0x60f609019017
ollama-1  | net/http.(*connReader).startBackgroundRead.gowrap2()
ollama-1  |     net/http/server.go:686 +0x25 fp=0xc0014457e0 sp=0xc0014457c8 pc=0x60f609018f45
ollama-1  | runtime.goexit({})
ollama-1  |     runtime/asm_amd64.s:1700 +0x1 fp=0xc0014457e8 sp=0xc0014457e0 pc=0x60f608d2a481
ollama-1  | created by net/http.(*connReader).startBackgroundRead in goroutine 27
ollama-1  |     net/http/server.go:686 +0xb6
ollama-1  | 
ollama-1  | rax    0x0
ollama-1  | rbx    0x4b
ollama-1  | rcx    0x7a255a819b2c
ollama-1  | rdx    0x6
ollama-1  | rdi    0x3a
ollama-1  | rsi    0x4b
ollama-1  | rbp    0x7a2442df8440
ollama-1  | rsp    0x7a2442df8400
ollama-1  | r8     0x0
ollama-1  | r9     0x0
ollama-1  | r10    0x8
ollama-1  | r11    0x246
ollama-1  | r12    0x6
ollama-1  | r13    0x4d
ollama-1  | r14    0x16
ollama-1  | r15    0x7a25050110a8
ollama-1  | rip    0x7a255a819b2c
ollama-1  | rflags 0x246
ollama-1  | cs     0x33
ollama-1  | fs     0x0
ollama-1  | gs     0x0
ollama-1  | time=2025-08-05T17:57:32.050Z level=ERROR source=server.go:807 msg="post predict" error="Post \"http://127.0.0.1:45347/completion\": EOF"
ollama-1  | [GIN] 2025/08/05 - 17:57:32 | 200 |  656.432015ms |       127.0.0.1 | POST     "/api/chat"
ollama-1  | time=2025-08-05T17:57:32.050Z level=DEBUG source=sched.go:432 msg="context for request finished" runner.name=registry.ollama.ai/library/gpt-oss:20b runner.inference=cuda runner.devices=1 runner.size="13.8 GiB" runner.vram="13.8 GiB" runner.parallel=1 runner.pid=58 runner.model=/root/.ollama/models/blobs/sha256-b112e727c6f18875636c56a779790a590d705aec9e1c0eb5a97d51fc2a778583 runner.num_ctx=8192
ollama-1  | time=2025-08-05T17:57:32.050Z level=DEBUG source=sched.go:341 msg="runner with non-zero duration has gone idle, adding timer" runner.name=registry.ollama.ai/library/gpt-oss:20b runner.inference=cuda runner.devices=1 runner.size="13.8 GiB" runner.vram="13.8 GiB" runner.parallel=1 runner.pid=58 runner.model=/root/.ollama/models/blobs/sha256-b112e727c6f18875636c56a779790a590d705aec9e1c0eb5a97d51fc2a778583 runner.num_ctx=8192 duration=5m0s
ollama-1  | time=2025-08-05T17:57:32.050Z level=DEBUG source=sched.go:359 msg="after processing request finished event" runner.name=registry.ollama.ai/library/gpt-oss:20b runner.inference=cuda runner.devices=1 runner.size="13.8 GiB" runner.vram="13.8 GiB" runner.parallel=1 runner.pid=58 runner.model=/root/.ollama/models/blobs/sha256-b112e727c6f18875636c56a779790a590d705aec9e1c0eb5a97d51fc2a778583 runner.num_ctx=8192 refCount=0
ollama-1  | time=2025-08-05T17:57:32.093Z level=ERROR source=server.go:464 msg="llama runner terminated" error="exit status 2"
Gracefully stopping... (press Ctrl+C again to force)
[+] Stopping 1/1
 ✔ Container ollama-ollama-1  Stopped                                                                                                                             0.2s
<!-- gh-comment-id:3156092544 --> @mikhail-shevtsov-wiregate commented on GitHub (Aug 5, 2025): @jessegross Running in Docker v.0.11.0 on RTX 3090 <details> <summary>Full log</summary> ### docker log ``` docker compose up [+] Running 1/1 ✔ Container ollama-ollama-1 Created 0.0s Attaching to ollama-1 ollama-1 | time=2025-08-05T17:57:15.513Z level=INFO source=routes.go:1297 msg="server config" env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_CONTEXT_LENGTH:4096 OLLAMA_DEBUG:DEBUG OLLAMA_FLASH_ATTENTION:true OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://0.0.0.0:11434 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE:q8_0 OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/root/.ollama/models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NEW_ENGINE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:1 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://* vscode-file://*] OLLAMA_SCHED_SPREAD:false ROCR_VISIBLE_DEVICES: http_proxy: https_proxy: no_proxy:]" ollama-1 | time=2025-08-05T17:57:15.515Z level=INFO source=images.go:477 msg="total blobs: 16" ollama-1 | time=2025-08-05T17:57:15.515Z level=INFO source=images.go:484 msg="total unused blobs removed: 0" ollama-1 | time=2025-08-05T17:57:15.516Z level=INFO source=routes.go:1350 msg="Listening on [::]:11434 (version 0.11.0)" ollama-1 | time=2025-08-05T17:57:15.516Z level=DEBUG source=sched.go:106 msg="starting llm scheduler" ollama-1 | time=2025-08-05T17:57:15.516Z level=INFO source=gpu.go:217 msg="looking for compatible GPUs" ollama-1 | time=2025-08-05T17:57:15.518Z level=DEBUG source=gpu.go:98 msg="searching for GPU discovery libraries for NVIDIA" ollama-1 | time=2025-08-05T17:57:15.518Z level=DEBUG source=gpu.go:501 msg="Searching for GPU library" name=libcuda.so* ollama-1 | time=2025-08-05T17:57:15.518Z level=DEBUG source=gpu.go:525 msg="gpu library search" globs="[/usr/lib/ollama/libcuda.so* /usr/local/nvidia/lib/libcuda.so* /usr/local/nvidia/lib64/libcuda.so* /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]" ollama-1 | time=2025-08-05T17:57:15.519Z level=DEBUG source=gpu.go:558 msg="discovered GPU libraries" paths=[/usr/lib/x86_64-linux-gnu/libcuda.so.550.163.01] ollama-1 | initializing /usr/lib/x86_64-linux-gnu/libcuda.so.550.163.01 ollama-1 | dlsym: cuInit - 0x7d7015e7ce20 ollama-1 | dlsym: cuDriverGetVersion - 0x7d7015e7ce40 ollama-1 | dlsym: cuDeviceGetCount - 0x7d7015e7ce80 ollama-1 | dlsym: cuDeviceGet - 0x7d7015e7ce60 ollama-1 | dlsym: cuDeviceGetAttribute - 0x7d7015e7cf60 ollama-1 | dlsym: cuDeviceGetUuid - 0x7d7015e7cec0 ollama-1 | dlsym: cuDeviceGetName - 0x7d7015e7cea0 ollama-1 | dlsym: cuCtxCreate_v3 - 0x7d7015e7d140 ollama-1 | dlsym: cuMemGetInfo_v2 - 0x7d7015e87080 ollama-1 | dlsym: cuCtxDestroy - 0x7d7015ee19c0 ollama-1 | calling cuInit ollama-1 | calling cuDriverGetVersion ollama-1 | raw version 0x2f08 ollama-1 | CUDA driver version: 12.4 ollama-1 | calling cuDeviceGetCount ollama-1 | device count 1 ollama-1 | time=2025-08-05T17:57:15.525Z level=DEBUG source=gpu.go:125 msg="detected GPUs" count=1 library=/usr/lib/x86_64-linux-gnu/libcuda.so.550.163.01 ollama-1 | [GPU-4a702f36-6e27-c7db-15af-79cfe15ee9df] CUDA totalMem 24252mb ollama-1 | [GPU-4a702f36-6e27-c7db-15af-79cfe15ee9df] CUDA freeMem 23991mb ollama-1 | [GPU-4a702f36-6e27-c7db-15af-79cfe15ee9df] Compute Capability 8.6 ollama-1 | time=2025-08-05T17:57:15.670Z level=DEBUG source=amd_linux.go:419 msg="amdgpu driver not detected /sys/module/amdgpu" ollama-1 | releasing cuda driver library ollama-1 | time=2025-08-05T17:57:15.670Z level=INFO source=types.go:130 msg="inference compute" id=GPU-4a702f36-6e27-c7db-15af-79cfe15ee9df library=cuda variant=v12 compute=8.6 driver=12.4 name="NVIDIA GeForce RTX 3090" total="23.7 GiB" available="23.4 GiB" ollama-1 | [GIN] 2025/08/05 - 17:57:21 | 200 | 66.772µs | 127.0.0.1 | HEAD "/" ollama-1 | time=2025-08-05T17:57:21.769Z level=DEBUG source=ggml.go:208 msg="key with type not found" key=general.alignment default=32 ollama-1 | [GIN] 2025/08/05 - 17:57:21 | 200 | 129.204587ms | 127.0.0.1 | POST "/api/show" ollama-1 | time=2025-08-05T17:57:21.860Z level=DEBUG source=gpu.go:391 msg="updating system memory data" before.total="62.5 GiB" before.free="53.1 GiB" before.free_swap="0 B" now.total="62.5 GiB" now.free="53.1 GiB" now.free_swap="0 B" ollama-1 | initializing /usr/lib/x86_64-linux-gnu/libcuda.so.550.163.01 ollama-1 | dlsym: cuInit - 0x7d7015e7ce20 ollama-1 | dlsym: cuDriverGetVersion - 0x7d7015e7ce40 ollama-1 | dlsym: cuDeviceGetCount - 0x7d7015e7ce80 ollama-1 | dlsym: cuDeviceGet - 0x7d7015e7ce60 ollama-1 | dlsym: cuDeviceGetAttribute - 0x7d7015e7cf60 ollama-1 | dlsym: cuDeviceGetUuid - 0x7d7015e7cec0 ollama-1 | dlsym: cuDeviceGetName - 0x7d7015e7cea0 ollama-1 | dlsym: cuCtxCreate_v3 - 0x7d7015e7d140 ollama-1 | dlsym: cuMemGetInfo_v2 - 0x7d7015e87080 ollama-1 | dlsym: cuCtxDestroy - 0x7d7015ee19c0 ollama-1 | calling cuInit ollama-1 | calling cuDriverGetVersion ollama-1 | raw version 0x2f08 ollama-1 | CUDA driver version: 12.4 ollama-1 | calling cuDeviceGetCount ollama-1 | device count 1 ollama-1 | time=2025-08-05T17:57:22.008Z level=DEBUG source=gpu.go:441 msg="updating cuda memory data" gpu=GPU-4a702f36-6e27-c7db-15af-79cfe15ee9df name="NVIDIA GeForce RTX 3090" overhead="0 B" before.total="23.7 GiB" before.free="23.4 GiB" now.total="23.7 GiB" now.free="23.4 GiB" now.used="261.1 MiB" ollama-1 | releasing cuda driver library ollama-1 | time=2025-08-05T17:57:22.008Z level=DEBUG source=sched.go:183 msg="updating default concurrency" OLLAMA_MAX_LOADED_MODELS=3 gpu_count=1 ollama-1 | time=2025-08-05T17:57:22.047Z level=DEBUG source=ggml.go:208 msg="key with type not found" key=general.alignment default=32 ollama-1 | time=2025-08-05T17:57:22.129Z level=DEBUG source=sched.go:226 msg="loading first model" model=/root/.ollama/models/blobs/sha256-b112e727c6f18875636c56a779790a590d705aec9e1c0eb5a97d51fc2a778583 ollama-1 | time=2025-08-05T17:57:22.129Z level=DEBUG source=memory.go:111 msg=evaluating library=cuda gpu_count=1 available="[23.4 GiB]" ollama-1 | time=2025-08-05T17:57:22.129Z level=DEBUG source=ggml.go:208 msg="key with type not found" key=gptoss.vision.block_count default=0 ollama-1 | time=2025-08-05T17:57:22.130Z level=DEBUG source=gpu.go:391 msg="updating system memory data" before.total="62.5 GiB" before.free="53.1 GiB" before.free_swap="0 B" now.total="62.5 GiB" now.free="53.0 GiB" now.free_swap="0 B" ollama-1 | initializing /usr/lib/x86_64-linux-gnu/libcuda.so.550.163.01 ollama-1 | dlsym: cuInit - 0x7d7015e7ce20 ollama-1 | dlsym: cuDriverGetVersion - 0x7d7015e7ce40 ollama-1 | dlsym: cuDeviceGetCount - 0x7d7015e7ce80 ollama-1 | dlsym: cuDeviceGet - 0x7d7015e7ce60 ollama-1 | dlsym: cuDeviceGetAttribute - 0x7d7015e7cf60 ollama-1 | dlsym: cuDeviceGetUuid - 0x7d7015e7cec0 ollama-1 | dlsym: cuDeviceGetName - 0x7d7015e7cea0 ollama-1 | dlsym: cuCtxCreate_v3 - 0x7d7015e7d140 ollama-1 | dlsym: cuMemGetInfo_v2 - 0x7d7015e87080 ollama-1 | dlsym: cuCtxDestroy - 0x7d7015ee19c0 ollama-1 | calling cuInit ollama-1 | calling cuDriverGetVersion ollama-1 | raw version 0x2f08 ollama-1 | CUDA driver version: 12.4 ollama-1 | calling cuDeviceGetCount ollama-1 | device count 1 ollama-1 | time=2025-08-05T17:57:22.260Z level=DEBUG source=gpu.go:441 msg="updating cuda memory data" gpu=GPU-4a702f36-6e27-c7db-15af-79cfe15ee9df name="NVIDIA GeForce RTX 3090" overhead="0 B" before.total="23.7 GiB" before.free="23.4 GiB" now.total="23.7 GiB" now.free="23.4 GiB" now.used="261.1 MiB" ollama-1 | releasing cuda driver library ollama-1 | time=2025-08-05T17:57:22.261Z level=INFO source=sched.go:786 msg="new model will fit in available VRAM in single GPU, loading" model=/root/.ollama/models/blobs/sha256-b112e727c6f18875636c56a779790a590d705aec9e1c0eb5a97d51fc2a778583 gpu=GPU-4a702f36-6e27-c7db-15af-79cfe15ee9df parallel=1 available=25157042176 required="13.8 GiB" ollama-1 | time=2025-08-05T17:57:22.261Z level=DEBUG source=gpu.go:391 msg="updating system memory data" before.total="62.5 GiB" before.free="53.0 GiB" before.free_swap="0 B" now.total="62.5 GiB" now.free="53.0 GiB" now.free_swap="0 B" ollama-1 | initializing /usr/lib/x86_64-linux-gnu/libcuda.so.550.163.01 ollama-1 | dlsym: cuInit - 0x7d7015e7ce20 ollama-1 | dlsym: cuDriverGetVersion - 0x7d7015e7ce40 ollama-1 | dlsym: cuDeviceGetCount - 0x7d7015e7ce80 ollama-1 | dlsym: cuDeviceGet - 0x7d7015e7ce60 ollama-1 | dlsym: cuDeviceGetAttribute - 0x7d7015e7cf60 ollama-1 | dlsym: cuDeviceGetUuid - 0x7d7015e7cec0 ollama-1 | dlsym: cuDeviceGetName - 0x7d7015e7cea0 ollama-1 | dlsym: cuCtxCreate_v3 - 0x7d7015e7d140 ollama-1 | dlsym: cuMemGetInfo_v2 - 0x7d7015e87080 ollama-1 | dlsym: cuCtxDestroy - 0x7d7015ee19c0 ollama-1 | calling cuInit ollama-1 | calling cuDriverGetVersion ollama-1 | raw version 0x2f08 ollama-1 | CUDA driver version: 12.4 ollama-1 | calling cuDeviceGetCount ollama-1 | device count 1 ollama-1 | time=2025-08-05T17:57:22.390Z level=DEBUG source=gpu.go:441 msg="updating cuda memory data" gpu=GPU-4a702f36-6e27-c7db-15af-79cfe15ee9df name="NVIDIA GeForce RTX 3090" overhead="0 B" before.total="23.7 GiB" before.free="23.4 GiB" now.total="23.7 GiB" now.free="23.4 GiB" now.used="261.1 MiB" ollama-1 | releasing cuda driver library ollama-1 | time=2025-08-05T17:57:22.390Z level=INFO source=server.go:135 msg="system memory" total="62.5 GiB" free="53.0 GiB" free_swap="0 B" ollama-1 | time=2025-08-05T17:57:22.390Z level=DEBUG source=memory.go:111 msg=evaluating library=cuda gpu_count=1 available="[23.4 GiB]" ollama-1 | time=2025-08-05T17:57:22.390Z level=DEBUG source=ggml.go:208 msg="key with type not found" key=gptoss.vision.block_count default=0 ollama-1 | time=2025-08-05T17:57:22.391Z level=DEBUG source=gpu.go:391 msg="updating system memory data" before.total="62.5 GiB" before.free="53.0 GiB" before.free_swap="0 B" now.total="62.5 GiB" now.free="53.0 GiB" now.free_swap="0 B" ollama-1 | initializing /usr/lib/x86_64-linux-gnu/libcuda.so.550.163.01 ollama-1 | dlsym: cuInit - 0x7d7015e7ce20 ollama-1 | dlsym: cuDriverGetVersion - 0x7d7015e7ce40 ollama-1 | dlsym: cuDeviceGetCount - 0x7d7015e7ce80 ollama-1 | dlsym: cuDeviceGet - 0x7d7015e7ce60 ollama-1 | dlsym: cuDeviceGetAttribute - 0x7d7015e7cf60 ollama-1 | dlsym: cuDeviceGetUuid - 0x7d7015e7cec0 ollama-1 | dlsym: cuDeviceGetName - 0x7d7015e7cea0 ollama-1 | dlsym: cuCtxCreate_v3 - 0x7d7015e7d140 ollama-1 | dlsym: cuMemGetInfo_v2 - 0x7d7015e87080 ollama-1 | dlsym: cuCtxDestroy - 0x7d7015ee19c0 ollama-1 | calling cuInit ollama-1 | calling cuDriverGetVersion ollama-1 | raw version 0x2f08 ollama-1 | CUDA driver version: 12.4 ollama-1 | calling cuDeviceGetCount ollama-1 | device count 1 ollama-1 | time=2025-08-05T17:57:22.512Z level=DEBUG source=gpu.go:441 msg="updating cuda memory data" gpu=GPU-4a702f36-6e27-c7db-15af-79cfe15ee9df name="NVIDIA GeForce RTX 3090" overhead="0 B" before.total="23.7 GiB" before.free="23.4 GiB" now.total="23.7 GiB" now.free="23.4 GiB" now.used="261.1 MiB" ollama-1 | releasing cuda driver library ollama-1 | time=2025-08-05T17:57:22.512Z level=INFO source=server.go:175 msg=offload library=cuda layers.requested=-1 layers.model=25 layers.offload=25 layers.split="" memory.available="[23.4 GiB]" memory.gpu_overhead="0 B" memory.required.full="13.8 GiB" memory.required.partial="13.8 GiB" memory.required.kv="150.0 MiB" memory.required.allocations="[13.8 GiB]" memory.weights.total="11.7 GiB" memory.weights.repeating="10.7 GiB" memory.weights.nonrepeating="1.1 GiB" memory.graph.full="1.0 GiB" memory.graph.partial="2.0 GiB" ollama-1 | time=2025-08-05T17:57:22.513Z level=INFO source=server.go:218 msg="enabling flash attention" ollama-1 | time=2025-08-05T17:57:22.513Z level=DEBUG source=server.go:291 msg="compatible gpu libraries" compatible=[] ollama-1 | time=2025-08-05T17:57:22.582Z level=DEBUG source=ggml.go:208 msg="key with type not found" key=general.alignment default=32 ollama-1 | time=2025-08-05T17:57:22.583Z level=DEBUG source=ggml.go:208 msg="key with type not found" key=tokenizer.ggml.pretokenizer default="[^\\r\\n\\p{L}\\p{N}]?[\\p{Lu}\\p{Lt}\\p{Lm}\\p{Lo}\\p{M}]*[\\p{Ll}\\p{Lm}\\p{Lo}\\p{M}]+(?i:'s|'t|'re|'ve|'m|'ll|'d)?|[^\\r\\n\\p{L}\\p{N}]?[\\p{Lu}\\p{Lt}\\p{Lm}\\p{Lo}\\p{M}]+[\\p{Ll}\\p{Lm}\\p{Lo}\\p{M}]*(?i:'s|'t|'re|'ve|'m|'ll|'d)?|\\p{N}{1,3}| ?[^\\s\\p{L}\\p{N}]+[\\r\\n/]*|\\s*[\\r\\n]+|\\s+(?!\\S)|\\s+" ollama-1 | time=2025-08-05T17:57:22.583Z level=INFO source=server.go:438 msg="starting llama server" cmd="/usr/bin/ollama runner --ollama-engine --model /root/.ollama/models/blobs/sha256-b112e727c6f18875636c56a779790a590d705aec9e1c0eb5a97d51fc2a778583 --ctx-size 8192 --batch-size 512 --n-gpu-layers 25 --threads 8 --flash-attn --kv-cache-type q8_0 --parallel 1 --port 45347" ollama-1 | time=2025-08-05T17:57:22.583Z level=DEBUG source=server.go:439 msg=subprocess PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin OLLAMA_FLASH_ATTENTION=1 OLLAMA_KV_CACHE_TYPE=q8_0 OLLAMA_DEBUG=1 LD_LIBRARY_PATH=/usr/lib/ollama:/usr/local/nvidia/lib:/usr/local/nvidia/lib64:/usr/lib/ollama OLLAMA_HOST=0.0.0.0:11434 OLLAMA_MAX_LOADED_MODELS=3 OLLAMA_LIBRARY_PATH=/usr/lib/ollama CUDA_VISIBLE_DEVICES=GPU-4a702f36-6e27-c7db-15af-79cfe15ee9df ollama-1 | time=2025-08-05T17:57:22.584Z level=INFO source=sched.go:481 msg="loaded runners" count=1 ollama-1 | time=2025-08-05T17:57:22.584Z level=INFO source=server.go:598 msg="waiting for llama runner to start responding" ollama-1 | time=2025-08-05T17:57:22.584Z level=INFO source=server.go:632 msg="waiting for server to become available" status="llm server not responding" ollama-1 | time=2025-08-05T17:57:22.598Z level=INFO source=runner.go:925 msg="starting ollama engine" ollama-1 | time=2025-08-05T17:57:22.599Z level=INFO source=runner.go:983 msg="Server listening on 127.0.0.1:45347" ollama-1 | time=2025-08-05T17:57:22.672Z level=DEBUG source=ggml.go:208 msg="key with type not found" key=general.alignment default=32 ollama-1 | time=2025-08-05T17:57:22.673Z level=DEBUG source=ggml.go:208 msg="key with type not found" key=general.name default="" ollama-1 | time=2025-08-05T17:57:22.673Z level=DEBUG source=ggml.go:208 msg="key with type not found" key=general.description default="" ollama-1 | time=2025-08-05T17:57:22.673Z level=INFO source=ggml.go:92 msg="" architecture=gptoss file_type=MXFP4 name="" description="" num_tensors=315 num_key_values=30 ollama-1 | time=2025-08-05T17:57:22.673Z level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=/usr/lib/ollama ollama-1 | ggml_cuda_init: GGML_CUDA_FORCE_MMQ: no ollama-1 | ggml_cuda_init: GGML_CUDA_FORCE_CUBLAS: no ollama-1 | ggml_cuda_init: found 1 CUDA devices: ollama-1 | Device 0: NVIDIA GeForce RTX 3090, compute capability 8.6, VMM: yes ollama-1 | load_backend: loaded CUDA backend from /usr/lib/ollama/libggml-cuda.so ollama-1 | load_backend: loaded CPU backend from /usr/lib/ollama/libggml-cpu-haswell.so ollama-1 | time=2025-08-05T17:57:22.735Z level=INFO source=ggml.go:104 msg=system CPU.0.SSE3=1 CPU.0.SSSE3=1 CPU.0.AVX=1 CPU.0.AVX2=1 CPU.0.F16C=1 CPU.0.FMA=1 CPU.0.BMI2=1 CPU.0.LLAMAFILE=1 CPU.1.LLAMAFILE=1 CUDA.0.ARCHS=500,600,610,700,750,800,860,870,890,900,1200 CUDA.0.USE_GRAPHS=1 CUDA.0.PEER_MAX_BATCH_SIZE=128 compiler=cgo(gcc) ollama-1 | time=2025-08-05T17:57:22.819Z level=INFO source=ggml.go:367 msg="offloading 24 repeating layers to GPU" ollama-1 | time=2025-08-05T17:57:22.819Z level=INFO source=ggml.go:373 msg="offloading output layer to GPU" ollama-1 | time=2025-08-05T17:57:22.819Z level=INFO source=ggml.go:378 msg="offloaded 25/25 layers to GPU" ollama-1 | time=2025-08-05T17:57:22.819Z level=INFO source=ggml.go:381 msg="model weights" buffer=CUDA0 size="11.7 GiB" ollama-1 | time=2025-08-05T17:57:22.819Z level=INFO source=ggml.go:381 msg="model weights" buffer=CPU size="1.1 GiB" ollama-1 | time=2025-08-05T17:57:22.820Z level=DEBUG source=ggml.go:208 msg="key with type not found" key=tokenizer.ggml.pretokenizer default="[^\\r\\n\\p{L}\\p{N}]?[\\p{Lu}\\p{Lt}\\p{Lm}\\p{Lo}\\p{M}]*[\\p{Ll}\\p{Lm}\\p{Lo}\\p{M}]+(?i:'s|'t|'re|'ve|'m|'ll|'d)?|[^\\r\\n\\p{L}\\p{N}]?[\\p{Lu}\\p{Lt}\\p{Lm}\\p{Lo}\\p{M}]+[\\p{Ll}\\p{Lm}\\p{Lo}\\p{M}]*(?i:'s|'t|'re|'ve|'m|'ll|'d)?|\\p{N}{1,3}| ?[^\\s\\p{L}\\p{N}]+[\\r\\n/]*|\\s*[\\r\\n]+|\\s+(?!\\S)|\\s+" ollama-1 | time=2025-08-05T17:57:22.835Z level=DEBUG source=ggml.go:654 msg="compute graph" nodes=1847 splits=2 ollama-1 | time=2025-08-05T17:57:22.835Z level=INFO source=ggml.go:672 msg="compute graph" backend=CUDA0 buffer_type=CUDA0 size="2.1 GiB" ollama-1 | time=2025-08-05T17:57:22.835Z level=INFO source=ggml.go:672 msg="compute graph" backend=CPU buffer_type=CPU size="5.6 MiB" ollama-1 | time=2025-08-05T17:57:22.835Z level=DEBUG source=runner.go:883 msg=memory allocated.InputWeights=1158266880A allocated.CPU.Graph=5898240A allocated.CUDA0.ID=GPU-4a702f36-6e27-c7db-15af-79cfe15ee9df allocated.CUDA0.Weights="[477075840A 477075840A 477075840A 477075840A 477075840A 477075840A 477075840A 477075840A 477075840A 477075840A 477075840A 477075840A 477075840A 477075840A 477075840A 477075840A 477075840A 477075840A 477075840A 477075840A 477075840A 477075840A 477075840A 477075840A 1158278400A]" allocated.CUDA0.Cache="[5014016A 8913408A 5014016A 8913408A 5014016A 8913408A 5014016A 8913408A 5014016A 8913408A 5014016A 8913408A 5014016A 8913408A 5014016A 8913408A 5014016A 8913408A 5014016A 8913408A 5014016A 8913408A 5014016A 8913408A 0U]" allocated.CUDA0.Graph=2204502272A ollama-1 | time=2025-08-05T17:57:22.835Z level=INFO source=server.go:632 msg="waiting for server to become available" status="llm server loading model" ollama-1 | time=2025-08-05T17:57:23.086Z level=DEBUG source=server.go:643 msg="model load progress 0.04" ollama-1 | time=2025-08-05T17:57:23.337Z level=DEBUG source=server.go:643 msg="model load progress 0.07" ollama-1 | time=2025-08-05T17:57:23.588Z level=DEBUG source=server.go:643 msg="model load progress 0.10" ollama-1 | time=2025-08-05T17:57:23.838Z level=DEBUG source=server.go:643 msg="model load progress 0.14" ollama-1 | time=2025-08-05T17:57:24.089Z level=DEBUG source=server.go:643 msg="model load progress 0.18" ollama-1 | time=2025-08-05T17:57:24.340Z level=DEBUG source=server.go:643 msg="model load progress 0.21" ollama-1 | time=2025-08-05T17:57:24.590Z level=DEBUG source=server.go:643 msg="model load progress 0.25" ollama-1 | time=2025-08-05T17:57:24.841Z level=DEBUG source=server.go:643 msg="model load progress 0.28" ollama-1 | time=2025-08-05T17:57:25.092Z level=DEBUG source=server.go:643 msg="model load progress 0.32" ollama-1 | time=2025-08-05T17:57:25.342Z level=DEBUG source=server.go:643 msg="model load progress 0.35" ollama-1 | time=2025-08-05T17:57:25.593Z level=DEBUG source=server.go:643 msg="model load progress 0.39" ollama-1 | time=2025-08-05T17:57:25.844Z level=DEBUG source=server.go:643 msg="model load progress 0.43" ollama-1 | time=2025-08-05T17:57:26.095Z level=DEBUG source=server.go:643 msg="model load progress 0.46" ollama-1 | time=2025-08-05T17:57:26.345Z level=DEBUG source=server.go:643 msg="model load progress 0.50" ollama-1 | time=2025-08-05T17:57:26.596Z level=DEBUG source=server.go:643 msg="model load progress 0.53" ollama-1 | time=2025-08-05T17:57:26.847Z level=DEBUG source=server.go:643 msg="model load progress 0.57" ollama-1 | time=2025-08-05T17:57:27.097Z level=DEBUG source=server.go:643 msg="model load progress 0.60" ollama-1 | time=2025-08-05T17:57:27.348Z level=DEBUG source=server.go:643 msg="model load progress 0.64" ollama-1 | time=2025-08-05T17:57:27.599Z level=DEBUG source=server.go:643 msg="model load progress 0.68" ollama-1 | time=2025-08-05T17:57:27.849Z level=DEBUG source=server.go:643 msg="model load progress 0.71" ollama-1 | time=2025-08-05T17:57:28.100Z level=DEBUG source=server.go:643 msg="model load progress 0.77" ollama-1 | time=2025-08-05T17:57:28.351Z level=DEBUG source=server.go:643 msg="model load progress 0.84" ollama-1 | time=2025-08-05T17:57:28.602Z level=DEBUG source=server.go:643 msg="model load progress 0.90" ollama-1 | time=2025-08-05T17:57:28.853Z level=DEBUG source=server.go:643 msg="model load progress 0.94" ollama-1 | time=2025-08-05T17:57:29.104Z level=DEBUG source=server.go:643 msg="model load progress 0.96" ollama-1 | time=2025-08-05T17:57:29.355Z level=DEBUG source=server.go:643 msg="model load progress 0.98" ollama-1 | time=2025-08-05T17:57:29.606Z level=INFO source=server.go:637 msg="llama runner started in 7.02 seconds" ollama-1 | time=2025-08-05T17:57:29.606Z level=DEBUG source=sched.go:493 msg="finished setting up" runner.name=registry.ollama.ai/library/gpt-oss:20b runner.inference=cuda runner.devices=1 runner.size="13.8 GiB" runner.vram="13.8 GiB" runner.parallel=1 runner.pid=58 runner.model=/root/.ollama/models/blobs/sha256-b112e727c6f18875636c56a779790a590d705aec9e1c0eb5a97d51fc2a778583 runner.num_ctx=8192 ollama-1 | [GIN] 2025/08/05 - 17:57:29 | 200 | 7.833381242s | 127.0.0.1 | POST "/api/generate" ollama-1 | time=2025-08-05T17:57:29.606Z level=DEBUG source=sched.go:501 msg="context for request finished" ollama-1 | time=2025-08-05T17:57:29.606Z level=DEBUG source=sched.go:341 msg="runner with non-zero duration has gone idle, adding timer" runner.name=registry.ollama.ai/library/gpt-oss:20b runner.inference=cuda runner.devices=1 runner.size="13.8 GiB" runner.vram="13.8 GiB" runner.parallel=1 runner.pid=58 runner.model=/root/.ollama/models/blobs/sha256-b112e727c6f18875636c56a779790a590d705aec9e1c0eb5a97d51fc2a778583 runner.num_ctx=8192 duration=5m0s ollama-1 | time=2025-08-05T17:57:29.606Z level=DEBUG source=sched.go:359 msg="after processing request finished event" runner.name=registry.ollama.ai/library/gpt-oss:20b runner.inference=cuda runner.devices=1 runner.size="13.8 GiB" runner.vram="13.8 GiB" runner.parallel=1 runner.pid=58 runner.model=/root/.ollama/models/blobs/sha256-b112e727c6f18875636c56a779790a590d705aec9e1c0eb5a97d51fc2a778583 runner.num_ctx=8192 refCount=0 ollama-1 | time=2025-08-05T17:57:31.478Z level=DEBUG source=sched.go:613 msg="evaluating already loaded" model=/root/.ollama/models/blobs/sha256-b112e727c6f18875636c56a779790a590d705aec9e1c0eb5a97d51fc2a778583 ollama-1 | time=2025-08-05T17:57:31.479Z level=DEBUG source=server.go:736 msg="completion request" images=0 prompt=315 format="" ollama-1 | time=2025-08-05T17:57:31.534Z level=DEBUG source=cache.go:136 msg="loading cache slot" id=0 cache=0 prompt=71 used=0 remaining=71 ollama-1 | CUDA error: an illegal memory access was encountered ollama-1 | current device: 0, in function ggml_cuda_mul_mat_id at //ml/backend/ggml/ggml/src/ggml-cuda/ggml-cuda.cu:2052 ollama-1 | cudaMemcpyAsync(ids_host.data(), ids->data, ggml_nbytes(ids), cudaMemcpyDeviceToHost, stream) ollama-1 | //ml/backend/ggml/ggml/src/ggml-cuda/ggml-cuda.cu:77: CUDA error ollama-1 | SIGSEGV: segmentation violation ollama-1 | PC=0x7a2450624fb7 m=15 sigcode=1 addr=0x204a03f7c ollama-1 | signal arrived during cgo execution ollama-1 | ollama-1 | goroutine 12 gp=0xc000103c00 m=15 mp=0xc000581808 [syscall]: ollama-1 | runtime.cgocall(0x60f6099ec180, 0xc000125a58) ollama-1 | runtime/cgocall.go:167 +0x4b fp=0xc000125a30 sp=0xc0001259f8 pc=0x60f608d1f8cb ollama-1 | github.com/ollama/ollama/ml/backend/ggml._Cfunc_ggml_backend_sched_graph_compute_async(0x7a2505011170, 0x7a2048004790) ollama-1 | _cgo_gotypes.go:886 +0x4a fp=0xc000125a58 sp=0xc000125a30 pc=0x60f6091594ea ollama-1 | github.com/ollama/ollama/ml/backend/ggml.(*Context).Compute.func1(...) ollama-1 | github.com/ollama/ollama/ml/backend/ggml/ggml.go:631 ollama-1 | github.com/ollama/ollama/ml/backend/ggml.(*Context).Compute(0xc000422000, {0xc00059a480, 0x1, 0x0?}) ollama-1 | github.com/ollama/ollama/ml/backend/ggml/ggml.go:631 +0x9d fp=0xc000125b00 sp=0xc000125a58 pc=0x60f6091649fd ollama-1 | github.com/ollama/ollama/model.Forward({0x60f60a0a0d30, 0xc000422000}, {0x60f60a097550, 0xc0000e96b0}, {0xc00012a400, 0x47, 0x80}, {{0x60f60a0ab988, 0xc0006ac360}, {0x0, ...}, ...}) ollama-1 | github.com/ollama/ollama/model/model.go:305 +0x2a7 fp=0xc000125be8 sp=0xc000125b00 pc=0x60f6091729c7 ollama-1 | github.com/ollama/ollama/runner/ollamarunner.(*Server).processBatch(0xc0004ec5a0) ollama-1 | github.com/ollama/ollama/runner/ollamarunner/runner.go:480 +0x4c5 fp=0xc000125f98 sp=0xc000125be8 pc=0x60f609213905 ollama-1 | github.com/ollama/ollama/runner/ollamarunner.(*Server).run(0xc0004ec5a0, {0x60f60a098a30, 0xc000690910}) ollama-1 | github.com/ollama/ollama/runner/ollamarunner/runner.go:362 +0x4e fp=0xc000125fb8 sp=0xc000125f98 pc=0x60f6092133ee ollama-1 | github.com/ollama/ollama/runner/ollamarunner.Execute.gowrap2() ollama-1 | github.com/ollama/ollama/runner/ollamarunner/runner.go:960 +0x28 fp=0xc000125fe0 sp=0xc000125fb8 pc=0x60f609218b48 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc000125fe8 sp=0xc000125fe0 pc=0x60f608d2a481 ollama-1 | created by github.com/ollama/ollama/runner/ollamarunner.Execute in goroutine 1 ollama-1 | github.com/ollama/ollama/runner/ollamarunner/runner.go:960 +0xa74 ollama-1 | ollama-1 | goroutine 1 gp=0xc000002380 m=nil [IO wait]: ollama-1 | runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc000123650 sp=0xc000123630 pc=0x60f608d22d4e ollama-1 | runtime.netpollblock(0xc0001236a0?, 0x8cbbb46?, 0xf6?) ollama-1 | runtime/netpoll.go:575 +0xf7 fp=0xc000123688 sp=0xc000123650 pc=0x60f608ce7837 ollama-1 | internal/poll.runtime_pollWait(0x7a25134a6eb0, 0x72) ollama-1 | runtime/netpoll.go:351 +0x85 fp=0xc0001236a8 sp=0xc000123688 pc=0x60f608d21f65 ollama-1 | internal/poll.(*pollDesc).wait(0xc0006a0480?, 0x900000036?, 0x0) ollama-1 | internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc0001236d0 sp=0xc0001236a8 pc=0x60f608da93a7 ollama-1 | internal/poll.(*pollDesc).waitRead(...) ollama-1 | internal/poll/fd_poll_runtime.go:89 ollama-1 | internal/poll.(*FD).Accept(0xc0006a0480) ollama-1 | internal/poll/fd_unix.go:620 +0x295 fp=0xc000123778 sp=0xc0001236d0 pc=0x60f608dae775 ollama-1 | net.(*netFD).accept(0xc0006a0480) ollama-1 | net/fd_unix.go:172 +0x29 fp=0xc000123830 sp=0xc000123778 pc=0x60f608e20d89 ollama-1 | net.(*TCPListener).accept(0xc000422880) ollama-1 | net/tcpsock_posix.go:159 +0x1b fp=0xc000123880 sp=0xc000123830 pc=0x60f608e3673b ollama-1 | net.(*TCPListener).Accept(0xc000422880) ollama-1 | net/tcpsock.go:380 +0x30 fp=0xc0001238b0 sp=0xc000123880 pc=0x60f608e355f0 ollama-1 | net/http.(*onceCloseListener).Accept(0xc0004f0360?) ollama-1 | <autogenerated>:1 +0x24 fp=0xc0001238c8 sp=0xc0001238b0 pc=0x60f60904cd44 ollama-1 | net/http.(*Server).Serve(0xc00030a000, {0x60f60a096588, 0xc000422880}) ollama-1 | net/http/server.go:3424 +0x30c fp=0xc0001239f8 sp=0xc0001238c8 pc=0x60f60902460c ollama-1 | github.com/ollama/ollama/runner/ollamarunner.Execute({0xc000034170, 0x11, 0x11}) ollama-1 | github.com/ollama/ollama/runner/ollamarunner/runner.go:984 +0xe09 fp=0xc000123d08 sp=0xc0001239f8 pc=0x60f6092188a9 ollama-1 | github.com/ollama/ollama/runner.Execute({0xc000034150?, 0x0?, 0x0?}) ollama-1 | github.com/ollama/ollama/runner/runner.go:20 +0xc9 fp=0xc000123d30 sp=0xc000123d08 pc=0x60f6092191a9 ollama-1 | github.com/ollama/ollama/cmd.NewCLI.func2(0xc0001fd200?, {0x60f609bd907b?, 0x4?, 0x60f609bd907f?}) ollama-1 | github.com/ollama/ollama/cmd/cmd.go:1583 +0x45 fp=0xc000123d58 sp=0xc000123d30 pc=0x60f60997e0e5 ollama-1 | github.com/spf13/cobra.(*Command).execute(0xc0004f4f08, {0xc0004ec360, 0x12, 0x12}) ollama-1 | github.com/spf13/cobra@v1.7.0/command.go:940 +0x85c fp=0xc000123e78 sp=0xc000123d58 pc=0x60f608e9a3dc ollama-1 | github.com/spf13/cobra.(*Command).ExecuteC(0xc0004d0908) ollama-1 | github.com/spf13/cobra@v1.7.0/command.go:1068 +0x3a5 fp=0xc000123f30 sp=0xc000123e78 pc=0x60f608e9ac25 ollama-1 | github.com/spf13/cobra.(*Command).Execute(...) ollama-1 | github.com/spf13/cobra@v1.7.0/command.go:992 ollama-1 | github.com/spf13/cobra.(*Command).ExecuteContext(...) ollama-1 | github.com/spf13/cobra@v1.7.0/command.go:985 ollama-1 | main.main() ollama-1 | github.com/ollama/ollama/main.go:12 +0x4d fp=0xc000123f50 sp=0xc000123f30 pc=0x60f60997ebcd ollama-1 | runtime.main() ollama-1 | runtime/proc.go:283 +0x29d fp=0xc000123fe0 sp=0xc000123f50 pc=0x60f608ceeebd ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc000123fe8 sp=0xc000123fe0 pc=0x60f608d2a481 ollama-1 | ollama-1 | goroutine 2 gp=0xc000002e00 m=nil [force gc (idle)]: ollama-1 | runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc000084fa8 sp=0xc000084f88 pc=0x60f608d22d4e ollama-1 | runtime.goparkunlock(...) ollama-1 | runtime/proc.go:441 ollama-1 | runtime.forcegchelper() ollama-1 | runtime/proc.go:348 +0xb8 fp=0xc000084fe0 sp=0xc000084fa8 pc=0x60f608cef1f8 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc000084fe8 sp=0xc000084fe0 pc=0x60f608d2a481 ollama-1 | created by runtime.init.7 in goroutine 1 ollama-1 | runtime/proc.go:336 +0x1a ollama-1 | ollama-1 | goroutine 3 gp=0xc000003340 m=nil [GC sweep wait]: ollama-1 | runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc000085780 sp=0xc000085760 pc=0x60f608d22d4e ollama-1 | runtime.goparkunlock(...) ollama-1 | runtime/proc.go:441 ollama-1 | runtime.bgsweep(0xc0000aa000) ollama-1 | runtime/mgcsweep.go:316 +0xdf fp=0xc0000857c8 sp=0xc000085780 pc=0x60f608cd999f ollama-1 | runtime.gcenable.gowrap1() ollama-1 | runtime/mgc.go:204 +0x25 fp=0xc0000857e0 sp=0xc0000857c8 pc=0x60f608ccdd85 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc0000857e8 sp=0xc0000857e0 pc=0x60f608d2a481 ollama-1 | created by runtime.gcenable in goroutine 1 ollama-1 | runtime/mgc.go:204 +0x66 ollama-1 | ollama-1 | goroutine 4 gp=0xc000003500 m=nil [GC scavenge wait]: ollama-1 | runtime.gopark(0x10000?, 0x60f609d9b090?, 0x0?, 0x0?, 0x0?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc000085f78 sp=0xc000085f58 pc=0x60f608d22d4e ollama-1 | runtime.goparkunlock(...) ollama-1 | runtime/proc.go:441 ollama-1 | runtime.(*scavengerState).park(0x60f60a92d9a0) ollama-1 | runtime/mgcscavenge.go:425 +0x49 fp=0xc000085fa8 sp=0xc000085f78 pc=0x60f608cd73e9 ollama-1 | runtime.bgscavenge(0xc0000aa000) ollama-1 | runtime/mgcscavenge.go:658 +0x59 fp=0xc000085fc8 sp=0xc000085fa8 pc=0x60f608cd7979 ollama-1 | runtime.gcenable.gowrap2() ollama-1 | runtime/mgc.go:205 +0x25 fp=0xc000085fe0 sp=0xc000085fc8 pc=0x60f608ccdd25 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc000085fe8 sp=0xc000085fe0 pc=0x60f608d2a481 ollama-1 | created by runtime.gcenable in goroutine 1 ollama-1 | runtime/mgc.go:205 +0xa5 ollama-1 | ollama-1 | goroutine 5 gp=0xc000003dc0 m=nil [finalizer wait]: ollama-1 | runtime.gopark(0x1b8?, 0xc000002380?, 0x1?, 0x23?, 0xc000084688?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc000084630 sp=0xc000084610 pc=0x60f608d22d4e ollama-1 | runtime.runfinq() ollama-1 | runtime/mfinal.go:196 +0x107 fp=0xc0000847e0 sp=0xc000084630 pc=0x60f608cccd47 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc0000847e8 sp=0xc0000847e0 pc=0x60f608d2a481 ollama-1 | created by runtime.createfing in goroutine 1 ollama-1 | runtime/mfinal.go:166 +0x3d ollama-1 | ollama-1 | goroutine 6 gp=0xc0001e08c0 m=nil [chan receive]: ollama-1 | runtime.gopark(0xc0001899a0?, 0xc001aa0048?, 0x60?, 0x67?, 0x60f608e079c8?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc000086718 sp=0xc0000866f8 pc=0x60f608d22d4e ollama-1 | runtime.chanrecv(0xc0000b8310, 0x0, 0x1) ollama-1 | runtime/chan.go:664 +0x445 fp=0xc000086790 sp=0xc000086718 pc=0x60f608cbe725 ollama-1 | runtime.chanrecv1(0x0?, 0x0?) ollama-1 | runtime/chan.go:506 +0x12 fp=0xc0000867b8 sp=0xc000086790 pc=0x60f608cbe2b2 ollama-1 | runtime.unique_runtime_registerUniqueMapCleanup.func2(...) ollama-1 | runtime/mgc.go:1796 ollama-1 | runtime.unique_runtime_registerUniqueMapCleanup.gowrap1() ollama-1 | runtime/mgc.go:1799 +0x2f fp=0xc0000867e0 sp=0xc0000867b8 pc=0x60f608cd0f2f ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc0000867e8 sp=0xc0000867e0 pc=0x60f608d2a481 ollama-1 | created by unique.runtime_registerUniqueMapCleanup in goroutine 1 ollama-1 | runtime/mgc.go:1794 +0x85 ollama-1 | ollama-1 | goroutine 7 gp=0xc0001e0e00 m=nil [GC worker (idle)]: ollama-1 | runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc000086f38 sp=0xc000086f18 pc=0x60f608d22d4e ollama-1 | runtime.gcBgMarkWorker(0xc0000b9730) ollama-1 | runtime/mgc.go:1423 +0xe9 fp=0xc000086fc8 sp=0xc000086f38 pc=0x60f608cd0249 ollama-1 | runtime.gcBgMarkStartWorkers.gowrap1() ollama-1 | runtime/mgc.go:1339 +0x25 fp=0xc000086fe0 sp=0xc000086fc8 pc=0x60f608cd0125 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc000086fe8 sp=0xc000086fe0 pc=0x60f608d2a481 ollama-1 | created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama-1 | runtime/mgc.go:1339 +0x105 ollama-1 | ollama-1 | goroutine 18 gp=0xc000102380 m=nil [GC worker (idle)]: ollama-1 | runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc000080738 sp=0xc000080718 pc=0x60f608d22d4e ollama-1 | runtime.gcBgMarkWorker(0xc0000b9730) ollama-1 | runtime/mgc.go:1423 +0xe9 fp=0xc0000807c8 sp=0xc000080738 pc=0x60f608cd0249 ollama-1 | runtime.gcBgMarkStartWorkers.gowrap1() ollama-1 | runtime/mgc.go:1339 +0x25 fp=0xc0000807e0 sp=0xc0000807c8 pc=0x60f608cd0125 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc0000807e8 sp=0xc0000807e0 pc=0x60f608d2a481 ollama-1 | created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama-1 | runtime/mgc.go:1339 +0x105 ollama-1 | ollama-1 | goroutine 34 gp=0xc000504000 m=nil [GC worker (idle)]: ollama-1 | runtime.gopark(0x60f60a9dc1e0?, 0x1?, 0x3f?, 0x35?, 0x0?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc00050a738 sp=0xc00050a718 pc=0x60f608d22d4e ollama-1 | runtime.gcBgMarkWorker(0xc0000b9730) ollama-1 | runtime/mgc.go:1423 +0xe9 fp=0xc00050a7c8 sp=0xc00050a738 pc=0x60f608cd0249 ollama-1 | runtime.gcBgMarkStartWorkers.gowrap1() ollama-1 | runtime/mgc.go:1339 +0x25 fp=0xc00050a7e0 sp=0xc00050a7c8 pc=0x60f608cd0125 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc00050a7e8 sp=0xc00050a7e0 pc=0x60f608d2a481 ollama-1 | created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama-1 | runtime/mgc.go:1339 +0x105 ollama-1 | ollama-1 | goroutine 8 gp=0xc0001e0fc0 m=nil [GC worker (idle)]: ollama-1 | runtime.gopark(0x60f60a9dc1e0?, 0x1?, 0x52?, 0xd6?, 0x0?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc000087738 sp=0xc000087718 pc=0x60f608d22d4e ollama-1 | runtime.gcBgMarkWorker(0xc0000b9730) ollama-1 | runtime/mgc.go:1423 +0xe9 fp=0xc0000877c8 sp=0xc000087738 pc=0x60f608cd0249 ollama-1 | runtime.gcBgMarkStartWorkers.gowrap1() ollama-1 | runtime/mgc.go:1339 +0x25 fp=0xc0000877e0 sp=0xc0000877c8 pc=0x60f608cd0125 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc0000877e8 sp=0xc0000877e0 pc=0x60f608d2a481 ollama-1 | created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama-1 | runtime/mgc.go:1339 +0x105 ollama-1 | ollama-1 | goroutine 19 gp=0xc000102540 m=nil [GC worker (idle)]: ollama-1 | runtime.gopark(0x1ca8e8b6ab9c?, 0x0?, 0x0?, 0x0?, 0x0?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc000080f38 sp=0xc000080f18 pc=0x60f608d22d4e ollama-1 | runtime.gcBgMarkWorker(0xc0000b9730) ollama-1 | runtime/mgc.go:1423 +0xe9 fp=0xc000080fc8 sp=0xc000080f38 pc=0x60f608cd0249 ollama-1 | runtime.gcBgMarkStartWorkers.gowrap1() ollama-1 | runtime/mgc.go:1339 +0x25 fp=0xc000080fe0 sp=0xc000080fc8 pc=0x60f608cd0125 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc000080fe8 sp=0xc000080fe0 pc=0x60f608d2a481 ollama-1 | created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama-1 | runtime/mgc.go:1339 +0x105 ollama-1 | ollama-1 | goroutine 35 gp=0xc0005041c0 m=nil [GC worker (idle)]: ollama-1 | runtime.gopark(0x1ca8e8b75bcd?, 0x0?, 0x0?, 0x0?, 0x0?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc00050af38 sp=0xc00050af18 pc=0x60f608d22d4e ollama-1 | runtime.gcBgMarkWorker(0xc0000b9730) ollama-1 | runtime/mgc.go:1423 +0xe9 fp=0xc00050afc8 sp=0xc00050af38 pc=0x60f608cd0249 ollama-1 | runtime.gcBgMarkStartWorkers.gowrap1() ollama-1 | runtime/mgc.go:1339 +0x25 fp=0xc00050afe0 sp=0xc00050afc8 pc=0x60f608cd0125 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc00050afe8 sp=0xc00050afe0 pc=0x60f608d2a481 ollama-1 | created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama-1 | runtime/mgc.go:1339 +0x105 ollama-1 | ollama-1 | goroutine 9 gp=0xc0001e1180 m=nil [GC worker (idle)]: ollama-1 | runtime.gopark(0x1ca8e8fee809?, 0x0?, 0x0?, 0x0?, 0x0?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc000087f38 sp=0xc000087f18 pc=0x60f608d22d4e ollama-1 | runtime.gcBgMarkWorker(0xc0000b9730) ollama-1 | runtime/mgc.go:1423 +0xe9 fp=0xc000087fc8 sp=0xc000087f38 pc=0x60f608cd0249 ollama-1 | runtime.gcBgMarkStartWorkers.gowrap1() ollama-1 | runtime/mgc.go:1339 +0x25 fp=0xc000087fe0 sp=0xc000087fc8 pc=0x60f608cd0125 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc000087fe8 sp=0xc000087fe0 pc=0x60f608d2a481 ollama-1 | created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama-1 | runtime/mgc.go:1339 +0x105 ollama-1 | ollama-1 | goroutine 20 gp=0xc000102700 m=nil [GC worker (idle)]: ollama-1 | runtime.gopark(0x1ca8e8dc93a3?, 0x1?, 0x4f?, 0x1a?, 0x0?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc000081738 sp=0xc000081718 pc=0x60f608d22d4e ollama-1 | runtime.gcBgMarkWorker(0xc0000b9730) ollama-1 | runtime/mgc.go:1423 +0xe9 fp=0xc0000817c8 sp=0xc000081738 pc=0x60f608cd0249 ollama-1 | runtime.gcBgMarkStartWorkers.gowrap1() ollama-1 | runtime/mgc.go:1339 +0x25 fp=0xc0000817e0 sp=0xc0000817c8 pc=0x60f608cd0125 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc0000817e8 sp=0xc0000817e0 pc=0x60f608d2a481 ollama-1 | created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama-1 | runtime/mgc.go:1339 +0x105 ollama-1 | ollama-1 | goroutine 36 gp=0xc000504380 m=nil [GC worker (idle)]: ollama-1 | runtime.gopark(0x1ca8e8fd3a82?, 0x3?, 0x53?, 0x96?, 0x0?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc00050b738 sp=0xc00050b718 pc=0x60f608d22d4e ollama-1 | runtime.gcBgMarkWorker(0xc0000b9730) ollama-1 | runtime/mgc.go:1423 +0xe9 fp=0xc00050b7c8 sp=0xc00050b738 pc=0x60f608cd0249 ollama-1 | runtime.gcBgMarkStartWorkers.gowrap1() ollama-1 | runtime/mgc.go:1339 +0x25 fp=0xc00050b7e0 sp=0xc00050b7c8 pc=0x60f608cd0125 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc00050b7e8 sp=0xc00050b7e0 pc=0x60f608d2a481 ollama-1 | created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama-1 | runtime/mgc.go:1339 +0x105 ollama-1 | ollama-1 | goroutine 10 gp=0xc0001e1340 m=nil [GC worker (idle)]: ollama-1 | runtime.gopark(0x1ca8e8b6da1a?, 0x0?, 0x0?, 0x0?, 0x0?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc000506738 sp=0xc000506718 pc=0x60f608d22d4e ollama-1 | runtime.gcBgMarkWorker(0xc0000b9730) ollama-1 | runtime/mgc.go:1423 +0xe9 fp=0xc0005067c8 sp=0xc000506738 pc=0x60f608cd0249 ollama-1 | runtime.gcBgMarkStartWorkers.gowrap1() ollama-1 | runtime/mgc.go:1339 +0x25 fp=0xc0005067e0 sp=0xc0005067c8 pc=0x60f608cd0125 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc0005067e8 sp=0xc0005067e0 pc=0x60f608d2a481 ollama-1 | created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama-1 | runtime/mgc.go:1339 +0x105 ollama-1 | ollama-1 | goroutine 21 gp=0xc0001028c0 m=nil [GC worker (idle)]: ollama-1 | runtime.gopark(0x60f60a9dc1e0?, 0x1?, 0xfa?, 0x2a?, 0x0?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc000081f38 sp=0xc000081f18 pc=0x60f608d22d4e ollama-1 | runtime.gcBgMarkWorker(0xc0000b9730) ollama-1 | runtime/mgc.go:1423 +0xe9 fp=0xc000081fc8 sp=0xc000081f38 pc=0x60f608cd0249 ollama-1 | runtime.gcBgMarkStartWorkers.gowrap1() ollama-1 | runtime/mgc.go:1339 +0x25 fp=0xc000081fe0 sp=0xc000081fc8 pc=0x60f608cd0125 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc000081fe8 sp=0xc000081fe0 pc=0x60f608d2a481 ollama-1 | created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama-1 | runtime/mgc.go:1339 +0x105 ollama-1 | ollama-1 | goroutine 22 gp=0xc000102a80 m=nil [GC worker (idle)]: ollama-1 | runtime.gopark(0x1ca8e8b763b2?, 0x1?, 0x5e?, 0x67?, 0x0?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc000082738 sp=0xc000082718 pc=0x60f608d22d4e ollama-1 | runtime.gcBgMarkWorker(0xc0000b9730) ollama-1 | runtime/mgc.go:1423 +0xe9 fp=0xc0000827c8 sp=0xc000082738 pc=0x60f608cd0249 ollama-1 | runtime.gcBgMarkStartWorkers.gowrap1() ollama-1 | runtime/mgc.go:1339 +0x25 fp=0xc0000827e0 sp=0xc0000827c8 pc=0x60f608cd0125 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc0000827e8 sp=0xc0000827e0 pc=0x60f608d2a481 ollama-1 | created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama-1 | runtime/mgc.go:1339 +0x105 ollama-1 | ollama-1 | goroutine 23 gp=0xc000102c40 m=nil [GC worker (idle)]: ollama-1 | runtime.gopark(0x1ca8e8dcb342?, 0x3?, 0x55?, 0x45?, 0x0?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc000082f38 sp=0xc000082f18 pc=0x60f608d22d4e ollama-1 | runtime.gcBgMarkWorker(0xc0000b9730) ollama-1 | runtime/mgc.go:1423 +0xe9 fp=0xc000082fc8 sp=0xc000082f38 pc=0x60f608cd0249 ollama-1 | runtime.gcBgMarkStartWorkers.gowrap1() ollama-1 | runtime/mgc.go:1339 +0x25 fp=0xc000082fe0 sp=0xc000082fc8 pc=0x60f608cd0125 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc000082fe8 sp=0xc000082fe0 pc=0x60f608d2a481 ollama-1 | created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama-1 | runtime/mgc.go:1339 +0x105 ollama-1 | ollama-1 | goroutine 24 gp=0xc000102e00 m=nil [GC worker (idle)]: ollama-1 | runtime.gopark(0x1ca8e9018c6b?, 0x3?, 0x19?, 0x32?, 0x0?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc000083738 sp=0xc000083718 pc=0x60f608d22d4e ollama-1 | runtime.gcBgMarkWorker(0xc0000b9730) ollama-1 | runtime/mgc.go:1423 +0xe9 fp=0xc0000837c8 sp=0xc000083738 pc=0x60f608cd0249 ollama-1 | runtime.gcBgMarkStartWorkers.gowrap1() ollama-1 | runtime/mgc.go:1339 +0x25 fp=0xc0000837e0 sp=0xc0000837c8 pc=0x60f608cd0125 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc0000837e8 sp=0xc0000837e0 pc=0x60f608d2a481 ollama-1 | created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama-1 | runtime/mgc.go:1339 +0x105 ollama-1 | ollama-1 | goroutine 25 gp=0xc000102fc0 m=nil [GC worker (idle)]: ollama-1 | runtime.gopark(0x1ca8e8dd9c39?, 0x3?, 0xc8?, 0x52?, 0x0?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc000083f38 sp=0xc000083f18 pc=0x60f608d22d4e ollama-1 | runtime.gcBgMarkWorker(0xc0000b9730) ollama-1 | runtime/mgc.go:1423 +0xe9 fp=0xc000083fc8 sp=0xc000083f38 pc=0x60f608cd0249 ollama-1 | runtime.gcBgMarkStartWorkers.gowrap1() ollama-1 | runtime/mgc.go:1339 +0x25 fp=0xc000083fe0 sp=0xc000083fc8 pc=0x60f608cd0125 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc000083fe8 sp=0xc000083fe0 pc=0x60f608d2a481 ollama-1 | created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama-1 | runtime/mgc.go:1339 +0x105 ollama-1 | ollama-1 | goroutine 26 gp=0xc000103180 m=nil [GC worker (idle)]: ollama-1 | runtime.gopark(0x1ca8e8b87b6c?, 0x3?, 0xe3?, 0xf5?, 0x0?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc00011c738 sp=0xc00011c718 pc=0x60f608d22d4e ollama-1 | runtime.gcBgMarkWorker(0xc0000b9730) ollama-1 | runtime/mgc.go:1423 +0xe9 fp=0xc00011c7c8 sp=0xc00011c738 pc=0x60f608cd0249 ollama-1 | runtime.gcBgMarkStartWorkers.gowrap1() ollama-1 | runtime/mgc.go:1339 +0x25 fp=0xc00011c7e0 sp=0xc00011c7c8 pc=0x60f608cd0125 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc00011c7e8 sp=0xc00011c7e0 pc=0x60f608d2a481 ollama-1 | created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama-1 | runtime/mgc.go:1339 +0x105 ollama-1 | ollama-1 | goroutine 27 gp=0xc000582a80 m=nil [select]: ollama-1 | runtime.gopark(0xc000047a10?, 0x2?, 0x0?, 0x0?, 0xc000047874?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc0000476a0 sp=0xc000047680 pc=0x60f608d22d4e ollama-1 | runtime.selectgo(0xc000047a10, 0xc000047870, 0x47?, 0x0, 0x4?, 0x1) ollama-1 | runtime/select.go:351 +0x837 fp=0xc0000477d8 sp=0xc0000476a0 pc=0x60f608d013b7 ollama-1 | github.com/ollama/ollama/runner/ollamarunner.(*Server).completion(0xc0004ec5a0, {0x60f60a096768, 0xc0014601c0}, 0xc000432280) ollama-1 | github.com/ollama/ollama/runner/ollamarunner/runner.go:680 +0xb65 fp=0xc000047ac0 sp=0xc0000477d8 pc=0x60f609215c45 ollama-1 | github.com/ollama/ollama/runner/ollamarunner.(*Server).completion-fm({0x60f60a096768?, 0xc0014601c0?}, 0xc000121b40?) ollama-1 | <autogenerated>:1 +0x36 fp=0xc000047af0 sp=0xc000047ac0 pc=0x60f609219016 ollama-1 | net/http.HandlerFunc.ServeHTTP(0xc0004c35c0?, {0x60f60a096768?, 0xc0014601c0?}, 0xc000121b60?) ollama-1 | net/http/server.go:2294 +0x29 fp=0xc000047b18 sp=0xc000047af0 pc=0x60f609020c49 ollama-1 | net/http.(*ServeMux).ServeHTTP(0x60f608cc7265?, {0x60f60a096768, 0xc0014601c0}, 0xc000432280) ollama-1 | net/http/server.go:2822 +0x1c4 fp=0xc000047b68 sp=0xc000047b18 pc=0x60f609022b44 ollama-1 | net/http.serverHandler.ServeHTTP({0x60f60a092db0?}, {0x60f60a096768?, 0xc0014601c0?}, 0x1?) ollama-1 | net/http/server.go:3301 +0x8e fp=0xc000047b98 sp=0xc000047b68 pc=0x60f6090405ce ollama-1 | net/http.(*conn).serve(0xc0004f0360, {0x60f60a0989f8, 0xc0000ffb60}) ollama-1 | net/http/server.go:2102 +0x625 fp=0xc000047fb8 sp=0xc000047b98 pc=0x60f60901f145 ollama-1 | net/http.(*Server).Serve.gowrap3() ollama-1 | net/http/server.go:3454 +0x28 fp=0xc000047fe0 sp=0xc000047fb8 pc=0x60f609024a08 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc000047fe8 sp=0xc000047fe0 pc=0x60f608d2a481 ollama-1 | created by net/http.(*Server).Serve in goroutine 1 ollama-1 | net/http/server.go:3454 +0x485 ollama-1 | ollama-1 | goroutine 454 gp=0xc000602700 m=nil [IO wait]: ollama-1 | runtime.gopark(0x100000001?, 0x100000001?, 0x1?, 0x0?, 0xb?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc0014455d8 sp=0xc0014455b8 pc=0x60f608d22d4e ollama-1 | runtime.netpollblock(0x60f608d460b8?, 0x8cbbb46?, 0xf6?) ollama-1 | runtime/netpoll.go:575 +0xf7 fp=0xc001445610 sp=0xc0014455d8 pc=0x60f608ce7837 ollama-1 | internal/poll.runtime_pollWait(0x7a25134a6d98, 0x72) ollama-1 | runtime/netpoll.go:351 +0x85 fp=0xc001445630 sp=0xc001445610 pc=0x60f608d21f65 ollama-1 | internal/poll.(*pollDesc).wait(0xc0006a0100?, 0xc001966041?, 0x0) ollama-1 | internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc001445658 sp=0xc001445630 pc=0x60f608da93a7 ollama-1 | internal/poll.(*pollDesc).waitRead(...) ollama-1 | internal/poll/fd_poll_runtime.go:89 ollama-1 | internal/poll.(*FD).Read(0xc0006a0100, {0xc001966041, 0x1, 0x1}) ollama-1 | internal/poll/fd_unix.go:165 +0x27a fp=0xc0014456f0 sp=0xc001445658 pc=0x60f608daa69a ollama-1 | net.(*netFD).Read(0xc0006a0100, {0xc001966041?, 0xc001972098?, 0xc001445770?}) ollama-1 | net/fd_posix.go:55 +0x25 fp=0xc001445738 sp=0xc0014456f0 pc=0x60f608e1ede5 ollama-1 | net.(*conn).Read(0xc000598020, {0xc001966041?, 0xc0018d42c0?, 0x60f60908a060?}) ollama-1 | net/net.go:194 +0x45 fp=0xc001445780 sp=0xc001445738 pc=0x60f608e2d1a5 ollama-1 | net/http.(*connReader).backgroundRead(0xc001966030) ollama-1 | net/http/server.go:690 +0x37 fp=0xc0014457c8 sp=0xc001445780 pc=0x60f609019017 ollama-1 | net/http.(*connReader).startBackgroundRead.gowrap2() ollama-1 | net/http/server.go:686 +0x25 fp=0xc0014457e0 sp=0xc0014457c8 pc=0x60f609018f45 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc0014457e8 sp=0xc0014457e0 pc=0x60f608d2a481 ollama-1 | created by net/http.(*connReader).startBackgroundRead in goroutine 27 ollama-1 | net/http/server.go:686 +0xb6 ollama-1 | ollama-1 | rax 0x204a03f7c ollama-1 | rbx 0x7a25047b1d60 ollama-1 | rcx 0xfdf ollama-1 | rdx 0x7a2504649520 ollama-1 | rdi 0x7a2504649530 ollama-1 | rsi 0x0 ollama-1 | rbp 0x7a2442df82d0 ollama-1 | rsp 0x7a2442df82b0 ollama-1 | r8 0x1 ollama-1 | r9 0x7a24f8ed7618 ollama-1 | r10 0x0 ollama-1 | r11 0x246 ollama-1 | r12 0x7a200400e520 ollama-1 | r13 0x7a2504649530 ollama-1 | r14 0x0 ollama-1 | r15 0x7a2504002e80 ollama-1 | rip 0x7a2450624fb7 ollama-1 | rflags 0x10297 ollama-1 | cs 0x33 ollama-1 | fs 0x0 ollama-1 | gs 0x0 ollama-1 | SIGABRT: abort ollama-1 | PC=0x7a255a819b2c m=15 sigcode=18446744073709551610 ollama-1 | signal arrived during cgo execution ollama-1 | ollama-1 | goroutine 12 gp=0xc000103c00 m=15 mp=0xc000581808 [syscall]: ollama-1 | runtime.cgocall(0x60f6099ec180, 0xc000125a58) ollama-1 | runtime/cgocall.go:167 +0x4b fp=0xc000125a30 sp=0xc0001259f8 pc=0x60f608d1f8cb ollama-1 | github.com/ollama/ollama/ml/backend/ggml._Cfunc_ggml_backend_sched_graph_compute_async(0x7a2505011170, 0x7a2048004790) ollama-1 | _cgo_gotypes.go:886 +0x4a fp=0xc000125a58 sp=0xc000125a30 pc=0x60f6091594ea ollama-1 | github.com/ollama/ollama/ml/backend/ggml.(*Context).Compute.func1(...) ollama-1 | github.com/ollama/ollama/ml/backend/ggml/ggml.go:631 ollama-1 | github.com/ollama/ollama/ml/backend/ggml.(*Context).Compute(0xc000422000, {0xc00059a480, 0x1, 0x0?}) ollama-1 | github.com/ollama/ollama/ml/backend/ggml/ggml.go:631 +0x9d fp=0xc000125b00 sp=0xc000125a58 pc=0x60f6091649fd ollama-1 | github.com/ollama/ollama/model.Forward({0x60f60a0a0d30, 0xc000422000}, {0x60f60a097550, 0xc0000e96b0}, {0xc00012a400, 0x47, 0x80}, {{0x60f60a0ab988, 0xc0006ac360}, {0x0, ...}, ...}) ollama-1 | github.com/ollama/ollama/model/model.go:305 +0x2a7 fp=0xc000125be8 sp=0xc000125b00 pc=0x60f6091729c7 ollama-1 | github.com/ollama/ollama/runner/ollamarunner.(*Server).processBatch(0xc0004ec5a0) ollama-1 | github.com/ollama/ollama/runner/ollamarunner/runner.go:480 +0x4c5 fp=0xc000125f98 sp=0xc000125be8 pc=0x60f609213905 ollama-1 | github.com/ollama/ollama/runner/ollamarunner.(*Server).run(0xc0004ec5a0, {0x60f60a098a30, 0xc000690910}) ollama-1 | github.com/ollama/ollama/runner/ollamarunner/runner.go:362 +0x4e fp=0xc000125fb8 sp=0xc000125f98 pc=0x60f6092133ee ollama-1 | github.com/ollama/ollama/runner/ollamarunner.Execute.gowrap2() ollama-1 | github.com/ollama/ollama/runner/ollamarunner/runner.go:960 +0x28 fp=0xc000125fe0 sp=0xc000125fb8 pc=0x60f609218b48 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc000125fe8 sp=0xc000125fe0 pc=0x60f608d2a481 ollama-1 | created by github.com/ollama/ollama/runner/ollamarunner.Execute in goroutine 1 ollama-1 | github.com/ollama/ollama/runner/ollamarunner/runner.go:960 +0xa74 ollama-1 | ollama-1 | goroutine 1 gp=0xc000002380 m=nil [IO wait]: ollama-1 | runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc000123650 sp=0xc000123630 pc=0x60f608d22d4e ollama-1 | runtime.netpollblock(0xc0001236a0?, 0x8cbbb46?, 0xf6?) ollama-1 | runtime/netpoll.go:575 +0xf7 fp=0xc000123688 sp=0xc000123650 pc=0x60f608ce7837 ollama-1 | internal/poll.runtime_pollWait(0x7a25134a6eb0, 0x72) ollama-1 | runtime/netpoll.go:351 +0x85 fp=0xc0001236a8 sp=0xc000123688 pc=0x60f608d21f65 ollama-1 | internal/poll.(*pollDesc).wait(0xc0006a0480?, 0x900000036?, 0x0) ollama-1 | internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc0001236d0 sp=0xc0001236a8 pc=0x60f608da93a7 ollama-1 | internal/poll.(*pollDesc).waitRead(...) ollama-1 | internal/poll/fd_poll_runtime.go:89 ollama-1 | internal/poll.(*FD).Accept(0xc0006a0480) ollama-1 | internal/poll/fd_unix.go:620 +0x295 fp=0xc000123778 sp=0xc0001236d0 pc=0x60f608dae775 ollama-1 | net.(*netFD).accept(0xc0006a0480) ollama-1 | net/fd_unix.go:172 +0x29 fp=0xc000123830 sp=0xc000123778 pc=0x60f608e20d89 ollama-1 | net.(*TCPListener).accept(0xc000422880) ollama-1 | net/tcpsock_posix.go:159 +0x1b fp=0xc000123880 sp=0xc000123830 pc=0x60f608e3673b ollama-1 | net.(*TCPListener).Accept(0xc000422880) ollama-1 | net/tcpsock.go:380 +0x30 fp=0xc0001238b0 sp=0xc000123880 pc=0x60f608e355f0 ollama-1 | net/http.(*onceCloseListener).Accept(0xc0004f0360?) ollama-1 | <autogenerated>:1 +0x24 fp=0xc0001238c8 sp=0xc0001238b0 pc=0x60f60904cd44 ollama-1 | net/http.(*Server).Serve(0xc00030a000, {0x60f60a096588, 0xc000422880}) ollama-1 | net/http/server.go:3424 +0x30c fp=0xc0001239f8 sp=0xc0001238c8 pc=0x60f60902460c ollama-1 | github.com/ollama/ollama/runner/ollamarunner.Execute({0xc000034170, 0x11, 0x11}) ollama-1 | github.com/ollama/ollama/runner/ollamarunner/runner.go:984 +0xe09 fp=0xc000123d08 sp=0xc0001239f8 pc=0x60f6092188a9 ollama-1 | github.com/ollama/ollama/runner.Execute({0xc000034150?, 0x0?, 0x0?}) ollama-1 | github.com/ollama/ollama/runner/runner.go:20 +0xc9 fp=0xc000123d30 sp=0xc000123d08 pc=0x60f6092191a9 ollama-1 | github.com/ollama/ollama/cmd.NewCLI.func2(0xc0001fd200?, {0x60f609bd907b?, 0x4?, 0x60f609bd907f?}) ollama-1 | github.com/ollama/ollama/cmd/cmd.go:1583 +0x45 fp=0xc000123d58 sp=0xc000123d30 pc=0x60f60997e0e5 ollama-1 | github.com/spf13/cobra.(*Command).execute(0xc0004f4f08, {0xc0004ec360, 0x12, 0x12}) ollama-1 | github.com/spf13/cobra@v1.7.0/command.go:940 +0x85c fp=0xc000123e78 sp=0xc000123d58 pc=0x60f608e9a3dc ollama-1 | github.com/spf13/cobra.(*Command).ExecuteC(0xc0004d0908) ollama-1 | github.com/spf13/cobra@v1.7.0/command.go:1068 +0x3a5 fp=0xc000123f30 sp=0xc000123e78 pc=0x60f608e9ac25 ollama-1 | github.com/spf13/cobra.(*Command).Execute(...) ollama-1 | github.com/spf13/cobra@v1.7.0/command.go:992 ollama-1 | github.com/spf13/cobra.(*Command).ExecuteContext(...) ollama-1 | github.com/spf13/cobra@v1.7.0/command.go:985 ollama-1 | main.main() ollama-1 | github.com/ollama/ollama/main.go:12 +0x4d fp=0xc000123f50 sp=0xc000123f30 pc=0x60f60997ebcd ollama-1 | runtime.main() ollama-1 | runtime/proc.go:283 +0x29d fp=0xc000123fe0 sp=0xc000123f50 pc=0x60f608ceeebd ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc000123fe8 sp=0xc000123fe0 pc=0x60f608d2a481 ollama-1 | ollama-1 | goroutine 2 gp=0xc000002e00 m=nil [force gc (idle)]: ollama-1 | runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc000084fa8 sp=0xc000084f88 pc=0x60f608d22d4e ollama-1 | runtime.goparkunlock(...) ollama-1 | runtime/proc.go:441 ollama-1 | runtime.forcegchelper() ollama-1 | runtime/proc.go:348 +0xb8 fp=0xc000084fe0 sp=0xc000084fa8 pc=0x60f608cef1f8 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc000084fe8 sp=0xc000084fe0 pc=0x60f608d2a481 ollama-1 | created by runtime.init.7 in goroutine 1 ollama-1 | runtime/proc.go:336 +0x1a ollama-1 | ollama-1 | goroutine 3 gp=0xc000003340 m=nil [GC sweep wait]: ollama-1 | runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc000085780 sp=0xc000085760 pc=0x60f608d22d4e ollama-1 | runtime.goparkunlock(...) ollama-1 | runtime/proc.go:441 ollama-1 | runtime.bgsweep(0xc0000aa000) ollama-1 | runtime/mgcsweep.go:316 +0xdf fp=0xc0000857c8 sp=0xc000085780 pc=0x60f608cd999f ollama-1 | runtime.gcenable.gowrap1() ollama-1 | runtime/mgc.go:204 +0x25 fp=0xc0000857e0 sp=0xc0000857c8 pc=0x60f608ccdd85 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc0000857e8 sp=0xc0000857e0 pc=0x60f608d2a481 ollama-1 | created by runtime.gcenable in goroutine 1 ollama-1 | runtime/mgc.go:204 +0x66 ollama-1 | ollama-1 | goroutine 4 gp=0xc000003500 m=nil [GC scavenge wait]: ollama-1 | runtime.gopark(0x10000?, 0x60f609d9b090?, 0x0?, 0x0?, 0x0?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc000085f78 sp=0xc000085f58 pc=0x60f608d22d4e ollama-1 | runtime.goparkunlock(...) ollama-1 | runtime/proc.go:441 ollama-1 | runtime.(*scavengerState).park(0x60f60a92d9a0) ollama-1 | runtime/mgcscavenge.go:425 +0x49 fp=0xc000085fa8 sp=0xc000085f78 pc=0x60f608cd73e9 ollama-1 | runtime.bgscavenge(0xc0000aa000) ollama-1 | runtime/mgcscavenge.go:658 +0x59 fp=0xc000085fc8 sp=0xc000085fa8 pc=0x60f608cd7979 ollama-1 | runtime.gcenable.gowrap2() ollama-1 | runtime/mgc.go:205 +0x25 fp=0xc000085fe0 sp=0xc000085fc8 pc=0x60f608ccdd25 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc000085fe8 sp=0xc000085fe0 pc=0x60f608d2a481 ollama-1 | created by runtime.gcenable in goroutine 1 ollama-1 | runtime/mgc.go:205 +0xa5 ollama-1 | ollama-1 | goroutine 5 gp=0xc000003dc0 m=nil [finalizer wait]: ollama-1 | runtime.gopark(0x1b8?, 0xc000002380?, 0x1?, 0x23?, 0xc000084688?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc000084630 sp=0xc000084610 pc=0x60f608d22d4e ollama-1 | runtime.runfinq() ollama-1 | runtime/mfinal.go:196 +0x107 fp=0xc0000847e0 sp=0xc000084630 pc=0x60f608cccd47 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc0000847e8 sp=0xc0000847e0 pc=0x60f608d2a481 ollama-1 | created by runtime.createfing in goroutine 1 ollama-1 | runtime/mfinal.go:166 +0x3d ollama-1 | ollama-1 | goroutine 6 gp=0xc0001e08c0 m=nil [chan receive]: ollama-1 | runtime.gopark(0xc0001899a0?, 0xc001aa0048?, 0x60?, 0x67?, 0x60f608e079c8?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc000086718 sp=0xc0000866f8 pc=0x60f608d22d4e ollama-1 | runtime.chanrecv(0xc0000b8310, 0x0, 0x1) ollama-1 | runtime/chan.go:664 +0x445 fp=0xc000086790 sp=0xc000086718 pc=0x60f608cbe725 ollama-1 | runtime.chanrecv1(0x0?, 0x0?) ollama-1 | runtime/chan.go:506 +0x12 fp=0xc0000867b8 sp=0xc000086790 pc=0x60f608cbe2b2 ollama-1 | runtime.unique_runtime_registerUniqueMapCleanup.func2(...) ollama-1 | runtime/mgc.go:1796 ollama-1 | runtime.unique_runtime_registerUniqueMapCleanup.gowrap1() ollama-1 | runtime/mgc.go:1799 +0x2f fp=0xc0000867e0 sp=0xc0000867b8 pc=0x60f608cd0f2f ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc0000867e8 sp=0xc0000867e0 pc=0x60f608d2a481 ollama-1 | created by unique.runtime_registerUniqueMapCleanup in goroutine 1 ollama-1 | runtime/mgc.go:1794 +0x85 ollama-1 | ollama-1 | goroutine 7 gp=0xc0001e0e00 m=nil [GC worker (idle)]: ollama-1 | runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc000086f38 sp=0xc000086f18 pc=0x60f608d22d4e ollama-1 | runtime.gcBgMarkWorker(0xc0000b9730) ollama-1 | runtime/mgc.go:1423 +0xe9 fp=0xc000086fc8 sp=0xc000086f38 pc=0x60f608cd0249 ollama-1 | runtime.gcBgMarkStartWorkers.gowrap1() ollama-1 | runtime/mgc.go:1339 +0x25 fp=0xc000086fe0 sp=0xc000086fc8 pc=0x60f608cd0125 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc000086fe8 sp=0xc000086fe0 pc=0x60f608d2a481 ollama-1 | created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama-1 | runtime/mgc.go:1339 +0x105 ollama-1 | ollama-1 | goroutine 18 gp=0xc000102380 m=nil [GC worker (idle)]: ollama-1 | runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc000080738 sp=0xc000080718 pc=0x60f608d22d4e ollama-1 | runtime.gcBgMarkWorker(0xc0000b9730) ollama-1 | runtime/mgc.go:1423 +0xe9 fp=0xc0000807c8 sp=0xc000080738 pc=0x60f608cd0249 ollama-1 | runtime.gcBgMarkStartWorkers.gowrap1() ollama-1 | runtime/mgc.go:1339 +0x25 fp=0xc0000807e0 sp=0xc0000807c8 pc=0x60f608cd0125 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc0000807e8 sp=0xc0000807e0 pc=0x60f608d2a481 ollama-1 | created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama-1 | runtime/mgc.go:1339 +0x105 ollama-1 | ollama-1 | goroutine 34 gp=0xc000504000 m=nil [GC worker (idle)]: ollama-1 | runtime.gopark(0x60f60a9dc1e0?, 0x1?, 0x3f?, 0x35?, 0x0?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc00050a738 sp=0xc00050a718 pc=0x60f608d22d4e ollama-1 | runtime.gcBgMarkWorker(0xc0000b9730) ollama-1 | runtime/mgc.go:1423 +0xe9 fp=0xc00050a7c8 sp=0xc00050a738 pc=0x60f608cd0249 ollama-1 | runtime.gcBgMarkStartWorkers.gowrap1() ollama-1 | runtime/mgc.go:1339 +0x25 fp=0xc00050a7e0 sp=0xc00050a7c8 pc=0x60f608cd0125 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc00050a7e8 sp=0xc00050a7e0 pc=0x60f608d2a481 ollama-1 | created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama-1 | runtime/mgc.go:1339 +0x105 ollama-1 | ollama-1 | goroutine 8 gp=0xc0001e0fc0 m=nil [GC worker (idle)]: ollama-1 | runtime.gopark(0x60f60a9dc1e0?, 0x1?, 0x52?, 0xd6?, 0x0?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc000087738 sp=0xc000087718 pc=0x60f608d22d4e ollama-1 | runtime.gcBgMarkWorker(0xc0000b9730) ollama-1 | runtime/mgc.go:1423 +0xe9 fp=0xc0000877c8 sp=0xc000087738 pc=0x60f608cd0249 ollama-1 | runtime.gcBgMarkStartWorkers.gowrap1() ollama-1 | runtime/mgc.go:1339 +0x25 fp=0xc0000877e0 sp=0xc0000877c8 pc=0x60f608cd0125 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc0000877e8 sp=0xc0000877e0 pc=0x60f608d2a481 ollama-1 | created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama-1 | runtime/mgc.go:1339 +0x105 ollama-1 | ollama-1 | goroutine 19 gp=0xc000102540 m=nil [GC worker (idle)]: ollama-1 | runtime.gopark(0x1ca8e8b6ab9c?, 0x0?, 0x0?, 0x0?, 0x0?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc000080f38 sp=0xc000080f18 pc=0x60f608d22d4e ollama-1 | runtime.gcBgMarkWorker(0xc0000b9730) ollama-1 | runtime/mgc.go:1423 +0xe9 fp=0xc000080fc8 sp=0xc000080f38 pc=0x60f608cd0249 ollama-1 | runtime.gcBgMarkStartWorkers.gowrap1() ollama-1 | runtime/mgc.go:1339 +0x25 fp=0xc000080fe0 sp=0xc000080fc8 pc=0x60f608cd0125 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc000080fe8 sp=0xc000080fe0 pc=0x60f608d2a481 ollama-1 | created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama-1 | runtime/mgc.go:1339 +0x105 ollama-1 | ollama-1 | goroutine 35 gp=0xc0005041c0 m=nil [GC worker (idle)]: ollama-1 | runtime.gopark(0x1ca8e8b75bcd?, 0x0?, 0x0?, 0x0?, 0x0?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc00050af38 sp=0xc00050af18 pc=0x60f608d22d4e ollama-1 | runtime.gcBgMarkWorker(0xc0000b9730) ollama-1 | runtime/mgc.go:1423 +0xe9 fp=0xc00050afc8 sp=0xc00050af38 pc=0x60f608cd0249 ollama-1 | runtime.gcBgMarkStartWorkers.gowrap1() ollama-1 | runtime/mgc.go:1339 +0x25 fp=0xc00050afe0 sp=0xc00050afc8 pc=0x60f608cd0125 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc00050afe8 sp=0xc00050afe0 pc=0x60f608d2a481 ollama-1 | created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama-1 | runtime/mgc.go:1339 +0x105 ollama-1 | ollama-1 | goroutine 9 gp=0xc0001e1180 m=nil [GC worker (idle)]: ollama-1 | runtime.gopark(0x1ca8e8fee809?, 0x0?, 0x0?, 0x0?, 0x0?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc000087f38 sp=0xc000087f18 pc=0x60f608d22d4e ollama-1 | runtime.gcBgMarkWorker(0xc0000b9730) ollama-1 | runtime/mgc.go:1423 +0xe9 fp=0xc000087fc8 sp=0xc000087f38 pc=0x60f608cd0249 ollama-1 | runtime.gcBgMarkStartWorkers.gowrap1() ollama-1 | runtime/mgc.go:1339 +0x25 fp=0xc000087fe0 sp=0xc000087fc8 pc=0x60f608cd0125 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc000087fe8 sp=0xc000087fe0 pc=0x60f608d2a481 ollama-1 | created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama-1 | runtime/mgc.go:1339 +0x105 ollama-1 | ollama-1 | goroutine 20 gp=0xc000102700 m=nil [GC worker (idle)]: ollama-1 | runtime.gopark(0x1ca8e8dc93a3?, 0x1?, 0x4f?, 0x1a?, 0x0?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc000081738 sp=0xc000081718 pc=0x60f608d22d4e ollama-1 | runtime.gcBgMarkWorker(0xc0000b9730) ollama-1 | runtime/mgc.go:1423 +0xe9 fp=0xc0000817c8 sp=0xc000081738 pc=0x60f608cd0249 ollama-1 | runtime.gcBgMarkStartWorkers.gowrap1() ollama-1 | runtime/mgc.go:1339 +0x25 fp=0xc0000817e0 sp=0xc0000817c8 pc=0x60f608cd0125 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc0000817e8 sp=0xc0000817e0 pc=0x60f608d2a481 ollama-1 | created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama-1 | runtime/mgc.go:1339 +0x105 ollama-1 | ollama-1 | goroutine 36 gp=0xc000504380 m=nil [GC worker (idle)]: ollama-1 | runtime.gopark(0x1ca8e8fd3a82?, 0x3?, 0x53?, 0x96?, 0x0?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc00050b738 sp=0xc00050b718 pc=0x60f608d22d4e ollama-1 | runtime.gcBgMarkWorker(0xc0000b9730) ollama-1 | runtime/mgc.go:1423 +0xe9 fp=0xc00050b7c8 sp=0xc00050b738 pc=0x60f608cd0249 ollama-1 | runtime.gcBgMarkStartWorkers.gowrap1() ollama-1 | runtime/mgc.go:1339 +0x25 fp=0xc00050b7e0 sp=0xc00050b7c8 pc=0x60f608cd0125 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc00050b7e8 sp=0xc00050b7e0 pc=0x60f608d2a481 ollama-1 | created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama-1 | runtime/mgc.go:1339 +0x105 ollama-1 | ollama-1 | goroutine 10 gp=0xc0001e1340 m=nil [GC worker (idle)]: ollama-1 | runtime.gopark(0x1ca8e8b6da1a?, 0x0?, 0x0?, 0x0?, 0x0?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc000506738 sp=0xc000506718 pc=0x60f608d22d4e ollama-1 | runtime.gcBgMarkWorker(0xc0000b9730) ollama-1 | runtime/mgc.go:1423 +0xe9 fp=0xc0005067c8 sp=0xc000506738 pc=0x60f608cd0249 ollama-1 | runtime.gcBgMarkStartWorkers.gowrap1() ollama-1 | runtime/mgc.go:1339 +0x25 fp=0xc0005067e0 sp=0xc0005067c8 pc=0x60f608cd0125 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc0005067e8 sp=0xc0005067e0 pc=0x60f608d2a481 ollama-1 | created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama-1 | runtime/mgc.go:1339 +0x105 ollama-1 | ollama-1 | goroutine 21 gp=0xc0001028c0 m=nil [GC worker (idle)]: ollama-1 | runtime.gopark(0x60f60a9dc1e0?, 0x1?, 0xfa?, 0x2a?, 0x0?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc000081f38 sp=0xc000081f18 pc=0x60f608d22d4e ollama-1 | runtime.gcBgMarkWorker(0xc0000b9730) ollama-1 | runtime/mgc.go:1423 +0xe9 fp=0xc000081fc8 sp=0xc000081f38 pc=0x60f608cd0249 ollama-1 | runtime.gcBgMarkStartWorkers.gowrap1() ollama-1 | runtime/mgc.go:1339 +0x25 fp=0xc000081fe0 sp=0xc000081fc8 pc=0x60f608cd0125 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc000081fe8 sp=0xc000081fe0 pc=0x60f608d2a481 ollama-1 | created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama-1 | runtime/mgc.go:1339 +0x105 ollama-1 | ollama-1 | goroutine 22 gp=0xc000102a80 m=nil [GC worker (idle)]: ollama-1 | runtime.gopark(0x1ca8e8b763b2?, 0x1?, 0x5e?, 0x67?, 0x0?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc000082738 sp=0xc000082718 pc=0x60f608d22d4e ollama-1 | runtime.gcBgMarkWorker(0xc0000b9730) ollama-1 | runtime/mgc.go:1423 +0xe9 fp=0xc0000827c8 sp=0xc000082738 pc=0x60f608cd0249 ollama-1 | runtime.gcBgMarkStartWorkers.gowrap1() ollama-1 | runtime/mgc.go:1339 +0x25 fp=0xc0000827e0 sp=0xc0000827c8 pc=0x60f608cd0125 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc0000827e8 sp=0xc0000827e0 pc=0x60f608d2a481 ollama-1 | created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama-1 | runtime/mgc.go:1339 +0x105 ollama-1 | ollama-1 | goroutine 23 gp=0xc000102c40 m=nil [GC worker (idle)]: ollama-1 | runtime.gopark(0x1ca8e8dcb342?, 0x3?, 0x55?, 0x45?, 0x0?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc000082f38 sp=0xc000082f18 pc=0x60f608d22d4e ollama-1 | runtime.gcBgMarkWorker(0xc0000b9730) ollama-1 | runtime/mgc.go:1423 +0xe9 fp=0xc000082fc8 sp=0xc000082f38 pc=0x60f608cd0249 ollama-1 | runtime.gcBgMarkStartWorkers.gowrap1() ollama-1 | runtime/mgc.go:1339 +0x25 fp=0xc000082fe0 sp=0xc000082fc8 pc=0x60f608cd0125 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc000082fe8 sp=0xc000082fe0 pc=0x60f608d2a481 ollama-1 | created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama-1 | runtime/mgc.go:1339 +0x105 ollama-1 | ollama-1 | goroutine 24 gp=0xc000102e00 m=nil [GC worker (idle)]: ollama-1 | runtime.gopark(0x1ca8e9018c6b?, 0x3?, 0x19?, 0x32?, 0x0?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc000083738 sp=0xc000083718 pc=0x60f608d22d4e ollama-1 | runtime.gcBgMarkWorker(0xc0000b9730) ollama-1 | runtime/mgc.go:1423 +0xe9 fp=0xc0000837c8 sp=0xc000083738 pc=0x60f608cd0249 ollama-1 | runtime.gcBgMarkStartWorkers.gowrap1() ollama-1 | runtime/mgc.go:1339 +0x25 fp=0xc0000837e0 sp=0xc0000837c8 pc=0x60f608cd0125 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc0000837e8 sp=0xc0000837e0 pc=0x60f608d2a481 ollama-1 | created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama-1 | runtime/mgc.go:1339 +0x105 ollama-1 | ollama-1 | goroutine 25 gp=0xc000102fc0 m=nil [GC worker (idle)]: ollama-1 | runtime.gopark(0x1ca8e8dd9c39?, 0x3?, 0xc8?, 0x52?, 0x0?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc000083f38 sp=0xc000083f18 pc=0x60f608d22d4e ollama-1 | runtime.gcBgMarkWorker(0xc0000b9730) ollama-1 | runtime/mgc.go:1423 +0xe9 fp=0xc000083fc8 sp=0xc000083f38 pc=0x60f608cd0249 ollama-1 | runtime.gcBgMarkStartWorkers.gowrap1() ollama-1 | runtime/mgc.go:1339 +0x25 fp=0xc000083fe0 sp=0xc000083fc8 pc=0x60f608cd0125 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc000083fe8 sp=0xc000083fe0 pc=0x60f608d2a481 ollama-1 | created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama-1 | runtime/mgc.go:1339 +0x105 ollama-1 | ollama-1 | goroutine 26 gp=0xc000103180 m=nil [GC worker (idle)]: ollama-1 | runtime.gopark(0x1ca8e8b87b6c?, 0x3?, 0xe3?, 0xf5?, 0x0?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc00011c738 sp=0xc00011c718 pc=0x60f608d22d4e ollama-1 | runtime.gcBgMarkWorker(0xc0000b9730) ollama-1 | runtime/mgc.go:1423 +0xe9 fp=0xc00011c7c8 sp=0xc00011c738 pc=0x60f608cd0249 ollama-1 | runtime.gcBgMarkStartWorkers.gowrap1() ollama-1 | runtime/mgc.go:1339 +0x25 fp=0xc00011c7e0 sp=0xc00011c7c8 pc=0x60f608cd0125 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc00011c7e8 sp=0xc00011c7e0 pc=0x60f608d2a481 ollama-1 | created by runtime.gcBgMarkStartWorkers in goroutine 1 ollama-1 | runtime/mgc.go:1339 +0x105 ollama-1 | ollama-1 | goroutine 27 gp=0xc000582a80 m=nil [select]: ollama-1 | runtime.gopark(0xc000047a10?, 0x2?, 0x0?, 0x0?, 0xc000047874?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc0000476a0 sp=0xc000047680 pc=0x60f608d22d4e ollama-1 | runtime.selectgo(0xc000047a10, 0xc000047870, 0x47?, 0x0, 0x4?, 0x1) ollama-1 | runtime/select.go:351 +0x837 fp=0xc0000477d8 sp=0xc0000476a0 pc=0x60f608d013b7 ollama-1 | github.com/ollama/ollama/runner/ollamarunner.(*Server).completion(0xc0004ec5a0, {0x60f60a096768, 0xc0014601c0}, 0xc000432280) ollama-1 | github.com/ollama/ollama/runner/ollamarunner/runner.go:680 +0xb65 fp=0xc000047ac0 sp=0xc0000477d8 pc=0x60f609215c45 ollama-1 | github.com/ollama/ollama/runner/ollamarunner.(*Server).completion-fm({0x60f60a096768?, 0xc0014601c0?}, 0xc000121b40?) ollama-1 | <autogenerated>:1 +0x36 fp=0xc000047af0 sp=0xc000047ac0 pc=0x60f609219016 ollama-1 | net/http.HandlerFunc.ServeHTTP(0xc0004c35c0?, {0x60f60a096768?, 0xc0014601c0?}, 0xc000121b60?) ollama-1 | net/http/server.go:2294 +0x29 fp=0xc000047b18 sp=0xc000047af0 pc=0x60f609020c49 ollama-1 | net/http.(*ServeMux).ServeHTTP(0x60f608cc7265?, {0x60f60a096768, 0xc0014601c0}, 0xc000432280) ollama-1 | net/http/server.go:2822 +0x1c4 fp=0xc000047b68 sp=0xc000047b18 pc=0x60f609022b44 ollama-1 | net/http.serverHandler.ServeHTTP({0x60f60a092db0?}, {0x60f60a096768?, 0xc0014601c0?}, 0x1?) ollama-1 | net/http/server.go:3301 +0x8e fp=0xc000047b98 sp=0xc000047b68 pc=0x60f6090405ce ollama-1 | net/http.(*conn).serve(0xc0004f0360, {0x60f60a0989f8, 0xc0000ffb60}) ollama-1 | net/http/server.go:2102 +0x625 fp=0xc000047fb8 sp=0xc000047b98 pc=0x60f60901f145 ollama-1 | net/http.(*Server).Serve.gowrap3() ollama-1 | net/http/server.go:3454 +0x28 fp=0xc000047fe0 sp=0xc000047fb8 pc=0x60f609024a08 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc000047fe8 sp=0xc000047fe0 pc=0x60f608d2a481 ollama-1 | created by net/http.(*Server).Serve in goroutine 1 ollama-1 | net/http/server.go:3454 +0x485 ollama-1 | ollama-1 | goroutine 454 gp=0xc000602700 m=nil [IO wait]: ollama-1 | runtime.gopark(0x100000001?, 0x100000001?, 0x1?, 0x0?, 0xb?) ollama-1 | runtime/proc.go:435 +0xce fp=0xc0014455d8 sp=0xc0014455b8 pc=0x60f608d22d4e ollama-1 | runtime.netpollblock(0x60f608d460b8?, 0x8cbbb46?, 0xf6?) ollama-1 | runtime/netpoll.go:575 +0xf7 fp=0xc001445610 sp=0xc0014455d8 pc=0x60f608ce7837 ollama-1 | internal/poll.runtime_pollWait(0x7a25134a6d98, 0x72) ollama-1 | runtime/netpoll.go:351 +0x85 fp=0xc001445630 sp=0xc001445610 pc=0x60f608d21f65 ollama-1 | internal/poll.(*pollDesc).wait(0xc0006a0100?, 0xc001966041?, 0x0) ollama-1 | internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc001445658 sp=0xc001445630 pc=0x60f608da93a7 ollama-1 | internal/poll.(*pollDesc).waitRead(...) ollama-1 | internal/poll/fd_poll_runtime.go:89 ollama-1 | internal/poll.(*FD).Read(0xc0006a0100, {0xc001966041, 0x1, 0x1}) ollama-1 | internal/poll/fd_unix.go:165 +0x27a fp=0xc0014456f0 sp=0xc001445658 pc=0x60f608daa69a ollama-1 | net.(*netFD).Read(0xc0006a0100, {0xc001966041?, 0xc001972098?, 0xc001445770?}) ollama-1 | net/fd_posix.go:55 +0x25 fp=0xc001445738 sp=0xc0014456f0 pc=0x60f608e1ede5 ollama-1 | net.(*conn).Read(0xc000598020, {0xc001966041?, 0xc0018d42c0?, 0x60f60908a060?}) ollama-1 | net/net.go:194 +0x45 fp=0xc001445780 sp=0xc001445738 pc=0x60f608e2d1a5 ollama-1 | net/http.(*connReader).backgroundRead(0xc001966030) ollama-1 | net/http/server.go:690 +0x37 fp=0xc0014457c8 sp=0xc001445780 pc=0x60f609019017 ollama-1 | net/http.(*connReader).startBackgroundRead.gowrap2() ollama-1 | net/http/server.go:686 +0x25 fp=0xc0014457e0 sp=0xc0014457c8 pc=0x60f609018f45 ollama-1 | runtime.goexit({}) ollama-1 | runtime/asm_amd64.s:1700 +0x1 fp=0xc0014457e8 sp=0xc0014457e0 pc=0x60f608d2a481 ollama-1 | created by net/http.(*connReader).startBackgroundRead in goroutine 27 ollama-1 | net/http/server.go:686 +0xb6 ollama-1 | ollama-1 | rax 0x0 ollama-1 | rbx 0x4b ollama-1 | rcx 0x7a255a819b2c ollama-1 | rdx 0x6 ollama-1 | rdi 0x3a ollama-1 | rsi 0x4b ollama-1 | rbp 0x7a2442df8440 ollama-1 | rsp 0x7a2442df8400 ollama-1 | r8 0x0 ollama-1 | r9 0x0 ollama-1 | r10 0x8 ollama-1 | r11 0x246 ollama-1 | r12 0x6 ollama-1 | r13 0x4d ollama-1 | r14 0x16 ollama-1 | r15 0x7a25050110a8 ollama-1 | rip 0x7a255a819b2c ollama-1 | rflags 0x246 ollama-1 | cs 0x33 ollama-1 | fs 0x0 ollama-1 | gs 0x0 ollama-1 | time=2025-08-05T17:57:32.050Z level=ERROR source=server.go:807 msg="post predict" error="Post \"http://127.0.0.1:45347/completion\": EOF" ollama-1 | [GIN] 2025/08/05 - 17:57:32 | 200 | 656.432015ms | 127.0.0.1 | POST "/api/chat" ollama-1 | time=2025-08-05T17:57:32.050Z level=DEBUG source=sched.go:432 msg="context for request finished" runner.name=registry.ollama.ai/library/gpt-oss:20b runner.inference=cuda runner.devices=1 runner.size="13.8 GiB" runner.vram="13.8 GiB" runner.parallel=1 runner.pid=58 runner.model=/root/.ollama/models/blobs/sha256-b112e727c6f18875636c56a779790a590d705aec9e1c0eb5a97d51fc2a778583 runner.num_ctx=8192 ollama-1 | time=2025-08-05T17:57:32.050Z level=DEBUG source=sched.go:341 msg="runner with non-zero duration has gone idle, adding timer" runner.name=registry.ollama.ai/library/gpt-oss:20b runner.inference=cuda runner.devices=1 runner.size="13.8 GiB" runner.vram="13.8 GiB" runner.parallel=1 runner.pid=58 runner.model=/root/.ollama/models/blobs/sha256-b112e727c6f18875636c56a779790a590d705aec9e1c0eb5a97d51fc2a778583 runner.num_ctx=8192 duration=5m0s ollama-1 | time=2025-08-05T17:57:32.050Z level=DEBUG source=sched.go:359 msg="after processing request finished event" runner.name=registry.ollama.ai/library/gpt-oss:20b runner.inference=cuda runner.devices=1 runner.size="13.8 GiB" runner.vram="13.8 GiB" runner.parallel=1 runner.pid=58 runner.model=/root/.ollama/models/blobs/sha256-b112e727c6f18875636c56a779790a590d705aec9e1c0eb5a97d51fc2a778583 runner.num_ctx=8192 refCount=0 ollama-1 | time=2025-08-05T17:57:32.093Z level=ERROR source=server.go:464 msg="llama runner terminated" error="exit status 2" Gracefully stopping... (press Ctrl+C again to force) [+] Stopping 1/1 ✔ Container ollama-ollama-1 Stopped 0.2s ``` </details>
Author
Owner

@dguembel-itomig commented on GitHub (Aug 5, 2025):

I also have a crash with gpt-oss:20b, on two different machines (with different Nvidia GPUs), but both Linux and running ollama in docker.

Full log, in the hope it will be helpful. Please let me know if I can provide additional information or test anything to narrow this down.


time=2025-08-05T18:02:50.707Z level=INFO source=routes.go:1297 msg="server config" env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_CONTEXT_LENGTH:16384 OLLAMA_DEBUG:INFO OLLAMA_FLASH_ATTENTION:true OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://0.0.0.0:11434 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE:q8_0 OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/root/.ollama/models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NEW_ENGINE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:2 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://* vscode-file://*] OLLAMA_SCHED_SPREAD:false ROCR_VISIBLE_DEVICES: http_proxy: https_proxy: no_proxy:]"
time=2025-08-05T18:02:50.710Z level=INFO source=images.go:477 msg="total blobs: 88"
time=2025-08-05T18:02:50.712Z level=INFO source=images.go:484 msg="total unused blobs removed: 0"
time=2025-08-05T18:02:50.712Z level=INFO source=routes.go:1350 msg="Listening on [::]:11434 (version 0.11.0)"
time=2025-08-05T18:02:50.712Z level=INFO source=gpu.go:217 msg="looking for compatible GPUs"
time=2025-08-05T18:02:51.014Z level=INFO source=types.go:130 msg="inference compute" id=GPU-aa5c1cb5-bae0-5032-c426-49bcfd0cf7b5 library=cuda variant=v12 compute=8.9 driver=12.5 name="NVIDIA RTX 4000 SFF Ada Generation" total="19.6 GiB" available="19.4 GiB"
^[[Otime=2025-08-05T18:03:03.165Z level=INFO source=server.go:135 msg="system memory" total="62.6 GiB" free="60.4 GiB" free_swap="32.0 GiB"
time=2025-08-05T18:03:03.284Z level=INFO source=server.go:175 msg=offload library=cuda layers.requested=-1 layers.model=25 layers.offload=22 layers.split="" memory.available="[19.4 GiB]" memory.gpu_overhead="0 B" memory.required.full="21.1 GiB" memory.required.partial="19.1 GiB" memory.required.kv="486.0 MiB" memory.required.allocations="[19.1 GiB]" memory.weights.total="11.7 GiB" memory.weights.repeating="10.7 GiB" memory.weights.nonrepeating="1.1 GiB" memory.graph.full="4.0 GiB" memory.graph.partial="8.0 GiB"
time=2025-08-05T18:03:03.284Z level=INFO source=server.go:218 msg="enabling flash attention"
time=2025-08-05T18:03:03.316Z level=INFO source=server.go:438 msg="starting llama server" cmd="/usr/bin/ollama runner --ollama-engine --model /root/.ollama/models/blobs/sha256-b112e727c6f18875636c56a779790a590d705aec9e1c0eb5a97d51fc2a778583 --ctx-size 32768 --batch-size 512 --n-gpu-layers 22 --threads 6 --flash-attn --kv-cache-type q8_0 --parallel 2 --port 39363"
time=2025-08-05T18:03:03.316Z level=INFO source=sched.go:481 msg="loaded runners" count=1
time=2025-08-05T18:03:03.316Z level=INFO source=server.go:598 msg="waiting for llama runner to start responding"
time=2025-08-05T18:03:03.316Z level=INFO source=server.go:632 msg="waiting for server to become available" status="llm server not responding"
time=2025-08-05T18:03:03.326Z level=INFO source=runner.go:925 msg="starting ollama engine"
time=2025-08-05T18:03:03.327Z level=INFO source=runner.go:983 msg="Server listening on 127.0.0.1:39363"
time=2025-08-05T18:03:03.373Z level=INFO source=ggml.go:92 msg="" architecture=gptoss file_type=MXFP4 name="" description="" num_tensors=315 num_key_values=30
ggml_cuda_init: GGML_CUDA_FORCE_MMQ:    no
ggml_cuda_init: GGML_CUDA_FORCE_CUBLAS: no
ggml_cuda_init: found 1 CUDA devices:
  Device 0: NVIDIA RTX 4000 SFF Ada Generation, compute capability 8.9, VMM: yes
load_backend: loaded CUDA backend from /usr/lib/ollama/libggml-cuda.so
load_backend: loaded CPU backend from /usr/lib/ollama/libggml-cpu-alderlake.so
time=2025-08-05T18:03:03.415Z level=INFO source=ggml.go:104 msg=system CPU.0.SSE3=1 CPU.0.SSSE3=1 CPU.0.AVX=1 CPU.0.AVX_VNNI=1 CPU.0.AVX2=1 CPU.0.F16C=1 CPU.0.FMA=1 CPU.0.BMI2=1 CPU.0.LLAMAFILE=1 CPU.1.LLAMAFILE=1 CUDA.0.ARCHS=500,600,610,700,750,800,860,870,890,900,1200 CUDA.0.USE_GRAPHS=1 CUDA.0.PEER_MAX_BATCH_SIZE=128 compiler=cgo(gcc)
time=2025-08-05T18:03:03.491Z level=INFO source=ggml.go:367 msg="offloading 22 repeating layers to GPU"
time=2025-08-05T18:03:03.491Z level=INFO source=ggml.go:371 msg="offloading output layer to CPU"
time=2025-08-05T18:03:03.491Z level=INFO source=ggml.go:378 msg="offloaded 22/25 layers to GPU"
time=2025-08-05T18:03:03.491Z level=INFO source=ggml.go:381 msg="model weights" buffer=CPU size="3.0 GiB"
time=2025-08-05T18:03:03.491Z level=INFO source=ggml.go:381 msg="model weights" buffer=CUDA0 size="9.8 GiB"
time=2025-08-05T18:03:03.508Z level=INFO source=ggml.go:672 msg="compute graph" backend=CUDA0 buffer_type=CUDA0 size="8.1 GiB"
time=2025-08-05T18:03:03.508Z level=INFO source=ggml.go:672 msg="compute graph" backend=CPU buffer_type=CPU size="8.0 GiB"
time=2025-08-05T18:03:03.567Z level=INFO source=server.go:632 msg="waiting for server to become available" status="llm server loading model"
^[[Itime=2025-08-05T18:03:06.331Z level=INFO source=server.go:637 msg="llama runner started in 3.01 seconds"
//ml/backend/ggml/ggml/src/ggml-cpu/ops.cpp:965: fatal error
//ml/backend/ggml/ggml/src/ggml-cpu/ops.cpp:965: fatal error
//ml/backend/ggml/ggml/src/ggml-cpu/ops.cpp:965: fatal error
//ml/backend/ggml/ggml/src/ggml-cpu/ops.cpp:965: fatal error
//ml/backend/ggml/ggml/src/ggml-cpu/ops.cpp:965: fatal error
//ml/backend/ggml/ggml/src/ggml-cpu/ops.cpp:965: fatal error
SIGSEGV: segmentation violation
PC=0x74916e7e2817 m=7 sigcode=1 addr=0x206403f70
signal arrived during cgo execution

goroutine 14 gp=0xc000602e00 m=7 mp=0xc000580008 [syscall]:
runtime.cgocall(0x64f1880e6180, 0xc000611a58)
	runtime/cgocall.go:167 +0x4b fp=0xc000611a30 sp=0xc0006119f8 pc=0x64f1874198cb
github.com/ollama/ollama/ml/backend/ggml._Cfunc_ggml_backend_sched_graph_compute_async(0x749168fad1a0, 0x749188004790)
	_cgo_gotypes.go:886 +0x4a fp=0xc000611a58 sp=0xc000611a30 pc=0x64f1878534ea
github.com/ollama/ollama/ml/backend/ggml.(*Context).Compute.func1(...)
	github.com/ollama/ollama/ml/backend/ggml/ggml.go:631
github.com/ollama/ollama/ml/backend/ggml.(*Context).Compute(0xc000422040, {0xc000474530, 0x1, 0x0?})
	github.com/ollama/ollama/ml/backend/ggml/ggml.go:631 +0x9d fp=0xc000611b00 sp=0xc000611a58 pc=0x64f18785e9fd
github.com/ollama/ollama/model.Forward({0x64f18879ad30, 0xc000422040}, {0x64f188791550, 0xc0000f36b0}, {0xc000116400, 0x6c, 0x80}, {{0x64f1887a5988, 0xc0000115c0}, {0x0, ...}, ...})
	github.com/ollama/ollama/model/model.go:305 +0x2a7 fp=0xc000611be8 sp=0xc000611b00 pc=0x64f18786c9c7
github.com/ollama/ollama/runner/ollamarunner.(*Server).processBatch(0xc0001487e0)
	github.com/ollama/ollama/runner/ollamarunner/runner.go:480 +0x4c5 fp=0xc000611f98 sp=0xc000611be8 pc=0x64f18790d905
github.com/ollama/ollama/runner/ollamarunner.(*Server).run(0xc0001487e0, {0x64f188792a30, 0xc000383e50})
	github.com/ollama/ollama/runner/ollamarunner/runner.go:362 +0x4e fp=0xc000611fb8 sp=0xc000611f98 pc=0x64f18790d3ee
github.com/ollama/ollama/runner/ollamarunner.Execute.gowrap2()
	github.com/ollama/ollama/runner/ollamarunner/runner.go:960 +0x28 fp=0xc000611fe0 sp=0xc000611fb8 pc=0x64f187912b48
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc000611fe8 sp=0xc000611fe0 pc=0x64f187424481
created by github.com/ollama/ollama/runner/ollamarunner.Execute in goroutine 1
	github.com/ollama/ollama/runner/ollamarunner/runner.go:960 +0xa74

goroutine 1 gp=0xc000002380 m=nil [IO wait]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc000613650 sp=0xc000613630 pc=0x64f18741cd4e
runtime.netpollblock(0xc0006136a0?, 0x873b5b46?, 0xf1?)
	runtime/netpoll.go:575 +0xf7 fp=0xc000613688 sp=0xc000613650 pc=0x64f1873e1837
internal/poll.runtime_pollWait(0x7491ea01feb0, 0x72)
	runtime/netpoll.go:351 +0x85 fp=0xc0006136a8 sp=0xc000613688 pc=0x64f18741bf65
internal/poll.(*pollDesc).wait(0xc00051ab00?, 0x9003bfe3e?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc0006136d0 sp=0xc0006136a8 pc=0x64f1874a33a7
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc00051ab00)
	internal/poll/fd_unix.go:620 +0x295 fp=0xc000613778 sp=0xc0006136d0 pc=0x64f1874a8775
net.(*netFD).accept(0xc00051ab00)
	net/fd_unix.go:172 +0x29 fp=0xc000613830 sp=0xc000613778 pc=0x64f18751ad89
net.(*TCPListener).accept(0xc00012f140)
	net/tcpsock_posix.go:159 +0x1b fp=0xc000613880 sp=0xc000613830 pc=0x64f18753073b
net.(*TCPListener).Accept(0xc00012f140)
	net/tcpsock.go:380 +0x30 fp=0xc0006138b0 sp=0xc000613880 pc=0x64f18752f5f0
net/http.(*onceCloseListener).Accept(0xc0004c0510?)
	<autogenerated>:1 +0x24 fp=0xc0006138c8 sp=0xc0006138b0 pc=0x64f187746d44
net/http.(*Server).Serve(0xc000213600, {0x64f188790588, 0xc00012f140})
	net/http/server.go:3424 +0x30c fp=0xc0006139f8 sp=0xc0006138c8 pc=0x64f18771e60c
github.com/ollama/ollama/runner/ollamarunner.Execute({0xc000034170, 0x11, 0x11})
	github.com/ollama/ollama/runner/ollamarunner/runner.go:984 +0xe09 fp=0xc000613d08 sp=0xc0006139f8 pc=0x64f1879128a9
github.com/ollama/ollama/runner.Execute({0xc000034150?, 0x0?, 0x0?})
	github.com/ollama/ollama/runner/runner.go:20 +0xc9 fp=0xc000613d30 sp=0xc000613d08 pc=0x64f1879131a9
github.com/ollama/ollama/cmd.NewCLI.func2(0xc000213400?, {0x64f1882d307b?, 0x4?, 0x64f1882d307f?})
	github.com/ollama/ollama/cmd/cmd.go:1583 +0x45 fp=0xc000613d58 sp=0xc000613d30 pc=0x64f1880780e5
github.com/spf13/cobra.(*Command).execute(0xc0004c2f08, {0xc0001485a0, 0x12, 0x12})
	github.com/spf13/cobra@v1.7.0/command.go:940 +0x85c fp=0xc000613e78 sp=0xc000613d58 pc=0x64f1875943dc
github.com/spf13/cobra.(*Command).ExecuteC(0xc000177208)
	github.com/spf13/cobra@v1.7.0/command.go:1068 +0x3a5 fp=0xc000613f30 sp=0xc000613e78 pc=0x64f187594c25
github.com/spf13/cobra.(*Command).Execute(...)
	github.com/spf13/cobra@v1.7.0/command.go:992
github.com/spf13/cobra.(*Command).ExecuteContext(...)
	github.com/spf13/cobra@v1.7.0/command.go:985
main.main()
	github.com/ollama/ollama/main.go:12 +0x4d fp=0xc000613f50 sp=0xc000613f30 pc=0x64f188078bcd
runtime.main()
	runtime/proc.go:283 +0x29d fp=0xc000613fe0 sp=0xc000613f50 pc=0x64f1873e8ebd
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc000613fe8 sp=0xc000613fe0 pc=0x64f187424481

goroutine 2 gp=0xc000002e00 m=nil [force gc (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc00008cfa8 sp=0xc00008cf88 pc=0x64f18741cd4e
runtime.goparkunlock(...)
	runtime/proc.go:441
runtime.forcegchelper()
	runtime/proc.go:348 +0xb8 fp=0xc00008cfe0 sp=0xc00008cfa8 pc=0x64f1873e91f8
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc00008cfe8 sp=0xc00008cfe0 pc=0x64f187424481
created by runtime.init.7 in goroutine 1
	runtime/proc.go:336 +0x1a

goroutine 3 gp=0xc000003340 m=nil [GC sweep wait]:
runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc00008d780 sp=0xc00008d760 pc=0x64f18741cd4e
runtime.goparkunlock(...)
	runtime/proc.go:441
runtime.bgsweep(0xc0000b8000)
	runtime/mgcsweep.go:316 +0xdf fp=0xc00008d7c8 sp=0xc00008d780 pc=0x64f1873d399f
runtime.gcenable.gowrap1()
	runtime/mgc.go:204 +0x25 fp=0xc00008d7e0 sp=0xc00008d7c8 pc=0x64f1873c7d85
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc00008d7e8 sp=0xc00008d7e0 pc=0x64f187424481
created by runtime.gcenable in goroutine 1
	runtime/mgc.go:204 +0x66

goroutine 4 gp=0xc000003500 m=nil [GC scavenge wait]:
runtime.gopark(0x10000?, 0x64f188495090?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc00008df78 sp=0xc00008df58 pc=0x64f18741cd4e
runtime.goparkunlock(...)
	runtime/proc.go:441
runtime.(*scavengerState).park(0x64f1890279a0)
	runtime/mgcscavenge.go:425 +0x49 fp=0xc00008dfa8 sp=0xc00008df78 pc=0x64f1873d13e9
runtime.bgscavenge(0xc0000b8000)
	runtime/mgcscavenge.go:658 +0x59 fp=0xc00008dfc8 sp=0xc00008dfa8 pc=0x64f1873d1979
runtime.gcenable.gowrap2()
	runtime/mgc.go:205 +0x25 fp=0xc00008dfe0 sp=0xc00008dfc8 pc=0x64f1873c7d25
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc00008dfe8 sp=0xc00008dfe0 pc=0x64f187424481
created by runtime.gcenable in goroutine 1
	runtime/mgc.go:205 +0xa5

goroutine 5 gp=0xc000003dc0 m=nil [finalizer wait]:
runtime.gopark(0x1b8?, 0xc000002380?, 0x1?, 0x23?, 0xc00008c688?)
	runtime/proc.go:435 +0xce fp=0xc00008c630 sp=0xc00008c610 pc=0x64f18741cd4e
runtime.runfinq()
	runtime/mfinal.go:196 +0x107 fp=0xc00008c7e0 sp=0xc00008c630 pc=0x64f1873c6d47
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc00008c7e8 sp=0xc00008c7e0 pc=0x64f187424481
created by runtime.createfing in goroutine 1
	runtime/mfinal.go:166 +0x3d

goroutine 6 gp=0xc0001f08c0 m=nil [chan receive]:
runtime.gopark(0xc0001eda40?, 0xc001a66030?, 0x60?, 0xe7?, 0x64f1875019c8?)
	runtime/proc.go:435 +0xce fp=0xc00008e718 sp=0xc00008e6f8 pc=0x64f18741cd4e
runtime.chanrecv(0xc0000c6310, 0x0, 0x1)
	runtime/chan.go:664 +0x445 fp=0xc00008e790 sp=0xc00008e718 pc=0x64f1873b8725
runtime.chanrecv1(0x0?, 0x0?)
	runtime/chan.go:506 +0x12 fp=0xc00008e7b8 sp=0xc00008e790 pc=0x64f1873b82b2
runtime.unique_runtime_registerUniqueMapCleanup.func2(...)
	runtime/mgc.go:1796
runtime.unique_runtime_registerUniqueMapCleanup.gowrap1()
	runtime/mgc.go:1799 +0x2f fp=0xc00008e7e0 sp=0xc00008e7b8 pc=0x64f1873caf2f
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc00008e7e8 sp=0xc00008e7e0 pc=0x64f187424481
created by unique.runtime_registerUniqueMapCleanup in goroutine 1
	runtime/mgc.go:1794 +0x85

goroutine 7 gp=0xc0001f0c40 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc00008ef38 sp=0xc00008ef18 pc=0x64f18741cd4e
runtime.gcBgMarkWorker(0xc0000c7730)
	runtime/mgc.go:1423 +0xe9 fp=0xc00008efc8 sp=0xc00008ef38 pc=0x64f1873ca249
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc00008efe0 sp=0xc00008efc8 pc=0x64f1873ca125
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc00008efe8 sp=0xc00008efe0 pc=0x64f187424481
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 8 gp=0xc0001f0e00 m=nil [GC worker (idle)]:
runtime.gopark(0x54a373ed71?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc00008f738 sp=0xc00008f718 pc=0x64f18741cd4e
runtime.gcBgMarkWorker(0xc0000c7730)
	runtime/mgc.go:1423 +0xe9 fp=0xc00008f7c8 sp=0xc00008f738 pc=0x64f1873ca249
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc00008f7e0 sp=0xc00008f7c8 pc=0x64f1873ca125
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc00008f7e8 sp=0xc00008f7e0 pc=0x64f187424481
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 9 gp=0xc0001f0fc0 m=nil [GC worker (idle)]:
runtime.gopark(0x64f1890d61e0?, 0x1?, 0x4b?, 0xbc?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc00008ff38 sp=0xc00008ff18 pc=0x64f18741cd4e
runtime.gcBgMarkWorker(0xc0000c7730)
	runtime/mgc.go:1423 +0xe9 fp=0xc00008ffc8 sp=0xc00008ff38 pc=0x64f1873ca249
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc00008ffe0 sp=0xc00008ffc8 pc=0x64f1873ca125
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc00008ffe8 sp=0xc00008ffe0 pc=0x64f187424481
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 10 gp=0xc0001f1180 m=nil [GC worker (idle)]:
runtime.gopark(0x54a3736a85?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc000088738 sp=0xc000088718 pc=0x64f18741cd4e
runtime.gcBgMarkWorker(0xc0000c7730)
	runtime/mgc.go:1423 +0xe9 fp=0xc0000887c8 sp=0xc000088738 pc=0x64f1873ca249
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0000887e0 sp=0xc0000887c8 pc=0x64f1873ca125
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0000887e8 sp=0xc0000887e0 pc=0x64f187424481
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 11 gp=0xc0001f1340 m=nil [GC worker (idle)]:
runtime.gopark(0x54a37333ba?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc000088f38 sp=0xc000088f18 pc=0x64f18741cd4e
runtime.gcBgMarkWorker(0xc0000c7730)
	runtime/mgc.go:1423 +0xe9 fp=0xc000088fc8 sp=0xc000088f38 pc=0x64f1873ca249
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc000088fe0 sp=0xc000088fc8 pc=0x64f1873ca125
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc000088fe8 sp=0xc000088fe0 pc=0x64f187424481
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 18 gp=0xc000504000 m=nil [GC worker (idle)]:
runtime.gopark(0x54a372cfb6?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc00050a738 sp=0xc00050a718 pc=0x64f18741cd4e
runtime.gcBgMarkWorker(0xc0000c7730)
	runtime/mgc.go:1423 +0xe9 fp=0xc00050a7c8 sp=0xc00050a738 pc=0x64f1873ca249
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc00050a7e0 sp=0xc00050a7c8 pc=0x64f1873ca125
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc00050a7e8 sp=0xc00050a7e0 pc=0x64f187424481
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 34 gp=0xc000102380 m=nil [GC worker (idle)]:
runtime.gopark(0x54a373a049?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc000506738 sp=0xc000506718 pc=0x64f18741cd4e
runtime.gcBgMarkWorker(0xc0000c7730)
	runtime/mgc.go:1423 +0xe9 fp=0xc0005067c8 sp=0xc000506738 pc=0x64f1873ca249
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0005067e0 sp=0xc0005067c8 pc=0x64f1873ca125
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0005067e8 sp=0xc0005067e0 pc=0x64f187424481
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 35 gp=0xc000102540 m=nil [GC worker (idle)]:
runtime.gopark(0x54a375b8dd?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc000506f38 sp=0xc000506f18 pc=0x64f18741cd4e
runtime.gcBgMarkWorker(0xc0000c7730)
	runtime/mgc.go:1423 +0xe9 fp=0xc000506fc8 sp=0xc000506f38 pc=0x64f1873ca249
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc000506fe0 sp=0xc000506fc8 pc=0x64f1873ca125
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc000506fe8 sp=0xc000506fe0 pc=0x64f187424481
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 36 gp=0xc000102700 m=nil [GC worker (idle)]:
runtime.gopark(0x54a3760db1?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc000507738 sp=0xc000507718 pc=0x64f18741cd4e
runtime.gcBgMarkWorker(0xc0000c7730)
	runtime/mgc.go:1423 +0xe9 fp=0xc0005077c8 sp=0xc000507738 pc=0x64f1873ca249
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0005077e0 sp=0xc0005077c8 pc=0x64f1873ca125
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0005077e8 sp=0xc0005077e0 pc=0x64f187424481
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 37 gp=0xc0001028c0 m=nil [GC worker (idle)]:
runtime.gopark(0x64f1890d61e0?, 0x1?, 0x98?, 0x12?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc000507f38 sp=0xc000507f18 pc=0x64f18741cd4e
runtime.gcBgMarkWorker(0xc0000c7730)
	runtime/mgc.go:1423 +0xe9 fp=0xc000507fc8 sp=0xc000507f38 pc=0x64f1873ca249
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc000507fe0 sp=0xc000507fc8 pc=0x64f1873ca125
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc000507fe8 sp=0xc000507fe0 pc=0x64f187424481
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 38 gp=0xc000102a80 m=nil [GC worker (idle)]:
runtime.gopark(0x64f1890d61e0?, 0x1?, 0x50?, 0x2?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc000508738 sp=0xc000508718 pc=0x64f18741cd4e
runtime.gcBgMarkWorker(0xc0000c7730)
	runtime/mgc.go:1423 +0xe9 fp=0xc0005087c8 sp=0xc000508738 pc=0x64f1873ca249
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0005087e0 sp=0xc0005087c8 pc=0x64f1873ca125
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0005087e8 sp=0xc0005087e0 pc=0x64f187424481
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 39 gp=0xc000102c40 m=nil [GC worker (idle)]:
runtime.gopark(0x64f1890d61e0?, 0x1?, 0xf?, 0xef?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc000508f38 sp=0xc000508f18 pc=0x64f18741cd4e
runtime.gcBgMarkWorker(0xc0000c7730)
	runtime/mgc.go:1423 +0xe9 fp=0xc000508fc8 sp=0xc000508f38 pc=0x64f1873ca249
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc000508fe0 sp=0xc000508fc8 pc=0x64f1873ca125
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc000508fe8 sp=0xc000508fe0 pc=0x64f187424481
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 40 gp=0xc000102e00 m=nil [GC worker (idle)]:
runtime.gopark(0x54a372f8ff?, 0x1?, 0x24?, 0xac?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc000509738 sp=0xc000509718 pc=0x64f18741cd4e
runtime.gcBgMarkWorker(0xc0000c7730)
	runtime/mgc.go:1423 +0xe9 fp=0xc0005097c8 sp=0xc000509738 pc=0x64f1873ca249
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0005097e0 sp=0xc0005097c8 pc=0x64f1873ca125
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0005097e8 sp=0xc0005097e0 pc=0x64f187424481
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 41 gp=0xc000102fc0 m=nil [GC worker (idle)]:
runtime.gopark(0x64f1890d61e0?, 0x1?, 0xfd?, 0x40?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc000509f38 sp=0xc000509f18 pc=0x64f18741cd4e
runtime.gcBgMarkWorker(0xc0000c7730)
	runtime/mgc.go:1423 +0xe9 fp=0xc000509fc8 sp=0xc000509f38 pc=0x64f1873ca249
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc000509fe0 sp=0xc000509fc8 pc=0x64f1873ca125
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc000509fe8 sp=0xc000509fe0 pc=0x64f187424481
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 42 gp=0xc000103180 m=nil [GC worker (idle)]:
runtime.gopark(0x54a3756bd1?, 0x3?, 0x29?, 0x87?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc00011c738 sp=0xc00011c718 pc=0x64f18741cd4e
runtime.gcBgMarkWorker(0xc0000c7730)
	runtime/mgc.go:1423 +0xe9 fp=0xc00011c7c8 sp=0xc00011c738 pc=0x64f1873ca249
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc00011c7e0 sp=0xc00011c7c8 pc=0x64f1873ca125
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc00011c7e8 sp=0xc00011c7e0 pc=0x64f187424481
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 43 gp=0xc000103340 m=nil [GC worker (idle)]:
runtime.gopark(0x54a373dcdc?, 0x1?, 0x26?, 0xbe?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc00011cf38 sp=0xc00011cf18 pc=0x64f18741cd4e
runtime.gcBgMarkWorker(0xc0000c7730)
	runtime/mgc.go:1423 +0xe9 fp=0xc00011cfc8 sp=0xc00011cf38 pc=0x64f1873ca249
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc00011cfe0 sp=0xc00011cfc8 pc=0x64f1873ca125
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc00011cfe8 sp=0xc00011cfe0 pc=0x64f187424481
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 44 gp=0xc000103500 m=nil [GC worker (idle)]:
runtime.gopark(0x54a39880fb?, 0x1?, 0xda?, 0xbc?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc00011d738 sp=0xc00011d718 pc=0x64f18741cd4e
runtime.gcBgMarkWorker(0xc0000c7730)
	runtime/mgc.go:1423 +0xe9 fp=0xc00011d7c8 sp=0xc00011d738 pc=0x64f1873ca249
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc00011d7e0 sp=0xc00011d7c8 pc=0x64f1873ca125
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc00011d7e8 sp=0xc00011d7e0 pc=0x64f187424481
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 12 gp=0xc0001f1500 m=nil [GC worker (idle)]:
runtime.gopark(0x54a37318de?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc000089738 sp=0xc000089718 pc=0x64f18741cd4e
runtime.gcBgMarkWorker(0xc0000c7730)
	runtime/mgc.go:1423 +0xe9 fp=0xc0000897c8 sp=0xc000089738 pc=0x64f1873ca249
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0000897e0 sp=0xc0000897c8 pc=0x64f1873ca125
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0000897e8 sp=0xc0000897e0 pc=0x64f187424481
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 19 gp=0xc0005041c0 m=nil [GC worker (idle)]:
runtime.gopark(0x54a3718a67?, 0x1?, 0x8d?, 0xe4?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc00050af38 sp=0xc00050af18 pc=0x64f18741cd4e
runtime.gcBgMarkWorker(0xc0000c7730)
	runtime/mgc.go:1423 +0xe9 fp=0xc00050afc8 sp=0xc00050af38 pc=0x64f1873ca249
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc00050afe0 sp=0xc00050afc8 pc=0x64f1873ca125
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc00050afe8 sp=0xc00050afe0 pc=0x64f187424481
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 20 gp=0xc000504380 m=nil [GC worker (idle)]:
runtime.gopark(0x54a3767ede?, 0x3?, 0xdf?, 0x2b?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc00050b738 sp=0xc00050b718 pc=0x64f18741cd4e
runtime.gcBgMarkWorker(0xc0000c7730)
	runtime/mgc.go:1423 +0xe9 fp=0xc00050b7c8 sp=0xc00050b738 pc=0x64f1873ca249
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc00050b7e0 sp=0xc00050b7c8 pc=0x64f1873ca125
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc00050b7e8 sp=0xc00050b7e0 pc=0x64f187424481
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 436 gp=0xc000505a40 m=nil [IO wait]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0xb?)
	runtime/proc.go:435 +0xce fp=0xc001ab75d8 sp=0xc001ab75b8 pc=0x64f18741cd4e
runtime.netpollblock(0x64f1874400b8?, 0x873b5b46?, 0xf1?)
	runtime/netpoll.go:575 +0xf7 fp=0xc001ab7610 sp=0xc001ab75d8 pc=0x64f1873e1837
internal/poll.runtime_pollWait(0x7491ea01fc80, 0x72)
	runtime/netpoll.go:351 +0x85 fp=0xc001ab7630 sp=0xc001ab7610 pc=0x64f18741bf65
internal/poll.(*pollDesc).wait(0xc00051a000?, 0xc001b46041?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc001ab7658 sp=0xc001ab7630 pc=0x64f1874a33a7
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc00051a000, {0xc001b46041, 0x1, 0x1})
	internal/poll/fd_unix.go:165 +0x27a fp=0xc001ab76f0 sp=0xc001ab7658 pc=0x64f1874a469a
net.(*netFD).Read(0xc00051a000, {0xc001b46041?, 0x0?, 0xc00187ab38?})
	net/fd_posix.go:55 +0x25 fp=0xc001ab7738 sp=0xc001ab76f0 pc=0x64f187518de5
net.(*conn).Read(0xc001da0000, {0xc001b46041?, 0xc0019d8540?, 0x64f187784060?})
	net/net.go:194 +0x45 fp=0xc001ab7780 sp=0xc001ab7738 pc=0x64f1875271a5
net/http.(*connReader).backgroundRead(0xc001b46030)
	net/http/server.go:690 +0x37 fp=0xc001ab77c8 sp=0xc001ab7780 pc=0x64f187713017
net/http.(*connReader).startBackgroundRead.gowrap2()
	net/http/server.go:686 +0x25 fp=0xc001ab77e0 sp=0xc001ab77c8 pc=0x64f187712f45
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc001ab77e8 sp=0xc001ab77e0 pc=0x64f187424481
created by net/http.(*connReader).startBackgroundRead in goroutine 290
	net/http/server.go:686 +0xb6

goroutine 290 gp=0xc002442540 m=nil [select]:
runtime.gopark(0xc000047a10?, 0x2?, 0x10?, 0x93?, 0xc000047874?)
	runtime/proc.go:435 +0xce fp=0xc0000476a0 sp=0xc000047680 pc=0x64f18741cd4e
runtime.selectgo(0xc000047a10, 0xc000047870, 0x6c?, 0x0, 0x4?, 0x1)
	runtime/select.go:351 +0x837 fp=0xc0000477d8 sp=0xc0000476a0 pc=0x64f1873fb3b7
github.com/ollama/ollama/runner/ollamarunner.(*Server).completion(0xc0001487e0, {0x64f188790768, 0xc001e5e000}, 0xc001e52000)
	github.com/ollama/ollama/runner/ollamarunner/runner.go:680 +0xb65 fp=0xc000047ac0 sp=0xc0000477d8 pc=0x64f18790fc45
github.com/ollama/ollama/runner/ollamarunner.(*Server).completion-fm({0x64f188790768?, 0xc001e5e000?}, 0xc000617b40?)
	<autogenerated>:1 +0x36 fp=0xc000047af0 sp=0xc000047ac0 pc=0x64f187913016
net/http.HandlerFunc.ServeHTTP(0xc000157440?, {0x64f188790768?, 0xc001e5e000?}, 0xc000617b60?)
	net/http/server.go:2294 +0x29 fp=0xc000047b18 sp=0xc000047af0 pc=0x64f18771ac49
net/http.(*ServeMux).ServeHTTP(0x64f1873c1265?, {0x64f188790768, 0xc001e5e000}, 0xc001e52000)
	net/http/server.go:2822 +0x1c4 fp=0xc000047b68 sp=0xc000047b18 pc=0x64f18771cb44
net/http.serverHandler.ServeHTTP({0x64f18878cdb0?}, {0x64f188790768?, 0xc001e5e000?}, 0x1?)
	net/http/server.go:3301 +0x8e fp=0xc000047b98 sp=0xc000047b68 pc=0x64f18773a5ce
net/http.(*conn).serve(0xc0004c0510, {0x64f1887929f8, 0xc0004d6450})
	net/http/server.go:2102 +0x625 fp=0xc000047fb8 sp=0xc000047b98 pc=0x64f187719145
net/http.(*Server).Serve.gowrap3()
	net/http/server.go:3454 +0x28 fp=0xc000047fe0 sp=0xc000047fb8 pc=0x64f18771ea08
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc000047fe8 sp=0xc000047fe0 pc=0x64f187424481
created by net/http.(*Server).Serve in goroutine 1
	net/http/server.go:3454 +0x485

rax    0x206403f70
rbx    0x7491687b24f0
rcx    0xfdc
rdx    0x7491686494c0
rdi    0x7491686494d0
rsi    0x0
rbp    0x7491a15fa2c0
rsp    0x7491a15fa2a0
r8     0x0
r9     0x0
r10    0x0
r11    0x246
r12    0x7488e4002c70
r13    0x7491686494d0
r14    0x0
r15    0x749168002d80
rip    0x74916e7e2817
rflags 0x10297
cs     0x33
fs     0x0
gs     0x0
SIGABRT: abort
PC=0x7491ea28cb2c m=7 sigcode=18446744073709551610
signal arrived during cgo execution

goroutine 14 gp=0xc000602e00 m=7 mp=0xc000580008 [syscall]:
runtime.cgocall(0x64f1880e6180, 0xc000611a58)
	runtime/cgocall.go:167 +0x4b fp=0xc000611a30 sp=0xc0006119f8 pc=0x64f1874198cb
github.com/ollama/ollama/ml/backend/ggml._Cfunc_ggml_backend_sched_graph_compute_async(0x749168fad1a0, 0x749188004790)
	_cgo_gotypes.go:886 +0x4a fp=0xc000611a58 sp=0xc000611a30 pc=0x64f1878534ea
github.com/ollama/ollama/ml/backend/ggml.(*Context).Compute.func1(...)
	github.com/ollama/ollama/ml/backend/ggml/ggml.go:631
github.com/ollama/ollama/ml/backend/ggml.(*Context).Compute(0xc000422040, {0xc000474530, 0x1, 0x0?})
	github.com/ollama/ollama/ml/backend/ggml/ggml.go:631 +0x9d fp=0xc000611b00 sp=0xc000611a58 pc=0x64f18785e9fd
github.com/ollama/ollama/model.Forward({0x64f18879ad30, 0xc000422040}, {0x64f188791550, 0xc0000f36b0}, {0xc000116400, 0x6c, 0x80}, {{0x64f1887a5988, 0xc0000115c0}, {0x0, ...}, ...})
	github.com/ollama/ollama/model/model.go:305 +0x2a7 fp=0xc000611be8 sp=0xc000611b00 pc=0x64f18786c9c7
github.com/ollama/ollama/runner/ollamarunner.(*Server).processBatch(0xc0001487e0)
	github.com/ollama/ollama/runner/ollamarunner/runner.go:480 +0x4c5 fp=0xc000611f98 sp=0xc000611be8 pc=0x64f18790d905
github.com/ollama/ollama/runner/ollamarunner.(*Server).run(0xc0001487e0, {0x64f188792a30, 0xc000383e50})
	github.com/ollama/ollama/runner/ollamarunner/runner.go:362 +0x4e fp=0xc000611fb8 sp=0xc000611f98 pc=0x64f18790d3ee
github.com/ollama/ollama/runner/ollamarunner.Execute.gowrap2()
	github.com/ollama/ollama/runner/ollamarunner/runner.go:960 +0x28 fp=0xc000611fe0 sp=0xc000611fb8 pc=0x64f187912b48
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc000611fe8 sp=0xc000611fe0 pc=0x64f187424481
created by github.com/ollama/ollama/runner/ollamarunner.Execute in goroutine 1
	github.com/ollama/ollama/runner/ollamarunner/runner.go:960 +0xa74

goroutine 1 gp=0xc000002380 m=nil [IO wait]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc000613650 sp=0xc000613630 pc=0x64f18741cd4e
runtime.netpollblock(0xc0006136a0?, 0x873b5b46?, 0xf1?)
	runtime/netpoll.go:575 +0xf7 fp=0xc000613688 sp=0xc000613650 pc=0x64f1873e1837
internal/poll.runtime_pollWait(0x7491ea01feb0, 0x72)
	runtime/netpoll.go:351 +0x85 fp=0xc0006136a8 sp=0xc000613688 pc=0x64f18741bf65
internal/poll.(*pollDesc).wait(0xc00051ab00?, 0x9003bfe3e?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc0006136d0 sp=0xc0006136a8 pc=0x64f1874a33a7
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc00051ab00)
	internal/poll/fd_unix.go:620 +0x295 fp=0xc000613778 sp=0xc0006136d0 pc=0x64f1874a8775
net.(*netFD).accept(0xc00051ab00)
	net/fd_unix.go:172 +0x29 fp=0xc000613830 sp=0xc000613778 pc=0x64f18751ad89
net.(*TCPListener).accept(0xc00012f140)
	net/tcpsock_posix.go:159 +0x1b fp=0xc000613880 sp=0xc000613830 pc=0x64f18753073b
net.(*TCPListener).Accept(0xc00012f140)
	net/tcpsock.go:380 +0x30 fp=0xc0006138b0 sp=0xc000613880 pc=0x64f18752f5f0
net/http.(*onceCloseListener).Accept(0xc0004c0510?)
	<autogenerated>:1 +0x24 fp=0xc0006138c8 sp=0xc0006138b0 pc=0x64f187746d44
net/http.(*Server).Serve(0xc000213600, {0x64f188790588, 0xc00012f140})
	net/http/server.go:3424 +0x30c fp=0xc0006139f8 sp=0xc0006138c8 pc=0x64f18771e60c
github.com/ollama/ollama/runner/ollamarunner.Execute({0xc000034170, 0x11, 0x11})
	github.com/ollama/ollama/runner/ollamarunner/runner.go:984 +0xe09 fp=0xc000613d08 sp=0xc0006139f8 pc=0x64f1879128a9
github.com/ollama/ollama/runner.Execute({0xc000034150?, 0x0?, 0x0?})
	github.com/ollama/ollama/runner/runner.go:20 +0xc9 fp=0xc000613d30 sp=0xc000613d08 pc=0x64f1879131a9
github.com/ollama/ollama/cmd.NewCLI.func2(0xc000213400?, {0x64f1882d307b?, 0x4?, 0x64f1882d307f?})
	github.com/ollama/ollama/cmd/cmd.go:1583 +0x45 fp=0xc000613d58 sp=0xc000613d30 pc=0x64f1880780e5
github.com/spf13/cobra.(*Command).execute(0xc0004c2f08, {0xc0001485a0, 0x12, 0x12})
	github.com/spf13/cobra@v1.7.0/command.go:940 +0x85c fp=0xc000613e78 sp=0xc000613d58 pc=0x64f1875943dc
github.com/spf13/cobra.(*Command).ExecuteC(0xc000177208)
	github.com/spf13/cobra@v1.7.0/command.go:1068 +0x3a5 fp=0xc000613f30 sp=0xc000613e78 pc=0x64f187594c25
github.com/spf13/cobra.(*Command).Execute(...)
	github.com/spf13/cobra@v1.7.0/command.go:992
github.com/spf13/cobra.(*Command).ExecuteContext(...)
	github.com/spf13/cobra@v1.7.0/command.go:985
main.main()
	github.com/ollama/ollama/main.go:12 +0x4d fp=0xc000613f50 sp=0xc000613f30 pc=0x64f188078bcd
runtime.main()
	runtime/proc.go:283 +0x29d fp=0xc000613fe0 sp=0xc000613f50 pc=0x64f1873e8ebd
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc000613fe8 sp=0xc000613fe0 pc=0x64f187424481

goroutine 2 gp=0xc000002e00 m=nil [force gc (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc00008cfa8 sp=0xc00008cf88 pc=0x64f18741cd4e
runtime.goparkunlock(...)
	runtime/proc.go:441
runtime.forcegchelper()
	runtime/proc.go:348 +0xb8 fp=0xc00008cfe0 sp=0xc00008cfa8 pc=0x64f1873e91f8
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc00008cfe8 sp=0xc00008cfe0 pc=0x64f187424481
created by runtime.init.7 in goroutine 1
	runtime/proc.go:336 +0x1a

goroutine 3 gp=0xc000003340 m=nil [GC sweep wait]:
runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc00008d780 sp=0xc00008d760 pc=0x64f18741cd4e
runtime.goparkunlock(...)
	runtime/proc.go:441
runtime.bgsweep(0xc0000b8000)
	runtime/mgcsweep.go:316 +0xdf fp=0xc00008d7c8 sp=0xc00008d780 pc=0x64f1873d399f
runtime.gcenable.gowrap1()
	runtime/mgc.go:204 +0x25 fp=0xc00008d7e0 sp=0xc00008d7c8 pc=0x64f1873c7d85
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc00008d7e8 sp=0xc00008d7e0 pc=0x64f187424481
created by runtime.gcenable in goroutine 1
	runtime/mgc.go:204 +0x66

goroutine 4 gp=0xc000003500 m=nil [GC scavenge wait]:
runtime.gopark(0x10000?, 0x64f188495090?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc00008df78 sp=0xc00008df58 pc=0x64f18741cd4e
runtime.goparkunlock(...)
	runtime/proc.go:441
runtime.(*scavengerState).park(0x64f1890279a0)
	runtime/mgcscavenge.go:425 +0x49 fp=0xc00008dfa8 sp=0xc00008df78 pc=0x64f1873d13e9
runtime.bgscavenge(0xc0000b8000)
	runtime/mgcscavenge.go:658 +0x59 fp=0xc00008dfc8 sp=0xc00008dfa8 pc=0x64f1873d1979
runtime.gcenable.gowrap2()
	runtime/mgc.go:205 +0x25 fp=0xc00008dfe0 sp=0xc00008dfc8 pc=0x64f1873c7d25
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc00008dfe8 sp=0xc00008dfe0 pc=0x64f187424481
created by runtime.gcenable in goroutine 1
	runtime/mgc.go:205 +0xa5

goroutine 5 gp=0xc000003dc0 m=nil [finalizer wait]:
runtime.gopark(0x1b8?, 0xc000002380?, 0x1?, 0x23?, 0xc00008c688?)
	runtime/proc.go:435 +0xce fp=0xc00008c630 sp=0xc00008c610 pc=0x64f18741cd4e
runtime.runfinq()
	runtime/mfinal.go:196 +0x107 fp=0xc00008c7e0 sp=0xc00008c630 pc=0x64f1873c6d47
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc00008c7e8 sp=0xc00008c7e0 pc=0x64f187424481
created by runtime.createfing in goroutine 1
	runtime/mfinal.go:166 +0x3d

goroutine 6 gp=0xc0001f08c0 m=nil [chan receive]:
runtime.gopark(0xc0001eda40?, 0xc001a66030?, 0x60?, 0xe7?, 0x64f1875019c8?)
	runtime/proc.go:435 +0xce fp=0xc00008e718 sp=0xc00008e6f8 pc=0x64f18741cd4e
runtime.chanrecv(0xc0000c6310, 0x0, 0x1)
	runtime/chan.go:664 +0x445 fp=0xc00008e790 sp=0xc00008e718 pc=0x64f1873b8725
runtime.chanrecv1(0x0?, 0x0?)
	runtime/chan.go:506 +0x12 fp=0xc00008e7b8 sp=0xc00008e790 pc=0x64f1873b82b2
runtime.unique_runtime_registerUniqueMapCleanup.func2(...)
	runtime/mgc.go:1796
runtime.unique_runtime_registerUniqueMapCleanup.gowrap1()
	runtime/mgc.go:1799 +0x2f fp=0xc00008e7e0 sp=0xc00008e7b8 pc=0x64f1873caf2f
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc00008e7e8 sp=0xc00008e7e0 pc=0x64f187424481
created by unique.runtime_registerUniqueMapCleanup in goroutine 1
	runtime/mgc.go:1794 +0x85

goroutine 7 gp=0xc0001f0c40 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc00008ef38 sp=0xc00008ef18 pc=0x64f18741cd4e
runtime.gcBgMarkWorker(0xc0000c7730)
	runtime/mgc.go:1423 +0xe9 fp=0xc00008efc8 sp=0xc00008ef38 pc=0x64f1873ca249
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc00008efe0 sp=0xc00008efc8 pc=0x64f1873ca125
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc00008efe8 sp=0xc00008efe0 pc=0x64f187424481
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 8 gp=0xc0001f0e00 m=nil [GC worker (idle)]:
runtime.gopark(0x54a373ed71?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc00008f738 sp=0xc00008f718 pc=0x64f18741cd4e
runtime.gcBgMarkWorker(0xc0000c7730)
	runtime/mgc.go:1423 +0xe9 fp=0xc00008f7c8 sp=0xc00008f738 pc=0x64f1873ca249
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc00008f7e0 sp=0xc00008f7c8 pc=0x64f1873ca125
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc00008f7e8 sp=0xc00008f7e0 pc=0x64f187424481
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 9 gp=0xc0001f0fc0 m=nil [GC worker (idle)]:
runtime.gopark(0x64f1890d61e0?, 0x1?, 0x4b?, 0xbc?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc00008ff38 sp=0xc00008ff18 pc=0x64f18741cd4e
runtime.gcBgMarkWorker(0xc0000c7730)
	runtime/mgc.go:1423 +0xe9 fp=0xc00008ffc8 sp=0xc00008ff38 pc=0x64f1873ca249
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc00008ffe0 sp=0xc00008ffc8 pc=0x64f1873ca125
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc00008ffe8 sp=0xc00008ffe0 pc=0x64f187424481
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 10 gp=0xc0001f1180 m=nil [GC worker (idle)]:
runtime.gopark(0x54a3736a85?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc000088738 sp=0xc000088718 pc=0x64f18741cd4e
runtime.gcBgMarkWorker(0xc0000c7730)
	runtime/mgc.go:1423 +0xe9 fp=0xc0000887c8 sp=0xc000088738 pc=0x64f1873ca249
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0000887e0 sp=0xc0000887c8 pc=0x64f1873ca125
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0000887e8 sp=0xc0000887e0 pc=0x64f187424481
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 11 gp=0xc0001f1340 m=nil [GC worker (idle)]:
runtime.gopark(0x54a37333ba?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc000088f38 sp=0xc000088f18 pc=0x64f18741cd4e
runtime.gcBgMarkWorker(0xc0000c7730)
	runtime/mgc.go:1423 +0xe9 fp=0xc000088fc8 sp=0xc000088f38 pc=0x64f1873ca249
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc000088fe0 sp=0xc000088fc8 pc=0x64f1873ca125
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc000088fe8 sp=0xc000088fe0 pc=0x64f187424481
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 18 gp=0xc000504000 m=nil [GC worker (idle)]:
runtime.gopark(0x54a372cfb6?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc00050a738 sp=0xc00050a718 pc=0x64f18741cd4e
runtime.gcBgMarkWorker(0xc0000c7730)
	runtime/mgc.go:1423 +0xe9 fp=0xc00050a7c8 sp=0xc00050a738 pc=0x64f1873ca249
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc00050a7e0 sp=0xc00050a7c8 pc=0x64f1873ca125
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc00050a7e8 sp=0xc00050a7e0 pc=0x64f187424481
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 34 gp=0xc000102380 m=nil [GC worker (idle)]:
runtime.gopark(0x54a373a049?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc000506738 sp=0xc000506718 pc=0x64f18741cd4e
runtime.gcBgMarkWorker(0xc0000c7730)
	runtime/mgc.go:1423 +0xe9 fp=0xc0005067c8 sp=0xc000506738 pc=0x64f1873ca249
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0005067e0 sp=0xc0005067c8 pc=0x64f1873ca125
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0005067e8 sp=0xc0005067e0 pc=0x64f187424481
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 35 gp=0xc000102540 m=nil [GC worker (idle)]:
runtime.gopark(0x54a375b8dd?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc000506f38 sp=0xc000506f18 pc=0x64f18741cd4e
runtime.gcBgMarkWorker(0xc0000c7730)
	runtime/mgc.go:1423 +0xe9 fp=0xc000506fc8 sp=0xc000506f38 pc=0x64f1873ca249
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc000506fe0 sp=0xc000506fc8 pc=0x64f1873ca125
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc000506fe8 sp=0xc000506fe0 pc=0x64f187424481
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 36 gp=0xc000102700 m=nil [GC worker (idle)]:
runtime.gopark(0x54a3760db1?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc000507738 sp=0xc000507718 pc=0x64f18741cd4e
runtime.gcBgMarkWorker(0xc0000c7730)
	runtime/mgc.go:1423 +0xe9 fp=0xc0005077c8 sp=0xc000507738 pc=0x64f1873ca249
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0005077e0 sp=0xc0005077c8 pc=0x64f1873ca125
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0005077e8 sp=0xc0005077e0 pc=0x64f187424481
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 37 gp=0xc0001028c0 m=nil [GC worker (idle)]:
runtime.gopark(0x64f1890d61e0?, 0x1?, 0x98?, 0x12?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc000507f38 sp=0xc000507f18 pc=0x64f18741cd4e
runtime.gcBgMarkWorker(0xc0000c7730)
	runtime/mgc.go:1423 +0xe9 fp=0xc000507fc8 sp=0xc000507f38 pc=0x64f1873ca249
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc000507fe0 sp=0xc000507fc8 pc=0x64f1873ca125
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc000507fe8 sp=0xc000507fe0 pc=0x64f187424481
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 38 gp=0xc000102a80 m=nil [GC worker (idle)]:
runtime.gopark(0x64f1890d61e0?, 0x1?, 0x50?, 0x2?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc000508738 sp=0xc000508718 pc=0x64f18741cd4e
runtime.gcBgMarkWorker(0xc0000c7730)
	runtime/mgc.go:1423 +0xe9 fp=0xc0005087c8 sp=0xc000508738 pc=0x64f1873ca249
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0005087e0 sp=0xc0005087c8 pc=0x64f1873ca125
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0005087e8 sp=0xc0005087e0 pc=0x64f187424481
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 39 gp=0xc000102c40 m=nil [GC worker (idle)]:
runtime.gopark(0x64f1890d61e0?, 0x1?, 0xf?, 0xef?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc000508f38 sp=0xc000508f18 pc=0x64f18741cd4e
runtime.gcBgMarkWorker(0xc0000c7730)
	runtime/mgc.go:1423 +0xe9 fp=0xc000508fc8 sp=0xc000508f38 pc=0x64f1873ca249
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc000508fe0 sp=0xc000508fc8 pc=0x64f1873ca125
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc000508fe8 sp=0xc000508fe0 pc=0x64f187424481
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 40 gp=0xc000102e00 m=nil [GC worker (idle)]:
runtime.gopark(0x54a372f8ff?, 0x1?, 0x24?, 0xac?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc000509738 sp=0xc000509718 pc=0x64f18741cd4e
runtime.gcBgMarkWorker(0xc0000c7730)
	runtime/mgc.go:1423 +0xe9 fp=0xc0005097c8 sp=0xc000509738 pc=0x64f1873ca249
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0005097e0 sp=0xc0005097c8 pc=0x64f1873ca125
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0005097e8 sp=0xc0005097e0 pc=0x64f187424481
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 41 gp=0xc000102fc0 m=nil [GC worker (idle)]:
runtime.gopark(0x64f1890d61e0?, 0x1?, 0xfd?, 0x40?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc000509f38 sp=0xc000509f18 pc=0x64f18741cd4e
runtime.gcBgMarkWorker(0xc0000c7730)
	runtime/mgc.go:1423 +0xe9 fp=0xc000509fc8 sp=0xc000509f38 pc=0x64f1873ca249
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc000509fe0 sp=0xc000509fc8 pc=0x64f1873ca125
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc000509fe8 sp=0xc000509fe0 pc=0x64f187424481
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 42 gp=0xc000103180 m=nil [GC worker (idle)]:
runtime.gopark(0x54a3756bd1?, 0x3?, 0x29?, 0x87?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc00011c738 sp=0xc00011c718 pc=0x64f18741cd4e
runtime.gcBgMarkWorker(0xc0000c7730)
	runtime/mgc.go:1423 +0xe9 fp=0xc00011c7c8 sp=0xc00011c738 pc=0x64f1873ca249
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc00011c7e0 sp=0xc00011c7c8 pc=0x64f1873ca125
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc00011c7e8 sp=0xc00011c7e0 pc=0x64f187424481
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 43 gp=0xc000103340 m=nil [GC worker (idle)]:
runtime.gopark(0x54a373dcdc?, 0x1?, 0x26?, 0xbe?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc00011cf38 sp=0xc00011cf18 pc=0x64f18741cd4e
runtime.gcBgMarkWorker(0xc0000c7730)
	runtime/mgc.go:1423 +0xe9 fp=0xc00011cfc8 sp=0xc00011cf38 pc=0x64f1873ca249
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc00011cfe0 sp=0xc00011cfc8 pc=0x64f1873ca125
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc00011cfe8 sp=0xc00011cfe0 pc=0x64f187424481
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 44 gp=0xc000103500 m=nil [GC worker (idle)]:
runtime.gopark(0x54a39880fb?, 0x1?, 0xda?, 0xbc?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc00011d738 sp=0xc00011d718 pc=0x64f18741cd4e
runtime.gcBgMarkWorker(0xc0000c7730)
	runtime/mgc.go:1423 +0xe9 fp=0xc00011d7c8 sp=0xc00011d738 pc=0x64f1873ca249
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc00011d7e0 sp=0xc00011d7c8 pc=0x64f1873ca125
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc00011d7e8 sp=0xc00011d7e0 pc=0x64f187424481
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 12 gp=0xc0001f1500 m=nil [GC worker (idle)]:
runtime.gopark(0x54a37318de?, 0x0?, 0x0?, 0x0?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc000089738 sp=0xc000089718 pc=0x64f18741cd4e
runtime.gcBgMarkWorker(0xc0000c7730)
	runtime/mgc.go:1423 +0xe9 fp=0xc0000897c8 sp=0xc000089738 pc=0x64f1873ca249
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc0000897e0 sp=0xc0000897c8 pc=0x64f1873ca125
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc0000897e8 sp=0xc0000897e0 pc=0x64f187424481
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 19 gp=0xc0005041c0 m=nil [GC worker (idle)]:
runtime.gopark(0x54a3718a67?, 0x1?, 0x8d?, 0xe4?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc00050af38 sp=0xc00050af18 pc=0x64f18741cd4e
runtime.gcBgMarkWorker(0xc0000c7730)
	runtime/mgc.go:1423 +0xe9 fp=0xc00050afc8 sp=0xc00050af38 pc=0x64f1873ca249
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc00050afe0 sp=0xc00050afc8 pc=0x64f1873ca125
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc00050afe8 sp=0xc00050afe0 pc=0x64f187424481
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 20 gp=0xc000504380 m=nil [GC worker (idle)]:
runtime.gopark(0x54a3767ede?, 0x3?, 0xdf?, 0x2b?, 0x0?)
	runtime/proc.go:435 +0xce fp=0xc00050b738 sp=0xc00050b718 pc=0x64f18741cd4e
runtime.gcBgMarkWorker(0xc0000c7730)
	runtime/mgc.go:1423 +0xe9 fp=0xc00050b7c8 sp=0xc00050b738 pc=0x64f1873ca249
runtime.gcBgMarkStartWorkers.gowrap1()
	runtime/mgc.go:1339 +0x25 fp=0xc00050b7e0 sp=0xc00050b7c8 pc=0x64f1873ca125
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc00050b7e8 sp=0xc00050b7e0 pc=0x64f187424481
created by runtime.gcBgMarkStartWorkers in goroutine 1
	runtime/mgc.go:1339 +0x105

goroutine 436 gp=0xc000505a40 m=nil [IO wait]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0xb?)
	runtime/proc.go:435 +0xce fp=0xc001ab75d8 sp=0xc001ab75b8 pc=0x64f18741cd4e
runtime.netpollblock(0x64f1874400b8?, 0x873b5b46?, 0xf1?)
	runtime/netpoll.go:575 +0xf7 fp=0xc001ab7610 sp=0xc001ab75d8 pc=0x64f1873e1837
internal/poll.runtime_pollWait(0x7491ea01fc80, 0x72)
	runtime/netpoll.go:351 +0x85 fp=0xc001ab7630 sp=0xc001ab7610 pc=0x64f18741bf65
internal/poll.(*pollDesc).wait(0xc00051a000?, 0xc001b46041?, 0x0)
	internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc001ab7658 sp=0xc001ab7630 pc=0x64f1874a33a7
internal/poll.(*pollDesc).waitRead(...)
	internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc00051a000, {0xc001b46041, 0x1, 0x1})
	internal/poll/fd_unix.go:165 +0x27a fp=0xc001ab76f0 sp=0xc001ab7658 pc=0x64f1874a469a
net.(*netFD).Read(0xc00051a000, {0xc001b46041?, 0x0?, 0xc00187ab38?})
	net/fd_posix.go:55 +0x25 fp=0xc001ab7738 sp=0xc001ab76f0 pc=0x64f187518de5
net.(*conn).Read(0xc001da0000, {0xc001b46041?, 0xc0019d8540?, 0x64f187784060?})
	net/net.go:194 +0x45 fp=0xc001ab7780 sp=0xc001ab7738 pc=0x64f1875271a5
net/http.(*connReader).backgroundRead(0xc001b46030)
	net/http/server.go:690 +0x37 fp=0xc001ab77c8 sp=0xc001ab7780 pc=0x64f187713017
net/http.(*connReader).startBackgroundRead.gowrap2()
	net/http/server.go:686 +0x25 fp=0xc001ab77e0 sp=0xc001ab77c8 pc=0x64f187712f45
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc001ab77e8 sp=0xc001ab77e0 pc=0x64f187424481
created by net/http.(*connReader).startBackgroundRead in goroutine 290
	net/http/server.go:686 +0xb6

goroutine 290 gp=0xc002442540 m=nil [select]:
runtime.gopark(0xc000047a10?, 0x2?, 0x10?, 0x93?, 0xc000047874?)
	runtime/proc.go:435 +0xce fp=0xc0000476a0 sp=0xc000047680 pc=0x64f18741cd4e
runtime.selectgo(0xc000047a10, 0xc000047870, 0x6c?, 0x0, 0x4?, 0x1)
	runtime/select.go:351 +0x837 fp=0xc0000477d8 sp=0xc0000476a0 pc=0x64f1873fb3b7
github.com/ollama/ollama/runner/ollamarunner.(*Server).completion(0xc0001487e0, {0x64f188790768, 0xc001e5e000}, 0xc001e52000)
	github.com/ollama/ollama/runner/ollamarunner/runner.go:680 +0xb65 fp=0xc000047ac0 sp=0xc0000477d8 pc=0x64f18790fc45
github.com/ollama/ollama/runner/ollamarunner.(*Server).completion-fm({0x64f188790768?, 0xc001e5e000?}, 0xc000617b40?)
	<autogenerated>:1 +0x36 fp=0xc000047af0 sp=0xc000047ac0 pc=0x64f187913016
net/http.HandlerFunc.ServeHTTP(0xc000157440?, {0x64f188790768?, 0xc001e5e000?}, 0xc000617b60?)
	net/http/server.go:2294 +0x29 fp=0xc000047b18 sp=0xc000047af0 pc=0x64f18771ac49
net/http.(*ServeMux).ServeHTTP(0x64f1873c1265?, {0x64f188790768, 0xc001e5e000}, 0xc001e52000)
	net/http/server.go:2822 +0x1c4 fp=0xc000047b68 sp=0xc000047b18 pc=0x64f18771cb44
net/http.serverHandler.ServeHTTP({0x64f18878cdb0?}, {0x64f188790768?, 0xc001e5e000?}, 0x1?)
	net/http/server.go:3301 +0x8e fp=0xc000047b98 sp=0xc000047b68 pc=0x64f18773a5ce
net/http.(*conn).serve(0xc0004c0510, {0x64f1887929f8, 0xc0004d6450})
	net/http/server.go:2102 +0x625 fp=0xc000047fb8 sp=0xc000047b98 pc=0x64f187719145
net/http.(*Server).Serve.gowrap3()
	net/http/server.go:3454 +0x28 fp=0xc000047fe0 sp=0xc000047fb8 pc=0x64f18771ea08
runtime.goexit({})
	runtime/asm_amd64.s:1700 +0x1 fp=0xc000047fe8 sp=0xc000047fe0 pc=0x64f187424481
created by net/http.(*Server).Serve in goroutine 1
	net/http/server.go:3454 +0x485

rax    0x0
rbx    0x39
rcx    0x7491ea28cb2c
rdx    0x6
rdi    0x33
rsi    0x39
rbp    0x7491a15fa430
rsp    0x7491a15fa3f0
r8     0x0
r9     0x0
r10    0x8
r11    0x246
r12    0x6
r13    0x3c5
r14    0x16
r15    0x200
rip    0x7491ea28cb2c
rflags 0x246
cs     0x33
fs     0x0
gs     0x0
time=2025-08-05T18:03:06.644Z level=ERROR source=server.go:807 msg="post predict" error="Post \"http://127.0.0.1:39363/completion\": EOF"
[GIN] 2025/08/05 - 18:03:06 | 200 |  4.166504666s |      172.19.0.2 | POST     "/api/chat"
<!-- gh-comment-id:3156112482 --> @dguembel-itomig commented on GitHub (Aug 5, 2025): I also have a crash with gpt-oss:20b, on two different machines (with different Nvidia GPUs), but both Linux and running ollama in docker. Full log, in the hope it will be helpful. Please let me know if I can provide additional information or test anything to narrow this down. ``` time=2025-08-05T18:02:50.707Z level=INFO source=routes.go:1297 msg="server config" env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_CONTEXT_LENGTH:16384 OLLAMA_DEBUG:INFO OLLAMA_FLASH_ATTENTION:true OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://0.0.0.0:11434 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE:q8_0 OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/root/.ollama/models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NEW_ENGINE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:2 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://* vscode-file://*] OLLAMA_SCHED_SPREAD:false ROCR_VISIBLE_DEVICES: http_proxy: https_proxy: no_proxy:]" time=2025-08-05T18:02:50.710Z level=INFO source=images.go:477 msg="total blobs: 88" time=2025-08-05T18:02:50.712Z level=INFO source=images.go:484 msg="total unused blobs removed: 0" time=2025-08-05T18:02:50.712Z level=INFO source=routes.go:1350 msg="Listening on [::]:11434 (version 0.11.0)" time=2025-08-05T18:02:50.712Z level=INFO source=gpu.go:217 msg="looking for compatible GPUs" time=2025-08-05T18:02:51.014Z level=INFO source=types.go:130 msg="inference compute" id=GPU-aa5c1cb5-bae0-5032-c426-49bcfd0cf7b5 library=cuda variant=v12 compute=8.9 driver=12.5 name="NVIDIA RTX 4000 SFF Ada Generation" total="19.6 GiB" available="19.4 GiB" ^[[Otime=2025-08-05T18:03:03.165Z level=INFO source=server.go:135 msg="system memory" total="62.6 GiB" free="60.4 GiB" free_swap="32.0 GiB" time=2025-08-05T18:03:03.284Z level=INFO source=server.go:175 msg=offload library=cuda layers.requested=-1 layers.model=25 layers.offload=22 layers.split="" memory.available="[19.4 GiB]" memory.gpu_overhead="0 B" memory.required.full="21.1 GiB" memory.required.partial="19.1 GiB" memory.required.kv="486.0 MiB" memory.required.allocations="[19.1 GiB]" memory.weights.total="11.7 GiB" memory.weights.repeating="10.7 GiB" memory.weights.nonrepeating="1.1 GiB" memory.graph.full="4.0 GiB" memory.graph.partial="8.0 GiB" time=2025-08-05T18:03:03.284Z level=INFO source=server.go:218 msg="enabling flash attention" time=2025-08-05T18:03:03.316Z level=INFO source=server.go:438 msg="starting llama server" cmd="/usr/bin/ollama runner --ollama-engine --model /root/.ollama/models/blobs/sha256-b112e727c6f18875636c56a779790a590d705aec9e1c0eb5a97d51fc2a778583 --ctx-size 32768 --batch-size 512 --n-gpu-layers 22 --threads 6 --flash-attn --kv-cache-type q8_0 --parallel 2 --port 39363" time=2025-08-05T18:03:03.316Z level=INFO source=sched.go:481 msg="loaded runners" count=1 time=2025-08-05T18:03:03.316Z level=INFO source=server.go:598 msg="waiting for llama runner to start responding" time=2025-08-05T18:03:03.316Z level=INFO source=server.go:632 msg="waiting for server to become available" status="llm server not responding" time=2025-08-05T18:03:03.326Z level=INFO source=runner.go:925 msg="starting ollama engine" time=2025-08-05T18:03:03.327Z level=INFO source=runner.go:983 msg="Server listening on 127.0.0.1:39363" time=2025-08-05T18:03:03.373Z level=INFO source=ggml.go:92 msg="" architecture=gptoss file_type=MXFP4 name="" description="" num_tensors=315 num_key_values=30 ggml_cuda_init: GGML_CUDA_FORCE_MMQ: no ggml_cuda_init: GGML_CUDA_FORCE_CUBLAS: no ggml_cuda_init: found 1 CUDA devices: Device 0: NVIDIA RTX 4000 SFF Ada Generation, compute capability 8.9, VMM: yes load_backend: loaded CUDA backend from /usr/lib/ollama/libggml-cuda.so load_backend: loaded CPU backend from /usr/lib/ollama/libggml-cpu-alderlake.so time=2025-08-05T18:03:03.415Z level=INFO source=ggml.go:104 msg=system CPU.0.SSE3=1 CPU.0.SSSE3=1 CPU.0.AVX=1 CPU.0.AVX_VNNI=1 CPU.0.AVX2=1 CPU.0.F16C=1 CPU.0.FMA=1 CPU.0.BMI2=1 CPU.0.LLAMAFILE=1 CPU.1.LLAMAFILE=1 CUDA.0.ARCHS=500,600,610,700,750,800,860,870,890,900,1200 CUDA.0.USE_GRAPHS=1 CUDA.0.PEER_MAX_BATCH_SIZE=128 compiler=cgo(gcc) time=2025-08-05T18:03:03.491Z level=INFO source=ggml.go:367 msg="offloading 22 repeating layers to GPU" time=2025-08-05T18:03:03.491Z level=INFO source=ggml.go:371 msg="offloading output layer to CPU" time=2025-08-05T18:03:03.491Z level=INFO source=ggml.go:378 msg="offloaded 22/25 layers to GPU" time=2025-08-05T18:03:03.491Z level=INFO source=ggml.go:381 msg="model weights" buffer=CPU size="3.0 GiB" time=2025-08-05T18:03:03.491Z level=INFO source=ggml.go:381 msg="model weights" buffer=CUDA0 size="9.8 GiB" time=2025-08-05T18:03:03.508Z level=INFO source=ggml.go:672 msg="compute graph" backend=CUDA0 buffer_type=CUDA0 size="8.1 GiB" time=2025-08-05T18:03:03.508Z level=INFO source=ggml.go:672 msg="compute graph" backend=CPU buffer_type=CPU size="8.0 GiB" time=2025-08-05T18:03:03.567Z level=INFO source=server.go:632 msg="waiting for server to become available" status="llm server loading model" ^[[Itime=2025-08-05T18:03:06.331Z level=INFO source=server.go:637 msg="llama runner started in 3.01 seconds" //ml/backend/ggml/ggml/src/ggml-cpu/ops.cpp:965: fatal error //ml/backend/ggml/ggml/src/ggml-cpu/ops.cpp:965: fatal error //ml/backend/ggml/ggml/src/ggml-cpu/ops.cpp:965: fatal error //ml/backend/ggml/ggml/src/ggml-cpu/ops.cpp:965: fatal error //ml/backend/ggml/ggml/src/ggml-cpu/ops.cpp:965: fatal error //ml/backend/ggml/ggml/src/ggml-cpu/ops.cpp:965: fatal error SIGSEGV: segmentation violation PC=0x74916e7e2817 m=7 sigcode=1 addr=0x206403f70 signal arrived during cgo execution goroutine 14 gp=0xc000602e00 m=7 mp=0xc000580008 [syscall]: runtime.cgocall(0x64f1880e6180, 0xc000611a58) runtime/cgocall.go:167 +0x4b fp=0xc000611a30 sp=0xc0006119f8 pc=0x64f1874198cb github.com/ollama/ollama/ml/backend/ggml._Cfunc_ggml_backend_sched_graph_compute_async(0x749168fad1a0, 0x749188004790) _cgo_gotypes.go:886 +0x4a fp=0xc000611a58 sp=0xc000611a30 pc=0x64f1878534ea github.com/ollama/ollama/ml/backend/ggml.(*Context).Compute.func1(...) github.com/ollama/ollama/ml/backend/ggml/ggml.go:631 github.com/ollama/ollama/ml/backend/ggml.(*Context).Compute(0xc000422040, {0xc000474530, 0x1, 0x0?}) github.com/ollama/ollama/ml/backend/ggml/ggml.go:631 +0x9d fp=0xc000611b00 sp=0xc000611a58 pc=0x64f18785e9fd github.com/ollama/ollama/model.Forward({0x64f18879ad30, 0xc000422040}, {0x64f188791550, 0xc0000f36b0}, {0xc000116400, 0x6c, 0x80}, {{0x64f1887a5988, 0xc0000115c0}, {0x0, ...}, ...}) github.com/ollama/ollama/model/model.go:305 +0x2a7 fp=0xc000611be8 sp=0xc000611b00 pc=0x64f18786c9c7 github.com/ollama/ollama/runner/ollamarunner.(*Server).processBatch(0xc0001487e0) github.com/ollama/ollama/runner/ollamarunner/runner.go:480 +0x4c5 fp=0xc000611f98 sp=0xc000611be8 pc=0x64f18790d905 github.com/ollama/ollama/runner/ollamarunner.(*Server).run(0xc0001487e0, {0x64f188792a30, 0xc000383e50}) github.com/ollama/ollama/runner/ollamarunner/runner.go:362 +0x4e fp=0xc000611fb8 sp=0xc000611f98 pc=0x64f18790d3ee github.com/ollama/ollama/runner/ollamarunner.Execute.gowrap2() github.com/ollama/ollama/runner/ollamarunner/runner.go:960 +0x28 fp=0xc000611fe0 sp=0xc000611fb8 pc=0x64f187912b48 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc000611fe8 sp=0xc000611fe0 pc=0x64f187424481 created by github.com/ollama/ollama/runner/ollamarunner.Execute in goroutine 1 github.com/ollama/ollama/runner/ollamarunner/runner.go:960 +0xa74 goroutine 1 gp=0xc000002380 m=nil [IO wait]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc000613650 sp=0xc000613630 pc=0x64f18741cd4e runtime.netpollblock(0xc0006136a0?, 0x873b5b46?, 0xf1?) runtime/netpoll.go:575 +0xf7 fp=0xc000613688 sp=0xc000613650 pc=0x64f1873e1837 internal/poll.runtime_pollWait(0x7491ea01feb0, 0x72) runtime/netpoll.go:351 +0x85 fp=0xc0006136a8 sp=0xc000613688 pc=0x64f18741bf65 internal/poll.(*pollDesc).wait(0xc00051ab00?, 0x9003bfe3e?, 0x0) internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc0006136d0 sp=0xc0006136a8 pc=0x64f1874a33a7 internal/poll.(*pollDesc).waitRead(...) internal/poll/fd_poll_runtime.go:89 internal/poll.(*FD).Accept(0xc00051ab00) internal/poll/fd_unix.go:620 +0x295 fp=0xc000613778 sp=0xc0006136d0 pc=0x64f1874a8775 net.(*netFD).accept(0xc00051ab00) net/fd_unix.go:172 +0x29 fp=0xc000613830 sp=0xc000613778 pc=0x64f18751ad89 net.(*TCPListener).accept(0xc00012f140) net/tcpsock_posix.go:159 +0x1b fp=0xc000613880 sp=0xc000613830 pc=0x64f18753073b net.(*TCPListener).Accept(0xc00012f140) net/tcpsock.go:380 +0x30 fp=0xc0006138b0 sp=0xc000613880 pc=0x64f18752f5f0 net/http.(*onceCloseListener).Accept(0xc0004c0510?) <autogenerated>:1 +0x24 fp=0xc0006138c8 sp=0xc0006138b0 pc=0x64f187746d44 net/http.(*Server).Serve(0xc000213600, {0x64f188790588, 0xc00012f140}) net/http/server.go:3424 +0x30c fp=0xc0006139f8 sp=0xc0006138c8 pc=0x64f18771e60c github.com/ollama/ollama/runner/ollamarunner.Execute({0xc000034170, 0x11, 0x11}) github.com/ollama/ollama/runner/ollamarunner/runner.go:984 +0xe09 fp=0xc000613d08 sp=0xc0006139f8 pc=0x64f1879128a9 github.com/ollama/ollama/runner.Execute({0xc000034150?, 0x0?, 0x0?}) github.com/ollama/ollama/runner/runner.go:20 +0xc9 fp=0xc000613d30 sp=0xc000613d08 pc=0x64f1879131a9 github.com/ollama/ollama/cmd.NewCLI.func2(0xc000213400?, {0x64f1882d307b?, 0x4?, 0x64f1882d307f?}) github.com/ollama/ollama/cmd/cmd.go:1583 +0x45 fp=0xc000613d58 sp=0xc000613d30 pc=0x64f1880780e5 github.com/spf13/cobra.(*Command).execute(0xc0004c2f08, {0xc0001485a0, 0x12, 0x12}) github.com/spf13/cobra@v1.7.0/command.go:940 +0x85c fp=0xc000613e78 sp=0xc000613d58 pc=0x64f1875943dc github.com/spf13/cobra.(*Command).ExecuteC(0xc000177208) github.com/spf13/cobra@v1.7.0/command.go:1068 +0x3a5 fp=0xc000613f30 sp=0xc000613e78 pc=0x64f187594c25 github.com/spf13/cobra.(*Command).Execute(...) github.com/spf13/cobra@v1.7.0/command.go:992 github.com/spf13/cobra.(*Command).ExecuteContext(...) github.com/spf13/cobra@v1.7.0/command.go:985 main.main() github.com/ollama/ollama/main.go:12 +0x4d fp=0xc000613f50 sp=0xc000613f30 pc=0x64f188078bcd runtime.main() runtime/proc.go:283 +0x29d fp=0xc000613fe0 sp=0xc000613f50 pc=0x64f1873e8ebd runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc000613fe8 sp=0xc000613fe0 pc=0x64f187424481 goroutine 2 gp=0xc000002e00 m=nil [force gc (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc00008cfa8 sp=0xc00008cf88 pc=0x64f18741cd4e runtime.goparkunlock(...) runtime/proc.go:441 runtime.forcegchelper() runtime/proc.go:348 +0xb8 fp=0xc00008cfe0 sp=0xc00008cfa8 pc=0x64f1873e91f8 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc00008cfe8 sp=0xc00008cfe0 pc=0x64f187424481 created by runtime.init.7 in goroutine 1 runtime/proc.go:336 +0x1a goroutine 3 gp=0xc000003340 m=nil [GC sweep wait]: runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc00008d780 sp=0xc00008d760 pc=0x64f18741cd4e runtime.goparkunlock(...) runtime/proc.go:441 runtime.bgsweep(0xc0000b8000) runtime/mgcsweep.go:316 +0xdf fp=0xc00008d7c8 sp=0xc00008d780 pc=0x64f1873d399f runtime.gcenable.gowrap1() runtime/mgc.go:204 +0x25 fp=0xc00008d7e0 sp=0xc00008d7c8 pc=0x64f1873c7d85 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc00008d7e8 sp=0xc00008d7e0 pc=0x64f187424481 created by runtime.gcenable in goroutine 1 runtime/mgc.go:204 +0x66 goroutine 4 gp=0xc000003500 m=nil [GC scavenge wait]: runtime.gopark(0x10000?, 0x64f188495090?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc00008df78 sp=0xc00008df58 pc=0x64f18741cd4e runtime.goparkunlock(...) runtime/proc.go:441 runtime.(*scavengerState).park(0x64f1890279a0) runtime/mgcscavenge.go:425 +0x49 fp=0xc00008dfa8 sp=0xc00008df78 pc=0x64f1873d13e9 runtime.bgscavenge(0xc0000b8000) runtime/mgcscavenge.go:658 +0x59 fp=0xc00008dfc8 sp=0xc00008dfa8 pc=0x64f1873d1979 runtime.gcenable.gowrap2() runtime/mgc.go:205 +0x25 fp=0xc00008dfe0 sp=0xc00008dfc8 pc=0x64f1873c7d25 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc00008dfe8 sp=0xc00008dfe0 pc=0x64f187424481 created by runtime.gcenable in goroutine 1 runtime/mgc.go:205 +0xa5 goroutine 5 gp=0xc000003dc0 m=nil [finalizer wait]: runtime.gopark(0x1b8?, 0xc000002380?, 0x1?, 0x23?, 0xc00008c688?) runtime/proc.go:435 +0xce fp=0xc00008c630 sp=0xc00008c610 pc=0x64f18741cd4e runtime.runfinq() runtime/mfinal.go:196 +0x107 fp=0xc00008c7e0 sp=0xc00008c630 pc=0x64f1873c6d47 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc00008c7e8 sp=0xc00008c7e0 pc=0x64f187424481 created by runtime.createfing in goroutine 1 runtime/mfinal.go:166 +0x3d goroutine 6 gp=0xc0001f08c0 m=nil [chan receive]: runtime.gopark(0xc0001eda40?, 0xc001a66030?, 0x60?, 0xe7?, 0x64f1875019c8?) runtime/proc.go:435 +0xce fp=0xc00008e718 sp=0xc00008e6f8 pc=0x64f18741cd4e runtime.chanrecv(0xc0000c6310, 0x0, 0x1) runtime/chan.go:664 +0x445 fp=0xc00008e790 sp=0xc00008e718 pc=0x64f1873b8725 runtime.chanrecv1(0x0?, 0x0?) runtime/chan.go:506 +0x12 fp=0xc00008e7b8 sp=0xc00008e790 pc=0x64f1873b82b2 runtime.unique_runtime_registerUniqueMapCleanup.func2(...) runtime/mgc.go:1796 runtime.unique_runtime_registerUniqueMapCleanup.gowrap1() runtime/mgc.go:1799 +0x2f fp=0xc00008e7e0 sp=0xc00008e7b8 pc=0x64f1873caf2f runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc00008e7e8 sp=0xc00008e7e0 pc=0x64f187424481 created by unique.runtime_registerUniqueMapCleanup in goroutine 1 runtime/mgc.go:1794 +0x85 goroutine 7 gp=0xc0001f0c40 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc00008ef38 sp=0xc00008ef18 pc=0x64f18741cd4e runtime.gcBgMarkWorker(0xc0000c7730) runtime/mgc.go:1423 +0xe9 fp=0xc00008efc8 sp=0xc00008ef38 pc=0x64f1873ca249 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc00008efe0 sp=0xc00008efc8 pc=0x64f1873ca125 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc00008efe8 sp=0xc00008efe0 pc=0x64f187424481 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 8 gp=0xc0001f0e00 m=nil [GC worker (idle)]: runtime.gopark(0x54a373ed71?, 0x0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc00008f738 sp=0xc00008f718 pc=0x64f18741cd4e runtime.gcBgMarkWorker(0xc0000c7730) runtime/mgc.go:1423 +0xe9 fp=0xc00008f7c8 sp=0xc00008f738 pc=0x64f1873ca249 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc00008f7e0 sp=0xc00008f7c8 pc=0x64f1873ca125 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc00008f7e8 sp=0xc00008f7e0 pc=0x64f187424481 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 9 gp=0xc0001f0fc0 m=nil [GC worker (idle)]: runtime.gopark(0x64f1890d61e0?, 0x1?, 0x4b?, 0xbc?, 0x0?) runtime/proc.go:435 +0xce fp=0xc00008ff38 sp=0xc00008ff18 pc=0x64f18741cd4e runtime.gcBgMarkWorker(0xc0000c7730) runtime/mgc.go:1423 +0xe9 fp=0xc00008ffc8 sp=0xc00008ff38 pc=0x64f1873ca249 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc00008ffe0 sp=0xc00008ffc8 pc=0x64f1873ca125 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc00008ffe8 sp=0xc00008ffe0 pc=0x64f187424481 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 10 gp=0xc0001f1180 m=nil [GC worker (idle)]: runtime.gopark(0x54a3736a85?, 0x0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc000088738 sp=0xc000088718 pc=0x64f18741cd4e runtime.gcBgMarkWorker(0xc0000c7730) runtime/mgc.go:1423 +0xe9 fp=0xc0000887c8 sp=0xc000088738 pc=0x64f1873ca249 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0000887e0 sp=0xc0000887c8 pc=0x64f1873ca125 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0000887e8 sp=0xc0000887e0 pc=0x64f187424481 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 11 gp=0xc0001f1340 m=nil [GC worker (idle)]: runtime.gopark(0x54a37333ba?, 0x0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc000088f38 sp=0xc000088f18 pc=0x64f18741cd4e runtime.gcBgMarkWorker(0xc0000c7730) runtime/mgc.go:1423 +0xe9 fp=0xc000088fc8 sp=0xc000088f38 pc=0x64f1873ca249 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc000088fe0 sp=0xc000088fc8 pc=0x64f1873ca125 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc000088fe8 sp=0xc000088fe0 pc=0x64f187424481 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 18 gp=0xc000504000 m=nil [GC worker (idle)]: runtime.gopark(0x54a372cfb6?, 0x0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc00050a738 sp=0xc00050a718 pc=0x64f18741cd4e runtime.gcBgMarkWorker(0xc0000c7730) runtime/mgc.go:1423 +0xe9 fp=0xc00050a7c8 sp=0xc00050a738 pc=0x64f1873ca249 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc00050a7e0 sp=0xc00050a7c8 pc=0x64f1873ca125 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc00050a7e8 sp=0xc00050a7e0 pc=0x64f187424481 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 34 gp=0xc000102380 m=nil [GC worker (idle)]: runtime.gopark(0x54a373a049?, 0x0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc000506738 sp=0xc000506718 pc=0x64f18741cd4e runtime.gcBgMarkWorker(0xc0000c7730) runtime/mgc.go:1423 +0xe9 fp=0xc0005067c8 sp=0xc000506738 pc=0x64f1873ca249 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0005067e0 sp=0xc0005067c8 pc=0x64f1873ca125 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0005067e8 sp=0xc0005067e0 pc=0x64f187424481 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 35 gp=0xc000102540 m=nil [GC worker (idle)]: runtime.gopark(0x54a375b8dd?, 0x0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc000506f38 sp=0xc000506f18 pc=0x64f18741cd4e runtime.gcBgMarkWorker(0xc0000c7730) runtime/mgc.go:1423 +0xe9 fp=0xc000506fc8 sp=0xc000506f38 pc=0x64f1873ca249 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc000506fe0 sp=0xc000506fc8 pc=0x64f1873ca125 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc000506fe8 sp=0xc000506fe0 pc=0x64f187424481 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 36 gp=0xc000102700 m=nil [GC worker (idle)]: runtime.gopark(0x54a3760db1?, 0x0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc000507738 sp=0xc000507718 pc=0x64f18741cd4e runtime.gcBgMarkWorker(0xc0000c7730) runtime/mgc.go:1423 +0xe9 fp=0xc0005077c8 sp=0xc000507738 pc=0x64f1873ca249 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0005077e0 sp=0xc0005077c8 pc=0x64f1873ca125 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0005077e8 sp=0xc0005077e0 pc=0x64f187424481 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 37 gp=0xc0001028c0 m=nil [GC worker (idle)]: runtime.gopark(0x64f1890d61e0?, 0x1?, 0x98?, 0x12?, 0x0?) runtime/proc.go:435 +0xce fp=0xc000507f38 sp=0xc000507f18 pc=0x64f18741cd4e runtime.gcBgMarkWorker(0xc0000c7730) runtime/mgc.go:1423 +0xe9 fp=0xc000507fc8 sp=0xc000507f38 pc=0x64f1873ca249 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc000507fe0 sp=0xc000507fc8 pc=0x64f1873ca125 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc000507fe8 sp=0xc000507fe0 pc=0x64f187424481 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 38 gp=0xc000102a80 m=nil [GC worker (idle)]: runtime.gopark(0x64f1890d61e0?, 0x1?, 0x50?, 0x2?, 0x0?) runtime/proc.go:435 +0xce fp=0xc000508738 sp=0xc000508718 pc=0x64f18741cd4e runtime.gcBgMarkWorker(0xc0000c7730) runtime/mgc.go:1423 +0xe9 fp=0xc0005087c8 sp=0xc000508738 pc=0x64f1873ca249 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0005087e0 sp=0xc0005087c8 pc=0x64f1873ca125 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0005087e8 sp=0xc0005087e0 pc=0x64f187424481 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 39 gp=0xc000102c40 m=nil [GC worker (idle)]: runtime.gopark(0x64f1890d61e0?, 0x1?, 0xf?, 0xef?, 0x0?) runtime/proc.go:435 +0xce fp=0xc000508f38 sp=0xc000508f18 pc=0x64f18741cd4e runtime.gcBgMarkWorker(0xc0000c7730) runtime/mgc.go:1423 +0xe9 fp=0xc000508fc8 sp=0xc000508f38 pc=0x64f1873ca249 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc000508fe0 sp=0xc000508fc8 pc=0x64f1873ca125 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc000508fe8 sp=0xc000508fe0 pc=0x64f187424481 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 40 gp=0xc000102e00 m=nil [GC worker (idle)]: runtime.gopark(0x54a372f8ff?, 0x1?, 0x24?, 0xac?, 0x0?) runtime/proc.go:435 +0xce fp=0xc000509738 sp=0xc000509718 pc=0x64f18741cd4e runtime.gcBgMarkWorker(0xc0000c7730) runtime/mgc.go:1423 +0xe9 fp=0xc0005097c8 sp=0xc000509738 pc=0x64f1873ca249 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0005097e0 sp=0xc0005097c8 pc=0x64f1873ca125 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0005097e8 sp=0xc0005097e0 pc=0x64f187424481 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 41 gp=0xc000102fc0 m=nil [GC worker (idle)]: runtime.gopark(0x64f1890d61e0?, 0x1?, 0xfd?, 0x40?, 0x0?) runtime/proc.go:435 +0xce fp=0xc000509f38 sp=0xc000509f18 pc=0x64f18741cd4e runtime.gcBgMarkWorker(0xc0000c7730) runtime/mgc.go:1423 +0xe9 fp=0xc000509fc8 sp=0xc000509f38 pc=0x64f1873ca249 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc000509fe0 sp=0xc000509fc8 pc=0x64f1873ca125 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc000509fe8 sp=0xc000509fe0 pc=0x64f187424481 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 42 gp=0xc000103180 m=nil [GC worker (idle)]: runtime.gopark(0x54a3756bd1?, 0x3?, 0x29?, 0x87?, 0x0?) runtime/proc.go:435 +0xce fp=0xc00011c738 sp=0xc00011c718 pc=0x64f18741cd4e runtime.gcBgMarkWorker(0xc0000c7730) runtime/mgc.go:1423 +0xe9 fp=0xc00011c7c8 sp=0xc00011c738 pc=0x64f1873ca249 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc00011c7e0 sp=0xc00011c7c8 pc=0x64f1873ca125 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc00011c7e8 sp=0xc00011c7e0 pc=0x64f187424481 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 43 gp=0xc000103340 m=nil [GC worker (idle)]: runtime.gopark(0x54a373dcdc?, 0x1?, 0x26?, 0xbe?, 0x0?) runtime/proc.go:435 +0xce fp=0xc00011cf38 sp=0xc00011cf18 pc=0x64f18741cd4e runtime.gcBgMarkWorker(0xc0000c7730) runtime/mgc.go:1423 +0xe9 fp=0xc00011cfc8 sp=0xc00011cf38 pc=0x64f1873ca249 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc00011cfe0 sp=0xc00011cfc8 pc=0x64f1873ca125 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc00011cfe8 sp=0xc00011cfe0 pc=0x64f187424481 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 44 gp=0xc000103500 m=nil [GC worker (idle)]: runtime.gopark(0x54a39880fb?, 0x1?, 0xda?, 0xbc?, 0x0?) runtime/proc.go:435 +0xce fp=0xc00011d738 sp=0xc00011d718 pc=0x64f18741cd4e runtime.gcBgMarkWorker(0xc0000c7730) runtime/mgc.go:1423 +0xe9 fp=0xc00011d7c8 sp=0xc00011d738 pc=0x64f1873ca249 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc00011d7e0 sp=0xc00011d7c8 pc=0x64f1873ca125 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc00011d7e8 sp=0xc00011d7e0 pc=0x64f187424481 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 12 gp=0xc0001f1500 m=nil [GC worker (idle)]: runtime.gopark(0x54a37318de?, 0x0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc000089738 sp=0xc000089718 pc=0x64f18741cd4e runtime.gcBgMarkWorker(0xc0000c7730) runtime/mgc.go:1423 +0xe9 fp=0xc0000897c8 sp=0xc000089738 pc=0x64f1873ca249 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0000897e0 sp=0xc0000897c8 pc=0x64f1873ca125 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0000897e8 sp=0xc0000897e0 pc=0x64f187424481 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 19 gp=0xc0005041c0 m=nil [GC worker (idle)]: runtime.gopark(0x54a3718a67?, 0x1?, 0x8d?, 0xe4?, 0x0?) runtime/proc.go:435 +0xce fp=0xc00050af38 sp=0xc00050af18 pc=0x64f18741cd4e runtime.gcBgMarkWorker(0xc0000c7730) runtime/mgc.go:1423 +0xe9 fp=0xc00050afc8 sp=0xc00050af38 pc=0x64f1873ca249 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc00050afe0 sp=0xc00050afc8 pc=0x64f1873ca125 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc00050afe8 sp=0xc00050afe0 pc=0x64f187424481 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 20 gp=0xc000504380 m=nil [GC worker (idle)]: runtime.gopark(0x54a3767ede?, 0x3?, 0xdf?, 0x2b?, 0x0?) runtime/proc.go:435 +0xce fp=0xc00050b738 sp=0xc00050b718 pc=0x64f18741cd4e runtime.gcBgMarkWorker(0xc0000c7730) runtime/mgc.go:1423 +0xe9 fp=0xc00050b7c8 sp=0xc00050b738 pc=0x64f1873ca249 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc00050b7e0 sp=0xc00050b7c8 pc=0x64f1873ca125 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc00050b7e8 sp=0xc00050b7e0 pc=0x64f187424481 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 436 gp=0xc000505a40 m=nil [IO wait]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0xb?) runtime/proc.go:435 +0xce fp=0xc001ab75d8 sp=0xc001ab75b8 pc=0x64f18741cd4e runtime.netpollblock(0x64f1874400b8?, 0x873b5b46?, 0xf1?) runtime/netpoll.go:575 +0xf7 fp=0xc001ab7610 sp=0xc001ab75d8 pc=0x64f1873e1837 internal/poll.runtime_pollWait(0x7491ea01fc80, 0x72) runtime/netpoll.go:351 +0x85 fp=0xc001ab7630 sp=0xc001ab7610 pc=0x64f18741bf65 internal/poll.(*pollDesc).wait(0xc00051a000?, 0xc001b46041?, 0x0) internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc001ab7658 sp=0xc001ab7630 pc=0x64f1874a33a7 internal/poll.(*pollDesc).waitRead(...) internal/poll/fd_poll_runtime.go:89 internal/poll.(*FD).Read(0xc00051a000, {0xc001b46041, 0x1, 0x1}) internal/poll/fd_unix.go:165 +0x27a fp=0xc001ab76f0 sp=0xc001ab7658 pc=0x64f1874a469a net.(*netFD).Read(0xc00051a000, {0xc001b46041?, 0x0?, 0xc00187ab38?}) net/fd_posix.go:55 +0x25 fp=0xc001ab7738 sp=0xc001ab76f0 pc=0x64f187518de5 net.(*conn).Read(0xc001da0000, {0xc001b46041?, 0xc0019d8540?, 0x64f187784060?}) net/net.go:194 +0x45 fp=0xc001ab7780 sp=0xc001ab7738 pc=0x64f1875271a5 net/http.(*connReader).backgroundRead(0xc001b46030) net/http/server.go:690 +0x37 fp=0xc001ab77c8 sp=0xc001ab7780 pc=0x64f187713017 net/http.(*connReader).startBackgroundRead.gowrap2() net/http/server.go:686 +0x25 fp=0xc001ab77e0 sp=0xc001ab77c8 pc=0x64f187712f45 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc001ab77e8 sp=0xc001ab77e0 pc=0x64f187424481 created by net/http.(*connReader).startBackgroundRead in goroutine 290 net/http/server.go:686 +0xb6 goroutine 290 gp=0xc002442540 m=nil [select]: runtime.gopark(0xc000047a10?, 0x2?, 0x10?, 0x93?, 0xc000047874?) runtime/proc.go:435 +0xce fp=0xc0000476a0 sp=0xc000047680 pc=0x64f18741cd4e runtime.selectgo(0xc000047a10, 0xc000047870, 0x6c?, 0x0, 0x4?, 0x1) runtime/select.go:351 +0x837 fp=0xc0000477d8 sp=0xc0000476a0 pc=0x64f1873fb3b7 github.com/ollama/ollama/runner/ollamarunner.(*Server).completion(0xc0001487e0, {0x64f188790768, 0xc001e5e000}, 0xc001e52000) github.com/ollama/ollama/runner/ollamarunner/runner.go:680 +0xb65 fp=0xc000047ac0 sp=0xc0000477d8 pc=0x64f18790fc45 github.com/ollama/ollama/runner/ollamarunner.(*Server).completion-fm({0x64f188790768?, 0xc001e5e000?}, 0xc000617b40?) <autogenerated>:1 +0x36 fp=0xc000047af0 sp=0xc000047ac0 pc=0x64f187913016 net/http.HandlerFunc.ServeHTTP(0xc000157440?, {0x64f188790768?, 0xc001e5e000?}, 0xc000617b60?) net/http/server.go:2294 +0x29 fp=0xc000047b18 sp=0xc000047af0 pc=0x64f18771ac49 net/http.(*ServeMux).ServeHTTP(0x64f1873c1265?, {0x64f188790768, 0xc001e5e000}, 0xc001e52000) net/http/server.go:2822 +0x1c4 fp=0xc000047b68 sp=0xc000047b18 pc=0x64f18771cb44 net/http.serverHandler.ServeHTTP({0x64f18878cdb0?}, {0x64f188790768?, 0xc001e5e000?}, 0x1?) net/http/server.go:3301 +0x8e fp=0xc000047b98 sp=0xc000047b68 pc=0x64f18773a5ce net/http.(*conn).serve(0xc0004c0510, {0x64f1887929f8, 0xc0004d6450}) net/http/server.go:2102 +0x625 fp=0xc000047fb8 sp=0xc000047b98 pc=0x64f187719145 net/http.(*Server).Serve.gowrap3() net/http/server.go:3454 +0x28 fp=0xc000047fe0 sp=0xc000047fb8 pc=0x64f18771ea08 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc000047fe8 sp=0xc000047fe0 pc=0x64f187424481 created by net/http.(*Server).Serve in goroutine 1 net/http/server.go:3454 +0x485 rax 0x206403f70 rbx 0x7491687b24f0 rcx 0xfdc rdx 0x7491686494c0 rdi 0x7491686494d0 rsi 0x0 rbp 0x7491a15fa2c0 rsp 0x7491a15fa2a0 r8 0x0 r9 0x0 r10 0x0 r11 0x246 r12 0x7488e4002c70 r13 0x7491686494d0 r14 0x0 r15 0x749168002d80 rip 0x74916e7e2817 rflags 0x10297 cs 0x33 fs 0x0 gs 0x0 SIGABRT: abort PC=0x7491ea28cb2c m=7 sigcode=18446744073709551610 signal arrived during cgo execution goroutine 14 gp=0xc000602e00 m=7 mp=0xc000580008 [syscall]: runtime.cgocall(0x64f1880e6180, 0xc000611a58) runtime/cgocall.go:167 +0x4b fp=0xc000611a30 sp=0xc0006119f8 pc=0x64f1874198cb github.com/ollama/ollama/ml/backend/ggml._Cfunc_ggml_backend_sched_graph_compute_async(0x749168fad1a0, 0x749188004790) _cgo_gotypes.go:886 +0x4a fp=0xc000611a58 sp=0xc000611a30 pc=0x64f1878534ea github.com/ollama/ollama/ml/backend/ggml.(*Context).Compute.func1(...) github.com/ollama/ollama/ml/backend/ggml/ggml.go:631 github.com/ollama/ollama/ml/backend/ggml.(*Context).Compute(0xc000422040, {0xc000474530, 0x1, 0x0?}) github.com/ollama/ollama/ml/backend/ggml/ggml.go:631 +0x9d fp=0xc000611b00 sp=0xc000611a58 pc=0x64f18785e9fd github.com/ollama/ollama/model.Forward({0x64f18879ad30, 0xc000422040}, {0x64f188791550, 0xc0000f36b0}, {0xc000116400, 0x6c, 0x80}, {{0x64f1887a5988, 0xc0000115c0}, {0x0, ...}, ...}) github.com/ollama/ollama/model/model.go:305 +0x2a7 fp=0xc000611be8 sp=0xc000611b00 pc=0x64f18786c9c7 github.com/ollama/ollama/runner/ollamarunner.(*Server).processBatch(0xc0001487e0) github.com/ollama/ollama/runner/ollamarunner/runner.go:480 +0x4c5 fp=0xc000611f98 sp=0xc000611be8 pc=0x64f18790d905 github.com/ollama/ollama/runner/ollamarunner.(*Server).run(0xc0001487e0, {0x64f188792a30, 0xc000383e50}) github.com/ollama/ollama/runner/ollamarunner/runner.go:362 +0x4e fp=0xc000611fb8 sp=0xc000611f98 pc=0x64f18790d3ee github.com/ollama/ollama/runner/ollamarunner.Execute.gowrap2() github.com/ollama/ollama/runner/ollamarunner/runner.go:960 +0x28 fp=0xc000611fe0 sp=0xc000611fb8 pc=0x64f187912b48 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc000611fe8 sp=0xc000611fe0 pc=0x64f187424481 created by github.com/ollama/ollama/runner/ollamarunner.Execute in goroutine 1 github.com/ollama/ollama/runner/ollamarunner/runner.go:960 +0xa74 goroutine 1 gp=0xc000002380 m=nil [IO wait]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc000613650 sp=0xc000613630 pc=0x64f18741cd4e runtime.netpollblock(0xc0006136a0?, 0x873b5b46?, 0xf1?) runtime/netpoll.go:575 +0xf7 fp=0xc000613688 sp=0xc000613650 pc=0x64f1873e1837 internal/poll.runtime_pollWait(0x7491ea01feb0, 0x72) runtime/netpoll.go:351 +0x85 fp=0xc0006136a8 sp=0xc000613688 pc=0x64f18741bf65 internal/poll.(*pollDesc).wait(0xc00051ab00?, 0x9003bfe3e?, 0x0) internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc0006136d0 sp=0xc0006136a8 pc=0x64f1874a33a7 internal/poll.(*pollDesc).waitRead(...) internal/poll/fd_poll_runtime.go:89 internal/poll.(*FD).Accept(0xc00051ab00) internal/poll/fd_unix.go:620 +0x295 fp=0xc000613778 sp=0xc0006136d0 pc=0x64f1874a8775 net.(*netFD).accept(0xc00051ab00) net/fd_unix.go:172 +0x29 fp=0xc000613830 sp=0xc000613778 pc=0x64f18751ad89 net.(*TCPListener).accept(0xc00012f140) net/tcpsock_posix.go:159 +0x1b fp=0xc000613880 sp=0xc000613830 pc=0x64f18753073b net.(*TCPListener).Accept(0xc00012f140) net/tcpsock.go:380 +0x30 fp=0xc0006138b0 sp=0xc000613880 pc=0x64f18752f5f0 net/http.(*onceCloseListener).Accept(0xc0004c0510?) <autogenerated>:1 +0x24 fp=0xc0006138c8 sp=0xc0006138b0 pc=0x64f187746d44 net/http.(*Server).Serve(0xc000213600, {0x64f188790588, 0xc00012f140}) net/http/server.go:3424 +0x30c fp=0xc0006139f8 sp=0xc0006138c8 pc=0x64f18771e60c github.com/ollama/ollama/runner/ollamarunner.Execute({0xc000034170, 0x11, 0x11}) github.com/ollama/ollama/runner/ollamarunner/runner.go:984 +0xe09 fp=0xc000613d08 sp=0xc0006139f8 pc=0x64f1879128a9 github.com/ollama/ollama/runner.Execute({0xc000034150?, 0x0?, 0x0?}) github.com/ollama/ollama/runner/runner.go:20 +0xc9 fp=0xc000613d30 sp=0xc000613d08 pc=0x64f1879131a9 github.com/ollama/ollama/cmd.NewCLI.func2(0xc000213400?, {0x64f1882d307b?, 0x4?, 0x64f1882d307f?}) github.com/ollama/ollama/cmd/cmd.go:1583 +0x45 fp=0xc000613d58 sp=0xc000613d30 pc=0x64f1880780e5 github.com/spf13/cobra.(*Command).execute(0xc0004c2f08, {0xc0001485a0, 0x12, 0x12}) github.com/spf13/cobra@v1.7.0/command.go:940 +0x85c fp=0xc000613e78 sp=0xc000613d58 pc=0x64f1875943dc github.com/spf13/cobra.(*Command).ExecuteC(0xc000177208) github.com/spf13/cobra@v1.7.0/command.go:1068 +0x3a5 fp=0xc000613f30 sp=0xc000613e78 pc=0x64f187594c25 github.com/spf13/cobra.(*Command).Execute(...) github.com/spf13/cobra@v1.7.0/command.go:992 github.com/spf13/cobra.(*Command).ExecuteContext(...) github.com/spf13/cobra@v1.7.0/command.go:985 main.main() github.com/ollama/ollama/main.go:12 +0x4d fp=0xc000613f50 sp=0xc000613f30 pc=0x64f188078bcd runtime.main() runtime/proc.go:283 +0x29d fp=0xc000613fe0 sp=0xc000613f50 pc=0x64f1873e8ebd runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc000613fe8 sp=0xc000613fe0 pc=0x64f187424481 goroutine 2 gp=0xc000002e00 m=nil [force gc (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc00008cfa8 sp=0xc00008cf88 pc=0x64f18741cd4e runtime.goparkunlock(...) runtime/proc.go:441 runtime.forcegchelper() runtime/proc.go:348 +0xb8 fp=0xc00008cfe0 sp=0xc00008cfa8 pc=0x64f1873e91f8 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc00008cfe8 sp=0xc00008cfe0 pc=0x64f187424481 created by runtime.init.7 in goroutine 1 runtime/proc.go:336 +0x1a goroutine 3 gp=0xc000003340 m=nil [GC sweep wait]: runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc00008d780 sp=0xc00008d760 pc=0x64f18741cd4e runtime.goparkunlock(...) runtime/proc.go:441 runtime.bgsweep(0xc0000b8000) runtime/mgcsweep.go:316 +0xdf fp=0xc00008d7c8 sp=0xc00008d780 pc=0x64f1873d399f runtime.gcenable.gowrap1() runtime/mgc.go:204 +0x25 fp=0xc00008d7e0 sp=0xc00008d7c8 pc=0x64f1873c7d85 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc00008d7e8 sp=0xc00008d7e0 pc=0x64f187424481 created by runtime.gcenable in goroutine 1 runtime/mgc.go:204 +0x66 goroutine 4 gp=0xc000003500 m=nil [GC scavenge wait]: runtime.gopark(0x10000?, 0x64f188495090?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc00008df78 sp=0xc00008df58 pc=0x64f18741cd4e runtime.goparkunlock(...) runtime/proc.go:441 runtime.(*scavengerState).park(0x64f1890279a0) runtime/mgcscavenge.go:425 +0x49 fp=0xc00008dfa8 sp=0xc00008df78 pc=0x64f1873d13e9 runtime.bgscavenge(0xc0000b8000) runtime/mgcscavenge.go:658 +0x59 fp=0xc00008dfc8 sp=0xc00008dfa8 pc=0x64f1873d1979 runtime.gcenable.gowrap2() runtime/mgc.go:205 +0x25 fp=0xc00008dfe0 sp=0xc00008dfc8 pc=0x64f1873c7d25 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc00008dfe8 sp=0xc00008dfe0 pc=0x64f187424481 created by runtime.gcenable in goroutine 1 runtime/mgc.go:205 +0xa5 goroutine 5 gp=0xc000003dc0 m=nil [finalizer wait]: runtime.gopark(0x1b8?, 0xc000002380?, 0x1?, 0x23?, 0xc00008c688?) runtime/proc.go:435 +0xce fp=0xc00008c630 sp=0xc00008c610 pc=0x64f18741cd4e runtime.runfinq() runtime/mfinal.go:196 +0x107 fp=0xc00008c7e0 sp=0xc00008c630 pc=0x64f1873c6d47 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc00008c7e8 sp=0xc00008c7e0 pc=0x64f187424481 created by runtime.createfing in goroutine 1 runtime/mfinal.go:166 +0x3d goroutine 6 gp=0xc0001f08c0 m=nil [chan receive]: runtime.gopark(0xc0001eda40?, 0xc001a66030?, 0x60?, 0xe7?, 0x64f1875019c8?) runtime/proc.go:435 +0xce fp=0xc00008e718 sp=0xc00008e6f8 pc=0x64f18741cd4e runtime.chanrecv(0xc0000c6310, 0x0, 0x1) runtime/chan.go:664 +0x445 fp=0xc00008e790 sp=0xc00008e718 pc=0x64f1873b8725 runtime.chanrecv1(0x0?, 0x0?) runtime/chan.go:506 +0x12 fp=0xc00008e7b8 sp=0xc00008e790 pc=0x64f1873b82b2 runtime.unique_runtime_registerUniqueMapCleanup.func2(...) runtime/mgc.go:1796 runtime.unique_runtime_registerUniqueMapCleanup.gowrap1() runtime/mgc.go:1799 +0x2f fp=0xc00008e7e0 sp=0xc00008e7b8 pc=0x64f1873caf2f runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc00008e7e8 sp=0xc00008e7e0 pc=0x64f187424481 created by unique.runtime_registerUniqueMapCleanup in goroutine 1 runtime/mgc.go:1794 +0x85 goroutine 7 gp=0xc0001f0c40 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc00008ef38 sp=0xc00008ef18 pc=0x64f18741cd4e runtime.gcBgMarkWorker(0xc0000c7730) runtime/mgc.go:1423 +0xe9 fp=0xc00008efc8 sp=0xc00008ef38 pc=0x64f1873ca249 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc00008efe0 sp=0xc00008efc8 pc=0x64f1873ca125 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc00008efe8 sp=0xc00008efe0 pc=0x64f187424481 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 8 gp=0xc0001f0e00 m=nil [GC worker (idle)]: runtime.gopark(0x54a373ed71?, 0x0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc00008f738 sp=0xc00008f718 pc=0x64f18741cd4e runtime.gcBgMarkWorker(0xc0000c7730) runtime/mgc.go:1423 +0xe9 fp=0xc00008f7c8 sp=0xc00008f738 pc=0x64f1873ca249 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc00008f7e0 sp=0xc00008f7c8 pc=0x64f1873ca125 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc00008f7e8 sp=0xc00008f7e0 pc=0x64f187424481 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 9 gp=0xc0001f0fc0 m=nil [GC worker (idle)]: runtime.gopark(0x64f1890d61e0?, 0x1?, 0x4b?, 0xbc?, 0x0?) runtime/proc.go:435 +0xce fp=0xc00008ff38 sp=0xc00008ff18 pc=0x64f18741cd4e runtime.gcBgMarkWorker(0xc0000c7730) runtime/mgc.go:1423 +0xe9 fp=0xc00008ffc8 sp=0xc00008ff38 pc=0x64f1873ca249 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc00008ffe0 sp=0xc00008ffc8 pc=0x64f1873ca125 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc00008ffe8 sp=0xc00008ffe0 pc=0x64f187424481 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 10 gp=0xc0001f1180 m=nil [GC worker (idle)]: runtime.gopark(0x54a3736a85?, 0x0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc000088738 sp=0xc000088718 pc=0x64f18741cd4e runtime.gcBgMarkWorker(0xc0000c7730) runtime/mgc.go:1423 +0xe9 fp=0xc0000887c8 sp=0xc000088738 pc=0x64f1873ca249 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0000887e0 sp=0xc0000887c8 pc=0x64f1873ca125 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0000887e8 sp=0xc0000887e0 pc=0x64f187424481 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 11 gp=0xc0001f1340 m=nil [GC worker (idle)]: runtime.gopark(0x54a37333ba?, 0x0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc000088f38 sp=0xc000088f18 pc=0x64f18741cd4e runtime.gcBgMarkWorker(0xc0000c7730) runtime/mgc.go:1423 +0xe9 fp=0xc000088fc8 sp=0xc000088f38 pc=0x64f1873ca249 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc000088fe0 sp=0xc000088fc8 pc=0x64f1873ca125 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc000088fe8 sp=0xc000088fe0 pc=0x64f187424481 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 18 gp=0xc000504000 m=nil [GC worker (idle)]: runtime.gopark(0x54a372cfb6?, 0x0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc00050a738 sp=0xc00050a718 pc=0x64f18741cd4e runtime.gcBgMarkWorker(0xc0000c7730) runtime/mgc.go:1423 +0xe9 fp=0xc00050a7c8 sp=0xc00050a738 pc=0x64f1873ca249 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc00050a7e0 sp=0xc00050a7c8 pc=0x64f1873ca125 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc00050a7e8 sp=0xc00050a7e0 pc=0x64f187424481 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 34 gp=0xc000102380 m=nil [GC worker (idle)]: runtime.gopark(0x54a373a049?, 0x0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc000506738 sp=0xc000506718 pc=0x64f18741cd4e runtime.gcBgMarkWorker(0xc0000c7730) runtime/mgc.go:1423 +0xe9 fp=0xc0005067c8 sp=0xc000506738 pc=0x64f1873ca249 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0005067e0 sp=0xc0005067c8 pc=0x64f1873ca125 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0005067e8 sp=0xc0005067e0 pc=0x64f187424481 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 35 gp=0xc000102540 m=nil [GC worker (idle)]: runtime.gopark(0x54a375b8dd?, 0x0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc000506f38 sp=0xc000506f18 pc=0x64f18741cd4e runtime.gcBgMarkWorker(0xc0000c7730) runtime/mgc.go:1423 +0xe9 fp=0xc000506fc8 sp=0xc000506f38 pc=0x64f1873ca249 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc000506fe0 sp=0xc000506fc8 pc=0x64f1873ca125 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc000506fe8 sp=0xc000506fe0 pc=0x64f187424481 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 36 gp=0xc000102700 m=nil [GC worker (idle)]: runtime.gopark(0x54a3760db1?, 0x0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc000507738 sp=0xc000507718 pc=0x64f18741cd4e runtime.gcBgMarkWorker(0xc0000c7730) runtime/mgc.go:1423 +0xe9 fp=0xc0005077c8 sp=0xc000507738 pc=0x64f1873ca249 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0005077e0 sp=0xc0005077c8 pc=0x64f1873ca125 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0005077e8 sp=0xc0005077e0 pc=0x64f187424481 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 37 gp=0xc0001028c0 m=nil [GC worker (idle)]: runtime.gopark(0x64f1890d61e0?, 0x1?, 0x98?, 0x12?, 0x0?) runtime/proc.go:435 +0xce fp=0xc000507f38 sp=0xc000507f18 pc=0x64f18741cd4e runtime.gcBgMarkWorker(0xc0000c7730) runtime/mgc.go:1423 +0xe9 fp=0xc000507fc8 sp=0xc000507f38 pc=0x64f1873ca249 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc000507fe0 sp=0xc000507fc8 pc=0x64f1873ca125 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc000507fe8 sp=0xc000507fe0 pc=0x64f187424481 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 38 gp=0xc000102a80 m=nil [GC worker (idle)]: runtime.gopark(0x64f1890d61e0?, 0x1?, 0x50?, 0x2?, 0x0?) runtime/proc.go:435 +0xce fp=0xc000508738 sp=0xc000508718 pc=0x64f18741cd4e runtime.gcBgMarkWorker(0xc0000c7730) runtime/mgc.go:1423 +0xe9 fp=0xc0005087c8 sp=0xc000508738 pc=0x64f1873ca249 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0005087e0 sp=0xc0005087c8 pc=0x64f1873ca125 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0005087e8 sp=0xc0005087e0 pc=0x64f187424481 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 39 gp=0xc000102c40 m=nil [GC worker (idle)]: runtime.gopark(0x64f1890d61e0?, 0x1?, 0xf?, 0xef?, 0x0?) runtime/proc.go:435 +0xce fp=0xc000508f38 sp=0xc000508f18 pc=0x64f18741cd4e runtime.gcBgMarkWorker(0xc0000c7730) runtime/mgc.go:1423 +0xe9 fp=0xc000508fc8 sp=0xc000508f38 pc=0x64f1873ca249 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc000508fe0 sp=0xc000508fc8 pc=0x64f1873ca125 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc000508fe8 sp=0xc000508fe0 pc=0x64f187424481 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 40 gp=0xc000102e00 m=nil [GC worker (idle)]: runtime.gopark(0x54a372f8ff?, 0x1?, 0x24?, 0xac?, 0x0?) runtime/proc.go:435 +0xce fp=0xc000509738 sp=0xc000509718 pc=0x64f18741cd4e runtime.gcBgMarkWorker(0xc0000c7730) runtime/mgc.go:1423 +0xe9 fp=0xc0005097c8 sp=0xc000509738 pc=0x64f1873ca249 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0005097e0 sp=0xc0005097c8 pc=0x64f1873ca125 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0005097e8 sp=0xc0005097e0 pc=0x64f187424481 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 41 gp=0xc000102fc0 m=nil [GC worker (idle)]: runtime.gopark(0x64f1890d61e0?, 0x1?, 0xfd?, 0x40?, 0x0?) runtime/proc.go:435 +0xce fp=0xc000509f38 sp=0xc000509f18 pc=0x64f18741cd4e runtime.gcBgMarkWorker(0xc0000c7730) runtime/mgc.go:1423 +0xe9 fp=0xc000509fc8 sp=0xc000509f38 pc=0x64f1873ca249 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc000509fe0 sp=0xc000509fc8 pc=0x64f1873ca125 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc000509fe8 sp=0xc000509fe0 pc=0x64f187424481 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 42 gp=0xc000103180 m=nil [GC worker (idle)]: runtime.gopark(0x54a3756bd1?, 0x3?, 0x29?, 0x87?, 0x0?) runtime/proc.go:435 +0xce fp=0xc00011c738 sp=0xc00011c718 pc=0x64f18741cd4e runtime.gcBgMarkWorker(0xc0000c7730) runtime/mgc.go:1423 +0xe9 fp=0xc00011c7c8 sp=0xc00011c738 pc=0x64f1873ca249 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc00011c7e0 sp=0xc00011c7c8 pc=0x64f1873ca125 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc00011c7e8 sp=0xc00011c7e0 pc=0x64f187424481 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 43 gp=0xc000103340 m=nil [GC worker (idle)]: runtime.gopark(0x54a373dcdc?, 0x1?, 0x26?, 0xbe?, 0x0?) runtime/proc.go:435 +0xce fp=0xc00011cf38 sp=0xc00011cf18 pc=0x64f18741cd4e runtime.gcBgMarkWorker(0xc0000c7730) runtime/mgc.go:1423 +0xe9 fp=0xc00011cfc8 sp=0xc00011cf38 pc=0x64f1873ca249 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc00011cfe0 sp=0xc00011cfc8 pc=0x64f1873ca125 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc00011cfe8 sp=0xc00011cfe0 pc=0x64f187424481 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 44 gp=0xc000103500 m=nil [GC worker (idle)]: runtime.gopark(0x54a39880fb?, 0x1?, 0xda?, 0xbc?, 0x0?) runtime/proc.go:435 +0xce fp=0xc00011d738 sp=0xc00011d718 pc=0x64f18741cd4e runtime.gcBgMarkWorker(0xc0000c7730) runtime/mgc.go:1423 +0xe9 fp=0xc00011d7c8 sp=0xc00011d738 pc=0x64f1873ca249 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc00011d7e0 sp=0xc00011d7c8 pc=0x64f1873ca125 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc00011d7e8 sp=0xc00011d7e0 pc=0x64f187424481 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 12 gp=0xc0001f1500 m=nil [GC worker (idle)]: runtime.gopark(0x54a37318de?, 0x0?, 0x0?, 0x0?, 0x0?) runtime/proc.go:435 +0xce fp=0xc000089738 sp=0xc000089718 pc=0x64f18741cd4e runtime.gcBgMarkWorker(0xc0000c7730) runtime/mgc.go:1423 +0xe9 fp=0xc0000897c8 sp=0xc000089738 pc=0x64f1873ca249 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc0000897e0 sp=0xc0000897c8 pc=0x64f1873ca125 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc0000897e8 sp=0xc0000897e0 pc=0x64f187424481 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 19 gp=0xc0005041c0 m=nil [GC worker (idle)]: runtime.gopark(0x54a3718a67?, 0x1?, 0x8d?, 0xe4?, 0x0?) runtime/proc.go:435 +0xce fp=0xc00050af38 sp=0xc00050af18 pc=0x64f18741cd4e runtime.gcBgMarkWorker(0xc0000c7730) runtime/mgc.go:1423 +0xe9 fp=0xc00050afc8 sp=0xc00050af38 pc=0x64f1873ca249 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc00050afe0 sp=0xc00050afc8 pc=0x64f1873ca125 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc00050afe8 sp=0xc00050afe0 pc=0x64f187424481 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 20 gp=0xc000504380 m=nil [GC worker (idle)]: runtime.gopark(0x54a3767ede?, 0x3?, 0xdf?, 0x2b?, 0x0?) runtime/proc.go:435 +0xce fp=0xc00050b738 sp=0xc00050b718 pc=0x64f18741cd4e runtime.gcBgMarkWorker(0xc0000c7730) runtime/mgc.go:1423 +0xe9 fp=0xc00050b7c8 sp=0xc00050b738 pc=0x64f1873ca249 runtime.gcBgMarkStartWorkers.gowrap1() runtime/mgc.go:1339 +0x25 fp=0xc00050b7e0 sp=0xc00050b7c8 pc=0x64f1873ca125 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc00050b7e8 sp=0xc00050b7e0 pc=0x64f187424481 created by runtime.gcBgMarkStartWorkers in goroutine 1 runtime/mgc.go:1339 +0x105 goroutine 436 gp=0xc000505a40 m=nil [IO wait]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0xb?) runtime/proc.go:435 +0xce fp=0xc001ab75d8 sp=0xc001ab75b8 pc=0x64f18741cd4e runtime.netpollblock(0x64f1874400b8?, 0x873b5b46?, 0xf1?) runtime/netpoll.go:575 +0xf7 fp=0xc001ab7610 sp=0xc001ab75d8 pc=0x64f1873e1837 internal/poll.runtime_pollWait(0x7491ea01fc80, 0x72) runtime/netpoll.go:351 +0x85 fp=0xc001ab7630 sp=0xc001ab7610 pc=0x64f18741bf65 internal/poll.(*pollDesc).wait(0xc00051a000?, 0xc001b46041?, 0x0) internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc001ab7658 sp=0xc001ab7630 pc=0x64f1874a33a7 internal/poll.(*pollDesc).waitRead(...) internal/poll/fd_poll_runtime.go:89 internal/poll.(*FD).Read(0xc00051a000, {0xc001b46041, 0x1, 0x1}) internal/poll/fd_unix.go:165 +0x27a fp=0xc001ab76f0 sp=0xc001ab7658 pc=0x64f1874a469a net.(*netFD).Read(0xc00051a000, {0xc001b46041?, 0x0?, 0xc00187ab38?}) net/fd_posix.go:55 +0x25 fp=0xc001ab7738 sp=0xc001ab76f0 pc=0x64f187518de5 net.(*conn).Read(0xc001da0000, {0xc001b46041?, 0xc0019d8540?, 0x64f187784060?}) net/net.go:194 +0x45 fp=0xc001ab7780 sp=0xc001ab7738 pc=0x64f1875271a5 net/http.(*connReader).backgroundRead(0xc001b46030) net/http/server.go:690 +0x37 fp=0xc001ab77c8 sp=0xc001ab7780 pc=0x64f187713017 net/http.(*connReader).startBackgroundRead.gowrap2() net/http/server.go:686 +0x25 fp=0xc001ab77e0 sp=0xc001ab77c8 pc=0x64f187712f45 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc001ab77e8 sp=0xc001ab77e0 pc=0x64f187424481 created by net/http.(*connReader).startBackgroundRead in goroutine 290 net/http/server.go:686 +0xb6 goroutine 290 gp=0xc002442540 m=nil [select]: runtime.gopark(0xc000047a10?, 0x2?, 0x10?, 0x93?, 0xc000047874?) runtime/proc.go:435 +0xce fp=0xc0000476a0 sp=0xc000047680 pc=0x64f18741cd4e runtime.selectgo(0xc000047a10, 0xc000047870, 0x6c?, 0x0, 0x4?, 0x1) runtime/select.go:351 +0x837 fp=0xc0000477d8 sp=0xc0000476a0 pc=0x64f1873fb3b7 github.com/ollama/ollama/runner/ollamarunner.(*Server).completion(0xc0001487e0, {0x64f188790768, 0xc001e5e000}, 0xc001e52000) github.com/ollama/ollama/runner/ollamarunner/runner.go:680 +0xb65 fp=0xc000047ac0 sp=0xc0000477d8 pc=0x64f18790fc45 github.com/ollama/ollama/runner/ollamarunner.(*Server).completion-fm({0x64f188790768?, 0xc001e5e000?}, 0xc000617b40?) <autogenerated>:1 +0x36 fp=0xc000047af0 sp=0xc000047ac0 pc=0x64f187913016 net/http.HandlerFunc.ServeHTTP(0xc000157440?, {0x64f188790768?, 0xc001e5e000?}, 0xc000617b60?) net/http/server.go:2294 +0x29 fp=0xc000047b18 sp=0xc000047af0 pc=0x64f18771ac49 net/http.(*ServeMux).ServeHTTP(0x64f1873c1265?, {0x64f188790768, 0xc001e5e000}, 0xc001e52000) net/http/server.go:2822 +0x1c4 fp=0xc000047b68 sp=0xc000047b18 pc=0x64f18771cb44 net/http.serverHandler.ServeHTTP({0x64f18878cdb0?}, {0x64f188790768?, 0xc001e5e000?}, 0x1?) net/http/server.go:3301 +0x8e fp=0xc000047b98 sp=0xc000047b68 pc=0x64f18773a5ce net/http.(*conn).serve(0xc0004c0510, {0x64f1887929f8, 0xc0004d6450}) net/http/server.go:2102 +0x625 fp=0xc000047fb8 sp=0xc000047b98 pc=0x64f187719145 net/http.(*Server).Serve.gowrap3() net/http/server.go:3454 +0x28 fp=0xc000047fe0 sp=0xc000047fb8 pc=0x64f18771ea08 runtime.goexit({}) runtime/asm_amd64.s:1700 +0x1 fp=0xc000047fe8 sp=0xc000047fe0 pc=0x64f187424481 created by net/http.(*Server).Serve in goroutine 1 net/http/server.go:3454 +0x485 rax 0x0 rbx 0x39 rcx 0x7491ea28cb2c rdx 0x6 rdi 0x33 rsi 0x39 rbp 0x7491a15fa430 rsp 0x7491a15fa3f0 r8 0x0 r9 0x0 r10 0x8 r11 0x246 r12 0x6 r13 0x3c5 r14 0x16 r15 0x200 rip 0x7491ea28cb2c rflags 0x246 cs 0x33 fs 0x0 gs 0x0 time=2025-08-05T18:03:06.644Z level=ERROR source=server.go:807 msg="post predict" error="Post \"http://127.0.0.1:39363/completion\": EOF" [GIN] 2025/08/05 - 18:03:06 | 200 | 4.166504666s | 172.19.0.2 | POST "/api/chat" ```
Author
Owner

@kapolos commented on GitHub (Aug 5, 2025):

@jessegross Thank you very much, I confirm that uninstalling first and then installing (instead of just installing over the existing installation) worked.

<!-- gh-comment-id:3156203844 --> @kapolos commented on GitHub (Aug 5, 2025): @jessegross Thank you very much, I confirm that uninstalling first and then installing (instead of just installing over the existing installation) worked.
Author
Owner

@jessegross commented on GitHub (Aug 5, 2025):

This might be related to KV cache quantization, you can try using the default setting and seeing if that helps.

<!-- gh-comment-id:3156224644 --> @jessegross commented on GitHub (Aug 5, 2025): This might be related to KV cache quantization, you can try using the default setting and seeing if that helps.
Author
Owner

@mikhail-shevtsov-wiregate commented on GitHub (Aug 5, 2025):

@jessegross Thx. Indeed. Disabling flash attention did help 👍

Image

UPD: disabling only OLLAMA_KV_CACHE_TYPE=q8_0 fixes the problem.

<!-- gh-comment-id:3156234156 --> @mikhail-shevtsov-wiregate commented on GitHub (Aug 5, 2025): @jessegross Thx. Indeed. Disabling flash attention did help 👍️ <img width="1346" height="343" alt="Image" src="https://github.com/user-attachments/assets/ba0d6452-ec79-4553-8fe1-104b8b27a95a" /> UPD: disabling only `OLLAMA_KV_CACHE_TYPE=q8_0` fixes the problem.
Author
Owner

@i0ntempest commented on GitHub (Aug 5, 2025):

Seems you can have OLLAMA_FLASH_ATTENTION=1 or OLLAMA_KV_CACHE_TYPE=q8_0, but not both.

<!-- gh-comment-id:3156327782 --> @i0ntempest commented on GitHub (Aug 5, 2025): Seems you can have `OLLAMA_FLASH_ATTENTION=1` or `OLLAMA_KV_CACHE_TYPE=q8_0`, but not both.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#54232