github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-05-06 16:11:34 -05:00
Code Issues 14.5k Packages Projects Releases 120 Wiki Activity

[GH-ISSUE #2198] ollama serve crashes with SIGSEV #63293

New Issue
Closed
opened 2026-05-03 12:53:32 -05:00 by GiteaMirror · 10 comments
GiteaMirror commented 2026-05-03 12:53:32 -05:00
Owner
Copy Link

Originally created by @hardik124 on GitHub (Jan 26, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/2198

Originally assigned to: @dhiltgen on GitHub.

I installed ollama using one liner, and everytime i try to run ollama serve, i get the following error :

hardik@pop-os:~/Downloads$ ollama serve
2024/01/26 09:54:31 images.go:857: INFO total blobs: 0
2024/01/26 09:54:31 images.go:864: INFO total unused blobs removed: 0
2024/01/26 09:54:31 routes.go:950: INFO Listening on 127.0.0.1:11434 (version 0.1.21)
2024/01/26 09:54:31 payload_common.go:106: INFO Extracting dynamic libraries...
2024/01/26 09:54:34 payload_common.go:145: INFO Dynamic LLM libraries [rocm_v5 cpu_avx cpu cuda_v11 rocm_v6 cpu_avx2]
2024/01/26 09:54:34 gpu.go:93: INFO Detecting GPU type
2024/01/26 09:54:34 gpu.go:212: INFO Searching for GPU management library libnvidia-ml.so
2024/01/26 09:54:34 gpu.go:258: INFO Discovered GPU libraries: [/usr/lib/x86_64-linux-gnu/libnvidia-ml.so.545.29.06]
SIGSEGV: segmentation violation
PC=0x7180ec649a70 m=17 sigcode=1
signal arrived during cgo execution

goroutine 1 [syscall]:
runtime.cgocall(0x9b6eb0, 0xc0000e78a8)
/usr/local/go/src/runtime/cgocall.go:157 +0x4b fp=0xc0000e7880 sp=0xc0000e7848 pc=0x409b0b
github.com/jmorganca/ollama/gpu._Cfunc_cuda_init(0x7180f4000b70, 0xc000490500)
_cgo_gotypes.go:248 +0x3f fp=0xc0000e78a8 sp=0xc0000e7880 pc=0x7b9cdf
github.com/jmorganca/ollama/gpu.LoadCUDAMgmt.func2(0xc0000361d0?, 0x33?)
/go/src/github.com/jmorganca/ollama/gpu/gpu.go:268 +0x4a fp=0xc0000e78e8 sp=0xc0000e78a8 pc=0x7bbaca
github.com/jmorganca/ollama/gpu.LoadCUDAMgmt({0xc000036020, 0x1, 0xc0000d4370?})
/go/src/github.com/jmorganca/ollama/gpu/gpu.go:268 +0x1b8 fp=0xc0000e7988 sp=0xc0000e78e8 pc=0x7bb998
github.com/jmorganca/ollama/gpu.initGPUHandles()
/go/src/github.com/jmorganca/ollama/gpu/gpu.go:96 +0xd1 fp=0xc0000e79f0 sp=0xc0000e7988 pc=0x7ba131
github.com/jmorganca/ollama/gpu.GetGPUInfo()
/go/src/github.com/jmorganca/ollama/gpu/gpu.go:121 +0xb5 fp=0xc0000e7b00 sp=0xc0000e79f0 pc=0x7ba2f5
github.com/jmorganca/ollama/gpu.CheckVRAM()
/go/src/github.com/jmorganca/ollama/gpu/gpu.go:194 +0x1f fp=0xc0000e7ba8 sp=0xc0000e7b00 pc=0x7bafdf
github.com/jmorganca/ollama/server.Serve({0x106c11d0, 0xc0004615a0})
/go/src/github.com/jmorganca/ollama/server/routes.go:972 +0x453 fp=0xc0000e7c98 sp=0xc0000e7ba8 pc=0x99b513
github.com/jmorganca/ollama/cmd.RunServer(0xc00048e300?, {0x10b06800?, 0x4?, 0xad25c1?})
/go/src/github.com/jmorganca/ollama/cmd/cmd.go:692 +0x199 fp=0xc0000e7d30 sp=0xc0000e7c98 pc=0x9ad9f9
github.com/spf13/cobra.(*Command).execute(0xc000463800, {0x10b06800, 0x0, 0x0})
/root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:940 +0x87c fp=0xc0000e7e68 sp=0xc0000e7d30 pc=0x7641dc
github.com/spf13/cobra.(*Command).ExecuteC(0xc000462c00)
/root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:1068 +0x3a5 fp=0xc0000e7f20 sp=0xc0000e7e68 pc=0x764a05
github.com/spf13/cobra.(*Command).Execute(...)
/root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:992
github.com/spf13/cobra.(*Command).ExecuteContext(...)
/root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:985
main.main()
/go/src/github.com/jmorganca/ollama/main.go:11 +0x4d fp=0xc0000e7f40 sp=0xc0000e7f20 pc=0x9b5a2d
runtime.main()
/usr/local/go/src/runtime/proc.go:267 +0x2bb fp=0xc0000e7fe0 sp=0xc0000e7f40 pc=0x43e25b
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000e7fe8 sp=0xc0000e7fe0 pc=0x46e0a1

goroutine 2 [force gc (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000076fa8 sp=0xc000076f88 pc=0x43e6ae
runtime.goparkunlock(...)
/usr/local/go/src/runtime/proc.go:404
runtime.forcegchelper()
/usr/local/go/src/runtime/proc.go:322 +0xb3 fp=0xc000076fe0 sp=0xc000076fa8 pc=0x43e533
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000076fe8 sp=0xc000076fe0 pc=0x46e0a1
created by runtime.init.6 in goroutine 1
/usr/local/go/src/runtime/proc.go:310 +0x1a

goroutine 3 [GC sweep wait]:
runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000077778 sp=0xc000077758 pc=0x43e6ae
runtime.goparkunlock(...)
/usr/local/go/src/runtime/proc.go:404
runtime.bgsweep(0x0?)
/usr/local/go/src/runtime/mgcsweep.go:321 +0xdf fp=0xc0000777c8 sp=0xc000077778 pc=0x42a5ff
runtime.gcenable.func1()
/usr/local/go/src/runtime/mgc.go:200 +0x25 fp=0xc0000777e0 sp=0xc0000777c8 pc=0x41f725
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000777e8 sp=0xc0000777e0 pc=0x46e0a1
created by runtime.gcenable in goroutine 1
/usr/local/go/src/runtime/mgc.go:200 +0x66

goroutine 4 [GC scavenge wait]:
runtime.gopark(0x7ce6fb?, 0x6f7fe8?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000077f70 sp=0xc000077f50 pc=0x43e6ae
runtime.goparkunlock(...)
/usr/local/go/src/runtime/proc.go:404
runtime.(*scavengerState).park(0x10ad6b80)
/usr/local/go/src/runtime/mgcscavenge.go:425 +0x49 fp=0xc000077fa0 sp=0xc000077f70 pc=0x427e29
runtime.bgscavenge(0x0?)
/usr/local/go/src/runtime/mgcscavenge.go:658 +0x59 fp=0xc000077fc8 sp=0xc000077fa0 pc=0x4283d9
runtime.gcenable.func2()
/usr/local/go/src/runtime/mgc.go:201 +0x25 fp=0xc000077fe0 sp=0xc000077fc8 pc=0x41f6c5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000077fe8 sp=0xc000077fe0 pc=0x46e0a1
created by runtime.gcenable in goroutine 1
/usr/local/go/src/runtime/mgc.go:201 +0xa5

goroutine 5 [finalizer wait]:
runtime.gopark(0xacb580?, 0x10043f801?, 0x0?, 0x0?, 0x446865?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000076628 sp=0xc000076608 pc=0x43e6ae
runtime.runfinq()
/usr/local/go/src/runtime/mfinal.go:193 +0x107 fp=0xc0000767e0 sp=0xc000076628 pc=0x41e7a7
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000767e8 sp=0xc0000767e0 pc=0x46e0a1
created by runtime.createfing in goroutine 1
/usr/local/go/src/runtime/mfinal.go:163 +0x3d

goroutine 6 [select, locked to thread]:
runtime.gopark(0xc0000787a8?, 0x2?, 0x49?, 0xe9?, 0xc0000787a4?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000078638 sp=0xc000078618 pc=0x43e6ae
runtime.selectgo(0xc0000787a8, 0xc0000787a0, 0x0?, 0x0, 0x0?, 0x1)
/usr/local/go/src/runtime/select.go:327 +0x725 fp=0xc000078758 sp=0xc000078638 pc=0x44e1e5
runtime.ensureSigM.func1()
/usr/local/go/src/runtime/signal_unix.go:1014 +0x19f fp=0xc0000787e0 sp=0xc000078758 pc=0x46521f
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000787e8 sp=0xc0000787e0 pc=0x46e0a1
created by runtime.ensureSigM in goroutine 1
/usr/local/go/src/runtime/signal_unix.go:997 +0xc8

goroutine 18 [syscall]:
runtime.notetsleepg(0x0?, 0x0?)
/usr/local/go/src/runtime/lock_futex.go:236 +0x29 fp=0xc0000727a0 sp=0xc000072768 pc=0x411209
os/signal.signal_recv()
/usr/local/go/src/runtime/sigqueue.go:152 +0x29 fp=0xc0000727c0 sp=0xc0000727a0 pc=0x46aa69
os/signal.loop()
/usr/local/go/src/os/signal/signal_unix.go:23 +0x13 fp=0xc0000727e0 sp=0xc0000727c0 pc=0x6f3dd3
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000727e8 sp=0xc0000727e0 pc=0x46e0a1
created by os/signal.Notify.func1.1 in goroutine 1
/usr/local/go/src/os/signal/signal.go:151 +0x1f

goroutine 19 [chan receive]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000072f18 sp=0xc000072ef8 pc=0x43e6ae
runtime.chanrecv(0xc0001ad2c0, 0x0, 0x1)
/usr/local/go/src/runtime/chan.go:583 +0x3cd fp=0xc000072f90 sp=0xc000072f18 pc=0x40beed
runtime.chanrecv1(0x0?, 0x0?)
/usr/local/go/src/runtime/chan.go:442 +0x12 fp=0xc000072fb8 sp=0xc000072f90 pc=0x40baf2
github.com/jmorganca/ollama/server.Serve.func1()
/go/src/github.com/jmorganca/ollama/server/routes.go:959 +0x25 fp=0xc000072fe0 sp=0xc000072fb8 pc=0x99b5e5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000072fe8 sp=0xc000072fe0 pc=0x46e0a1
created by github.com/jmorganca/ollama/server.Serve in goroutine 1
/go/src/github.com/jmorganca/ollama/server/routes.go:958 +0x3f6

goroutine 20 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000073750 sp=0xc000073730 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000737e0 sp=0xc000073750 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000737e8 sp=0xc0000737e0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 21 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000073f50 sp=0xc000073f30 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000073fe0 sp=0xc000073f50 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000073fe8 sp=0xc000073fe0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 34 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000514750 sp=0xc000514730 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005147e0 sp=0xc000514750 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005147e8 sp=0xc0005147e0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 7 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000078f50 sp=0xc000078f30 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000078fe0 sp=0xc000078f50 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000078fe8 sp=0xc000078fe0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 22 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000074750 sp=0xc000074730 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000747e0 sp=0xc000074750 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000747e8 sp=0xc0000747e0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 23 [GC worker (idle)]:
runtime.gopark(0x63fd946caf31?, 0x1?, 0x1e?, 0x50?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000074f50 sp=0xc000074f30 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000074fe0 sp=0xc000074f50 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000074fe8 sp=0xc000074fe0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 24 [GC worker (idle)]:
runtime.gopark(0x63fd946ce20b?, 0x1?, 0x2d?, 0xf?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000075750 sp=0xc000075730 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000757e0 sp=0xc000075750 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000757e8 sp=0xc0000757e0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 35 [GC worker (idle)]:
runtime.gopark(0x63fd7654c30c?, 0x3?, 0x26?, 0x9?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000514f50 sp=0xc000514f30 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000514fe0 sp=0xc000514f50 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000514fe8 sp=0xc000514fe0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 36 [GC worker (idle)]:
runtime.gopark(0x63fd946c659e?, 0x3?, 0x69?, 0x3?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000515750 sp=0xc000515730 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005157e0 sp=0xc000515750 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005157e8 sp=0xc0005157e0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 37 [GC worker (idle)]:
runtime.gopark(0x63fd946ce5b0?, 0x1?, 0xd0?, 0xfb?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000515f50 sp=0xc000515f30 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000515fe0 sp=0xc000515f50 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000515fe8 sp=0xc000515fe0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 38 [GC worker (idle)]:
runtime.gopark(0x63fd946ccb86?, 0x1?, 0x90?, 0xf5?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000516750 sp=0xc000516730 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005167e0 sp=0xc000516750 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005167e8 sp=0xc0005167e0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 25 [GC worker (idle)]:
runtime.gopark(0x63fd5c3437c7?, 0x3?, 0x15?, 0x30?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000075f50 sp=0xc000075f30 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000075fe0 sp=0xc000075f50 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000075fe8 sp=0xc000075fe0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 26 [GC worker (idle)]:
runtime.gopark(0x63fd7654c109?, 0x1?, 0x34?, 0x7d?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000510750 sp=0xc000510730 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005107e0 sp=0xc000510750 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005107e8 sp=0xc0005107e0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 27 [GC worker (idle)]:
runtime.gopark(0x63fd946d1ce4?, 0x3?, 0xcb?, 0x32?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000510f50 sp=0xc000510f30 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000510fe0 sp=0xc000510f50 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000510fe8 sp=0xc000510fe0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 28 [GC worker (idle)]:
runtime.gopark(0x63fd7654c427?, 0x1?, 0x54?, 0xd5?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000511750 sp=0xc000511730 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005117e0 sp=0xc000511750 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005117e8 sp=0xc0005117e0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 29 [GC worker (idle)]:
runtime.gopark(0x63fd946ca944?, 0x1?, 0xd9?, 0x3f?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000511f50 sp=0xc000511f30 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000511fe0 sp=0xc000511f50 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000511fe8 sp=0xc000511fe0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 30 [GC worker (idle)]:
runtime.gopark(0x10b08520?, 0x1?, 0x10?, 0x2e?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000512750 sp=0xc000512730 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005127e0 sp=0xc000512750 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005127e8 sp=0xc0005127e0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 31 [GC worker (idle)]:
runtime.gopark(0x10b08520?, 0x1?, 0x70?, 0x37?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000512f50 sp=0xc000512f30 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000512fe0 sp=0xc000512f50 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000512fe8 sp=0xc000512fe0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 32 [GC worker (idle)]:
runtime.gopark(0x63fd946c66ea?, 0x3?, 0x80?, 0x40?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000513750 sp=0xc000513730 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005137e0 sp=0xc000513750 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005137e8 sp=0xc0005137e0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 33 [GC worker (idle)]:
runtime.gopark(0x63fd946c71ed?, 0x1?, 0xe1?, 0x2e?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000513f50 sp=0xc000513f30 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000513fe0 sp=0xc000513f50 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000513fe8 sp=0xc000513fe0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

rax 0x7180f4000bf0
rbx 0xc000490500
rcx 0x7180f4000030
rdx 0x1a
rdi 0x71810cff8b60
rsi 0x100
rbp 0x71810cff8d80
rsp 0x71810cff8b58
r8 0x0
r9 0x7180f4000bf0
r10 0x7180f40004b0
r11 0x7180f4000090
r12 0x9
r13 0x71810cff8d50
r14 0x71810cff8b60
r15 0x0
rip 0x7180ec649a70
rflags 0x10206
cs 0x33
fs 0x0
gs 0x0

Originally created by @hardik124 on GitHub (Jan 26, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/2198 Originally assigned to: @dhiltgen on GitHub. I installed ollama using one liner, and everytime i try to run ollama serve, i get the following error : hardik@pop-os:~/Downloads$ ollama serve 2024/01/26 09:54:31 images.go:857: INFO total blobs: 0 2024/01/26 09:54:31 images.go:864: INFO total unused blobs removed: 0 2024/01/26 09:54:31 routes.go:950: INFO Listening on 127.0.0.1:11434 (version 0.1.21) 2024/01/26 09:54:31 payload_common.go:106: INFO Extracting dynamic libraries... 2024/01/26 09:54:34 payload_common.go:145: INFO Dynamic LLM libraries [rocm_v5 cpu_avx cpu cuda_v11 rocm_v6 cpu_avx2] 2024/01/26 09:54:34 gpu.go:93: INFO Detecting GPU type 2024/01/26 09:54:34 gpu.go:212: INFO Searching for GPU management library libnvidia-ml.so 2024/01/26 09:54:34 gpu.go:258: INFO Discovered GPU libraries: [/usr/lib/x86_64-linux-gnu/libnvidia-ml.so.545.29.06] SIGSEGV: segmentation violation PC=0x7180ec649a70 m=17 sigcode=1 signal arrived during cgo execution goroutine 1 [syscall]: runtime.cgocall(0x9b6eb0, 0xc0000e78a8) /usr/local/go/src/runtime/cgocall.go:157 +0x4b fp=0xc0000e7880 sp=0xc0000e7848 pc=0x409b0b github.com/jmorganca/ollama/gpu._Cfunc_cuda_init(0x7180f4000b70, 0xc000490500) _cgo_gotypes.go:248 +0x3f fp=0xc0000e78a8 sp=0xc0000e7880 pc=0x7b9cdf github.com/jmorganca/ollama/gpu.LoadCUDAMgmt.func2(0xc0000361d0?, 0x33?) /go/src/github.com/jmorganca/ollama/gpu/gpu.go:268 +0x4a fp=0xc0000e78e8 sp=0xc0000e78a8 pc=0x7bbaca github.com/jmorganca/ollama/gpu.LoadCUDAMgmt({0xc000036020, 0x1, 0xc0000d4370?}) /go/src/github.com/jmorganca/ollama/gpu/gpu.go:268 +0x1b8 fp=0xc0000e7988 sp=0xc0000e78e8 pc=0x7bb998 github.com/jmorganca/ollama/gpu.initGPUHandles() /go/src/github.com/jmorganca/ollama/gpu/gpu.go:96 +0xd1 fp=0xc0000e79f0 sp=0xc0000e7988 pc=0x7ba131 github.com/jmorganca/ollama/gpu.GetGPUInfo() /go/src/github.com/jmorganca/ollama/gpu/gpu.go:121 +0xb5 fp=0xc0000e7b00 sp=0xc0000e79f0 pc=0x7ba2f5 github.com/jmorganca/ollama/gpu.CheckVRAM() /go/src/github.com/jmorganca/ollama/gpu/gpu.go:194 +0x1f fp=0xc0000e7ba8 sp=0xc0000e7b00 pc=0x7bafdf github.com/jmorganca/ollama/server.Serve({0x106c11d0, 0xc0004615a0}) /go/src/github.com/jmorganca/ollama/server/routes.go:972 +0x453 fp=0xc0000e7c98 sp=0xc0000e7ba8 pc=0x99b513 github.com/jmorganca/ollama/cmd.RunServer(0xc00048e300?, {0x10b06800?, 0x4?, 0xad25c1?}) /go/src/github.com/jmorganca/ollama/cmd/cmd.go:692 +0x199 fp=0xc0000e7d30 sp=0xc0000e7c98 pc=0x9ad9f9 github.com/spf13/cobra.(*Command).execute(0xc000463800, {0x10b06800, 0x0, 0x0}) /root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:940 +0x87c fp=0xc0000e7e68 sp=0xc0000e7d30 pc=0x7641dc github.com/spf13/cobra.(*Command).ExecuteC(0xc000462c00) /root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:1068 +0x3a5 fp=0xc0000e7f20 sp=0xc0000e7e68 pc=0x764a05 github.com/spf13/cobra.(*Command).Execute(...) /root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:992 github.com/spf13/cobra.(*Command).ExecuteContext(...) /root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:985 main.main() /go/src/github.com/jmorganca/ollama/main.go:11 +0x4d fp=0xc0000e7f40 sp=0xc0000e7f20 pc=0x9b5a2d runtime.main() /usr/local/go/src/runtime/proc.go:267 +0x2bb fp=0xc0000e7fe0 sp=0xc0000e7f40 pc=0x43e25b runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000e7fe8 sp=0xc0000e7fe0 pc=0x46e0a1 goroutine 2 [force gc (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000076fa8 sp=0xc000076f88 pc=0x43e6ae runtime.goparkunlock(...) /usr/local/go/src/runtime/proc.go:404 runtime.forcegchelper() /usr/local/go/src/runtime/proc.go:322 +0xb3 fp=0xc000076fe0 sp=0xc000076fa8 pc=0x43e533 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000076fe8 sp=0xc000076fe0 pc=0x46e0a1 created by runtime.init.6 in goroutine 1 /usr/local/go/src/runtime/proc.go:310 +0x1a goroutine 3 [GC sweep wait]: runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000077778 sp=0xc000077758 pc=0x43e6ae runtime.goparkunlock(...) /usr/local/go/src/runtime/proc.go:404 runtime.bgsweep(0x0?) /usr/local/go/src/runtime/mgcsweep.go:321 +0xdf fp=0xc0000777c8 sp=0xc000077778 pc=0x42a5ff runtime.gcenable.func1() /usr/local/go/src/runtime/mgc.go:200 +0x25 fp=0xc0000777e0 sp=0xc0000777c8 pc=0x41f725 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000777e8 sp=0xc0000777e0 pc=0x46e0a1 created by runtime.gcenable in goroutine 1 /usr/local/go/src/runtime/mgc.go:200 +0x66 goroutine 4 [GC scavenge wait]: runtime.gopark(0x7ce6fb?, 0x6f7fe8?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000077f70 sp=0xc000077f50 pc=0x43e6ae runtime.goparkunlock(...) /usr/local/go/src/runtime/proc.go:404 runtime.(*scavengerState).park(0x10ad6b80) /usr/local/go/src/runtime/mgcscavenge.go:425 +0x49 fp=0xc000077fa0 sp=0xc000077f70 pc=0x427e29 runtime.bgscavenge(0x0?) /usr/local/go/src/runtime/mgcscavenge.go:658 +0x59 fp=0xc000077fc8 sp=0xc000077fa0 pc=0x4283d9 runtime.gcenable.func2() /usr/local/go/src/runtime/mgc.go:201 +0x25 fp=0xc000077fe0 sp=0xc000077fc8 pc=0x41f6c5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000077fe8 sp=0xc000077fe0 pc=0x46e0a1 created by runtime.gcenable in goroutine 1 /usr/local/go/src/runtime/mgc.go:201 +0xa5 goroutine 5 [finalizer wait]: runtime.gopark(0xacb580?, 0x10043f801?, 0x0?, 0x0?, 0x446865?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000076628 sp=0xc000076608 pc=0x43e6ae runtime.runfinq() /usr/local/go/src/runtime/mfinal.go:193 +0x107 fp=0xc0000767e0 sp=0xc000076628 pc=0x41e7a7 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000767e8 sp=0xc0000767e0 pc=0x46e0a1 created by runtime.createfing in goroutine 1 /usr/local/go/src/runtime/mfinal.go:163 +0x3d goroutine 6 [select, locked to thread]: runtime.gopark(0xc0000787a8?, 0x2?, 0x49?, 0xe9?, 0xc0000787a4?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000078638 sp=0xc000078618 pc=0x43e6ae runtime.selectgo(0xc0000787a8, 0xc0000787a0, 0x0?, 0x0, 0x0?, 0x1) /usr/local/go/src/runtime/select.go:327 +0x725 fp=0xc000078758 sp=0xc000078638 pc=0x44e1e5 runtime.ensureSigM.func1() /usr/local/go/src/runtime/signal_unix.go:1014 +0x19f fp=0xc0000787e0 sp=0xc000078758 pc=0x46521f runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000787e8 sp=0xc0000787e0 pc=0x46e0a1 created by runtime.ensureSigM in goroutine 1 /usr/local/go/src/runtime/signal_unix.go:997 +0xc8 goroutine 18 [syscall]: runtime.notetsleepg(0x0?, 0x0?) /usr/local/go/src/runtime/lock_futex.go:236 +0x29 fp=0xc0000727a0 sp=0xc000072768 pc=0x411209 os/signal.signal_recv() /usr/local/go/src/runtime/sigqueue.go:152 +0x29 fp=0xc0000727c0 sp=0xc0000727a0 pc=0x46aa69 os/signal.loop() /usr/local/go/src/os/signal/signal_unix.go:23 +0x13 fp=0xc0000727e0 sp=0xc0000727c0 pc=0x6f3dd3 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000727e8 sp=0xc0000727e0 pc=0x46e0a1 created by os/signal.Notify.func1.1 in goroutine 1 /usr/local/go/src/os/signal/signal.go:151 +0x1f goroutine 19 [chan receive]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000072f18 sp=0xc000072ef8 pc=0x43e6ae runtime.chanrecv(0xc0001ad2c0, 0x0, 0x1) /usr/local/go/src/runtime/chan.go:583 +0x3cd fp=0xc000072f90 sp=0xc000072f18 pc=0x40beed runtime.chanrecv1(0x0?, 0x0?) /usr/local/go/src/runtime/chan.go:442 +0x12 fp=0xc000072fb8 sp=0xc000072f90 pc=0x40baf2 github.com/jmorganca/ollama/server.Serve.func1() /go/src/github.com/jmorganca/ollama/server/routes.go:959 +0x25 fp=0xc000072fe0 sp=0xc000072fb8 pc=0x99b5e5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000072fe8 sp=0xc000072fe0 pc=0x46e0a1 created by github.com/jmorganca/ollama/server.Serve in goroutine 1 /go/src/github.com/jmorganca/ollama/server/routes.go:958 +0x3f6 goroutine 20 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000073750 sp=0xc000073730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000737e0 sp=0xc000073750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000737e8 sp=0xc0000737e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 21 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000073f50 sp=0xc000073f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000073fe0 sp=0xc000073f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000073fe8 sp=0xc000073fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 34 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000514750 sp=0xc000514730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005147e0 sp=0xc000514750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005147e8 sp=0xc0005147e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 7 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000078f50 sp=0xc000078f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000078fe0 sp=0xc000078f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000078fe8 sp=0xc000078fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 22 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000074750 sp=0xc000074730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000747e0 sp=0xc000074750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000747e8 sp=0xc0000747e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 23 [GC worker (idle)]: runtime.gopark(0x63fd946caf31?, 0x1?, 0x1e?, 0x50?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000074f50 sp=0xc000074f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000074fe0 sp=0xc000074f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000074fe8 sp=0xc000074fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 24 [GC worker (idle)]: runtime.gopark(0x63fd946ce20b?, 0x1?, 0x2d?, 0xf?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000075750 sp=0xc000075730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000757e0 sp=0xc000075750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000757e8 sp=0xc0000757e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 35 [GC worker (idle)]: runtime.gopark(0x63fd7654c30c?, 0x3?, 0x26?, 0x9?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000514f50 sp=0xc000514f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000514fe0 sp=0xc000514f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000514fe8 sp=0xc000514fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 36 [GC worker (idle)]: runtime.gopark(0x63fd946c659e?, 0x3?, 0x69?, 0x3?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000515750 sp=0xc000515730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005157e0 sp=0xc000515750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005157e8 sp=0xc0005157e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 37 [GC worker (idle)]: runtime.gopark(0x63fd946ce5b0?, 0x1?, 0xd0?, 0xfb?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000515f50 sp=0xc000515f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000515fe0 sp=0xc000515f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000515fe8 sp=0xc000515fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 38 [GC worker (idle)]: runtime.gopark(0x63fd946ccb86?, 0x1?, 0x90?, 0xf5?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000516750 sp=0xc000516730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005167e0 sp=0xc000516750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005167e8 sp=0xc0005167e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 25 [GC worker (idle)]: runtime.gopark(0x63fd5c3437c7?, 0x3?, 0x15?, 0x30?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000075f50 sp=0xc000075f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000075fe0 sp=0xc000075f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000075fe8 sp=0xc000075fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 26 [GC worker (idle)]: runtime.gopark(0x63fd7654c109?, 0x1?, 0x34?, 0x7d?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000510750 sp=0xc000510730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005107e0 sp=0xc000510750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005107e8 sp=0xc0005107e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 27 [GC worker (idle)]: runtime.gopark(0x63fd946d1ce4?, 0x3?, 0xcb?, 0x32?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000510f50 sp=0xc000510f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000510fe0 sp=0xc000510f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000510fe8 sp=0xc000510fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 28 [GC worker (idle)]: runtime.gopark(0x63fd7654c427?, 0x1?, 0x54?, 0xd5?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000511750 sp=0xc000511730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005117e0 sp=0xc000511750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005117e8 sp=0xc0005117e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 29 [GC worker (idle)]: runtime.gopark(0x63fd946ca944?, 0x1?, 0xd9?, 0x3f?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000511f50 sp=0xc000511f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000511fe0 sp=0xc000511f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000511fe8 sp=0xc000511fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 30 [GC worker (idle)]: runtime.gopark(0x10b08520?, 0x1?, 0x10?, 0x2e?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000512750 sp=0xc000512730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005127e0 sp=0xc000512750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005127e8 sp=0xc0005127e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 31 [GC worker (idle)]: runtime.gopark(0x10b08520?, 0x1?, 0x70?, 0x37?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000512f50 sp=0xc000512f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000512fe0 sp=0xc000512f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000512fe8 sp=0xc000512fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 32 [GC worker (idle)]: runtime.gopark(0x63fd946c66ea?, 0x3?, 0x80?, 0x40?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000513750 sp=0xc000513730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005137e0 sp=0xc000513750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005137e8 sp=0xc0005137e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 33 [GC worker (idle)]: runtime.gopark(0x63fd946c71ed?, 0x1?, 0xe1?, 0x2e?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000513f50 sp=0xc000513f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000513fe0 sp=0xc000513f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000513fe8 sp=0xc000513fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c rax 0x7180f4000bf0 rbx 0xc000490500 rcx 0x7180f4000030 rdx 0x1a rdi 0x71810cff8b60 rsi 0x100 rbp 0x71810cff8d80 rsp 0x71810cff8b58 r8 0x0 r9 0x7180f4000bf0 r10 0x7180f40004b0 r11 0x7180f4000090 r12 0x9 r13 0x71810cff8d50 r14 0x71810cff8b60 r15 0x0 rip 0x7180ec649a70 rflags 0x10206 cs 0x33 fs 0x0 gs 0x0
GiteaMirror added the bug label 2026-05-03 12:53:32 -05:00
GiteaMirror commented 2026-05-03 12:53:49 -05:00
Author
Owner
Copy Link

@aprelmaprel commented on GitHub (Jan 26, 2024):

I installed ollama using one liner, and everytime i try to run ollama serve, i get the following error :

hardik@pop-os:~/Downloads$ ollama serve 2024/01/26 09:54:31 images.go:857: INFO total blobs: 0 2024/01/26 09:54:31 images.go:864: INFO total unused blobs removed: 0 2024/01/26 09:54:31 routes.go:950: INFO Listening on 127.0.0.1:11434 (version 0.1.21) 2024/01/26 09:54:31 payload_common.go:106: INFO Extracting dynamic libraries... 2024/01/26 09:54:34 payload_common.go:145: INFO Dynamic LLM libraries [rocm_v5 cpu_avx cpu cuda_v11 rocm_v6 cpu_avx2] 2024/01/26 09:54:34 gpu.go:93: INFO Detecting GPU type 2024/01/26 09:54:34 gpu.go:212: INFO Searching for GPU management library libnvidia-ml.so 2024/01/26 09:54:34 gpu.go:258: INFO Discovered GPU libraries: [/usr/lib/x86_64-linux-gnu/libnvidia-ml.so.545.29.06] SIGSEGV: segmentation violation PC=0x7180ec649a70 m=17 sigcode=1 signal arrived during cgo execution

goroutine 1 [syscall]: runtime.cgocall(0x9b6eb0, 0xc0000e78a8) /usr/local/go/src/runtime/cgocall.go:157 +0x4b fp=0xc0000e7880 sp=0xc0000e7848 pc=0x409b0b github.com/jmorganca/ollama/gpu._Cfunc_cuda_init(0x7180f4000b70, 0xc000490500) _cgo_gotypes.go:248 +0x3f fp=0xc0000e78a8 sp=0xc0000e7880 pc=0x7b9cdf github.com/jmorganca/ollama/gpu.LoadCUDAMgmt.func2(0xc0000361d0?, 0x33?) /go/src/github.com/jmorganca/ollama/gpu/gpu.go:268 +0x4a fp=0xc0000e78e8 sp=0xc0000e78a8 pc=0x7bbaca github.com/jmorganca/ollama/gpu.LoadCUDAMgmt({0xc000036020, 0x1, 0xc0000d4370?}) /go/src/github.com/jmorganca/ollama/gpu/gpu.go:268 +0x1b8 fp=0xc0000e7988 sp=0xc0000e78e8 pc=0x7bb998 github.com/jmorganca/ollama/gpu.initGPUHandles() /go/src/github.com/jmorganca/ollama/gpu/gpu.go:96 +0xd1 fp=0xc0000e79f0 sp=0xc0000e7988 pc=0x7ba131 github.com/jmorganca/ollama/gpu.GetGPUInfo() /go/src/github.com/jmorganca/ollama/gpu/gpu.go:121 +0xb5 fp=0xc0000e7b00 sp=0xc0000e79f0 pc=0x7ba2f5 github.com/jmorganca/ollama/gpu.CheckVRAM() /go/src/github.com/jmorganca/ollama/gpu/gpu.go:194 +0x1f fp=0xc0000e7ba8 sp=0xc0000e7b00 pc=0x7bafdf github.com/jmorganca/ollama/server.Serve({0x106c11d0, 0xc0004615a0}) /go/src/github.com/jmorganca/ollama/server/routes.go:972 +0x453 fp=0xc0000e7c98 sp=0xc0000e7ba8 pc=0x99b513 github.com/jmorganca/ollama/cmd.RunServer(0xc00048e300?, {0x10b06800?, 0x4?, 0xad25c1?}) /go/src/github.com/jmorganca/ollama/cmd/cmd.go:692 +0x199 fp=0xc0000e7d30 sp=0xc0000e7c98 pc=0x9ad9f9 github.com/spf13/cobra.(*Command).execute(0xc000463800, {0x10b06800, 0x0, 0x0}) /root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:940 +0x87c fp=0xc0000e7e68 sp=0xc0000e7d30 pc=0x7641dc github.com/spf13/cobra.(*Command).ExecuteC(0xc000462c00) /root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:1068 +0x3a5 fp=0xc0000e7f20 sp=0xc0000e7e68 pc=0x764a05 github.com/spf13/cobra.(*Command).Execute(...) /root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:992 github.com/spf13/cobra.(*Command).ExecuteContext(...) /root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:985 main.main() /go/src/github.com/jmorganca/ollama/main.go:11 +0x4d fp=0xc0000e7f40 sp=0xc0000e7f20 pc=0x9b5a2d runtime.main() /usr/local/go/src/runtime/proc.go:267 +0x2bb fp=0xc0000e7fe0 sp=0xc0000e7f40 pc=0x43e25b runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000e7fe8 sp=0xc0000e7fe0 pc=0x46e0a1

goroutine 2 [force gc (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000076fa8 sp=0xc000076f88 pc=0x43e6ae runtime.goparkunlock(...) /usr/local/go/src/runtime/proc.go:404 runtime.forcegchelper() /usr/local/go/src/runtime/proc.go:322 +0xb3 fp=0xc000076fe0 sp=0xc000076fa8 pc=0x43e533 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000076fe8 sp=0xc000076fe0 pc=0x46e0a1 created by runtime.init.6 in goroutine 1 /usr/local/go/src/runtime/proc.go:310 +0x1a

goroutine 3 [GC sweep wait]: runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000077778 sp=0xc000077758 pc=0x43e6ae runtime.goparkunlock(...) /usr/local/go/src/runtime/proc.go:404 runtime.bgsweep(0x0?) /usr/local/go/src/runtime/mgcsweep.go:321 +0xdf fp=0xc0000777c8 sp=0xc000077778 pc=0x42a5ff runtime.gcenable.func1() /usr/local/go/src/runtime/mgc.go:200 +0x25 fp=0xc0000777e0 sp=0xc0000777c8 pc=0x41f725 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000777e8 sp=0xc0000777e0 pc=0x46e0a1 created by runtime.gcenable in goroutine 1 /usr/local/go/src/runtime/mgc.go:200 +0x66

goroutine 4 [GC scavenge wait]: runtime.gopark(0x7ce6fb?, 0x6f7fe8?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000077f70 sp=0xc000077f50 pc=0x43e6ae runtime.goparkunlock(...) /usr/local/go/src/runtime/proc.go:404 runtime.(*scavengerState).park(0x10ad6b80) /usr/local/go/src/runtime/mgcscavenge.go:425 +0x49 fp=0xc000077fa0 sp=0xc000077f70 pc=0x427e29 runtime.bgscavenge(0x0?) /usr/local/go/src/runtime/mgcscavenge.go:658 +0x59 fp=0xc000077fc8 sp=0xc000077fa0 pc=0x4283d9 runtime.gcenable.func2() /usr/local/go/src/runtime/mgc.go:201 +0x25 fp=0xc000077fe0 sp=0xc000077fc8 pc=0x41f6c5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000077fe8 sp=0xc000077fe0 pc=0x46e0a1 created by runtime.gcenable in goroutine 1 /usr/local/go/src/runtime/mgc.go:201 +0xa5

goroutine 5 [finalizer wait]: runtime.gopark(0xacb580?, 0x10043f801?, 0x0?, 0x0?, 0x446865?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000076628 sp=0xc000076608 pc=0x43e6ae runtime.runfinq() /usr/local/go/src/runtime/mfinal.go:193 +0x107 fp=0xc0000767e0 sp=0xc000076628 pc=0x41e7a7 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000767e8 sp=0xc0000767e0 pc=0x46e0a1 created by runtime.createfing in goroutine 1 /usr/local/go/src/runtime/mfinal.go:163 +0x3d

goroutine 6 [select, locked to thread]: runtime.gopark(0xc0000787a8?, 0x2?, 0x49?, 0xe9?, 0xc0000787a4?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000078638 sp=0xc000078618 pc=0x43e6ae runtime.selectgo(0xc0000787a8, 0xc0000787a0, 0x0?, 0x0, 0x0?, 0x1) /usr/local/go/src/runtime/select.go:327 +0x725 fp=0xc000078758 sp=0xc000078638 pc=0x44e1e5 runtime.ensureSigM.func1() /usr/local/go/src/runtime/signal_unix.go:1014 +0x19f fp=0xc0000787e0 sp=0xc000078758 pc=0x46521f runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000787e8 sp=0xc0000787e0 pc=0x46e0a1 created by runtime.ensureSigM in goroutine 1 /usr/local/go/src/runtime/signal_unix.go:997 +0xc8

goroutine 18 [syscall]: runtime.notetsleepg(0x0?, 0x0?) /usr/local/go/src/runtime/lock_futex.go:236 +0x29 fp=0xc0000727a0 sp=0xc000072768 pc=0x411209 os/signal.signal_recv() /usr/local/go/src/runtime/sigqueue.go:152 +0x29 fp=0xc0000727c0 sp=0xc0000727a0 pc=0x46aa69 os/signal.loop() /usr/local/go/src/os/signal/signal_unix.go:23 +0x13 fp=0xc0000727e0 sp=0xc0000727c0 pc=0x6f3dd3 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000727e8 sp=0xc0000727e0 pc=0x46e0a1 created by os/signal.Notify.func1.1 in goroutine 1 /usr/local/go/src/os/signal/signal.go:151 +0x1f

goroutine 19 [chan receive]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000072f18 sp=0xc000072ef8 pc=0x43e6ae runtime.chanrecv(0xc0001ad2c0, 0x0, 0x1) /usr/local/go/src/runtime/chan.go:583 +0x3cd fp=0xc000072f90 sp=0xc000072f18 pc=0x40beed runtime.chanrecv1(0x0?, 0x0?) /usr/local/go/src/runtime/chan.go:442 +0x12 fp=0xc000072fb8 sp=0xc000072f90 pc=0x40baf2 github.com/jmorganca/ollama/server.Serve.func1() /go/src/github.com/jmorganca/ollama/server/routes.go:959 +0x25 fp=0xc000072fe0 sp=0xc000072fb8 pc=0x99b5e5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000072fe8 sp=0xc000072fe0 pc=0x46e0a1 created by github.com/jmorganca/ollama/server.Serve in goroutine 1 /go/src/github.com/jmorganca/ollama/server/routes.go:958 +0x3f6

goroutine 20 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000073750 sp=0xc000073730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000737e0 sp=0xc000073750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000737e8 sp=0xc0000737e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 21 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000073f50 sp=0xc000073f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000073fe0 sp=0xc000073f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000073fe8 sp=0xc000073fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 34 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000514750 sp=0xc000514730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005147e0 sp=0xc000514750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005147e8 sp=0xc0005147e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 7 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000078f50 sp=0xc000078f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000078fe0 sp=0xc000078f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000078fe8 sp=0xc000078fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 22 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000074750 sp=0xc000074730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000747e0 sp=0xc000074750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000747e8 sp=0xc0000747e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 23 [GC worker (idle)]: runtime.gopark(0x63fd946caf31?, 0x1?, 0x1e?, 0x50?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000074f50 sp=0xc000074f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000074fe0 sp=0xc000074f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000074fe8 sp=0xc000074fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 24 [GC worker (idle)]: runtime.gopark(0x63fd946ce20b?, 0x1?, 0x2d?, 0xf?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000075750 sp=0xc000075730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000757e0 sp=0xc000075750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000757e8 sp=0xc0000757e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 35 [GC worker (idle)]: runtime.gopark(0x63fd7654c30c?, 0x3?, 0x26?, 0x9?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000514f50 sp=0xc000514f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000514fe0 sp=0xc000514f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000514fe8 sp=0xc000514fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 36 [GC worker (idle)]: runtime.gopark(0x63fd946c659e?, 0x3?, 0x69?, 0x3?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000515750 sp=0xc000515730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005157e0 sp=0xc000515750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005157e8 sp=0xc0005157e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 37 [GC worker (idle)]: runtime.gopark(0x63fd946ce5b0?, 0x1?, 0xd0?, 0xfb?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000515f50 sp=0xc000515f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000515fe0 sp=0xc000515f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000515fe8 sp=0xc000515fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 38 [GC worker (idle)]: runtime.gopark(0x63fd946ccb86?, 0x1?, 0x90?, 0xf5?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000516750 sp=0xc000516730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005167e0 sp=0xc000516750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005167e8 sp=0xc0005167e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 25 [GC worker (idle)]: runtime.gopark(0x63fd5c3437c7?, 0x3?, 0x15?, 0x30?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000075f50 sp=0xc000075f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000075fe0 sp=0xc000075f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000075fe8 sp=0xc000075fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 26 [GC worker (idle)]: runtime.gopark(0x63fd7654c109?, 0x1?, 0x34?, 0x7d?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000510750 sp=0xc000510730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005107e0 sp=0xc000510750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005107e8 sp=0xc0005107e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 27 [GC worker (idle)]: runtime.gopark(0x63fd946d1ce4?, 0x3?, 0xcb?, 0x32?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000510f50 sp=0xc000510f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000510fe0 sp=0xc000510f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000510fe8 sp=0xc000510fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 28 [GC worker (idle)]: runtime.gopark(0x63fd7654c427?, 0x1?, 0x54?, 0xd5?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000511750 sp=0xc000511730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005117e0 sp=0xc000511750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005117e8 sp=0xc0005117e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 29 [GC worker (idle)]: runtime.gopark(0x63fd946ca944?, 0x1?, 0xd9?, 0x3f?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000511f50 sp=0xc000511f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000511fe0 sp=0xc000511f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000511fe8 sp=0xc000511fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 30 [GC worker (idle)]: runtime.gopark(0x10b08520?, 0x1?, 0x10?, 0x2e?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000512750 sp=0xc000512730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005127e0 sp=0xc000512750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005127e8 sp=0xc0005127e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 31 [GC worker (idle)]: runtime.gopark(0x10b08520?, 0x1?, 0x70?, 0x37?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000512f50 sp=0xc000512f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000512fe0 sp=0xc000512f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000512fe8 sp=0xc000512fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 32 [GC worker (idle)]: runtime.gopark(0x63fd946c66ea?, 0x3?, 0x80?, 0x40?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000513750 sp=0xc000513730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005137e0 sp=0xc000513750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005137e8 sp=0xc0005137e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 33 [GC worker (idle)]: runtime.gopark(0x63fd946c71ed?, 0x1?, 0xe1?, 0x2e?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000513f50 sp=0xc000513f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000513fe0 sp=0xc000513f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000513fe8 sp=0xc000513fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c

rax 0x7180f4000bf0 rbx 0xc000490500 rcx 0x7180f4000030 rdx 0x1a rdi 0x71810cff8b60 rsi 0x100 rbp 0x71810cff8d80 rsp 0x71810cff8b58 r8 0x0 r9 0x7180f4000bf0 r10 0x7180f40004b0 r11 0x7180f4000090 r12 0x9 r13 0x71810cff8d50 r14 0x71810cff8b60 r15 0x0 rip 0x7180ec649a70 rflags 0x10206 cs 0x33 fs 0x0 gs 0x0

Same here

<!-- gh-comment-id:1911549566 --> @aprelmaprel commented on GitHub (Jan 26, 2024): > I installed ollama using one liner, and everytime i try to run ollama serve, i get the following error : > > hardik@pop-os:~/Downloads$ ollama serve 2024/01/26 09:54:31 images.go:857: INFO total blobs: 0 2024/01/26 09:54:31 images.go:864: INFO total unused blobs removed: 0 2024/01/26 09:54:31 routes.go:950: INFO Listening on 127.0.0.1:11434 (version 0.1.21) 2024/01/26 09:54:31 payload_common.go:106: INFO Extracting dynamic libraries... 2024/01/26 09:54:34 payload_common.go:145: INFO Dynamic LLM libraries [rocm_v5 cpu_avx cpu cuda_v11 rocm_v6 cpu_avx2] 2024/01/26 09:54:34 gpu.go:93: INFO Detecting GPU type 2024/01/26 09:54:34 gpu.go:212: INFO Searching for GPU management library libnvidia-ml.so 2024/01/26 09:54:34 gpu.go:258: INFO Discovered GPU libraries: [/usr/lib/x86_64-linux-gnu/libnvidia-ml.so.545.29.06] SIGSEGV: segmentation violation PC=0x7180ec649a70 m=17 sigcode=1 signal arrived during cgo execution > > goroutine 1 [syscall]: runtime.cgocall(0x9b6eb0, 0xc0000e78a8) /usr/local/go/src/runtime/cgocall.go:157 +0x4b fp=0xc0000e7880 sp=0xc0000e7848 pc=0x409b0b github.com/jmorganca/ollama/gpu._Cfunc_cuda_init(0x7180f4000b70, 0xc000490500) _cgo_gotypes.go:248 +0x3f fp=0xc0000e78a8 sp=0xc0000e7880 pc=0x7b9cdf github.com/jmorganca/ollama/gpu.LoadCUDAMgmt.func2(0xc0000361d0?, 0x33?) /go/src/github.com/jmorganca/ollama/gpu/gpu.go:268 +0x4a fp=0xc0000e78e8 sp=0xc0000e78a8 pc=0x7bbaca github.com/jmorganca/ollama/gpu.LoadCUDAMgmt({0xc000036020, 0x1, 0xc0000d4370?}) /go/src/github.com/jmorganca/ollama/gpu/gpu.go:268 +0x1b8 fp=0xc0000e7988 sp=0xc0000e78e8 pc=0x7bb998 github.com/jmorganca/ollama/gpu.initGPUHandles() /go/src/github.com/jmorganca/ollama/gpu/gpu.go:96 +0xd1 fp=0xc0000e79f0 sp=0xc0000e7988 pc=0x7ba131 github.com/jmorganca/ollama/gpu.GetGPUInfo() /go/src/github.com/jmorganca/ollama/gpu/gpu.go:121 +0xb5 fp=0xc0000e7b00 sp=0xc0000e79f0 pc=0x7ba2f5 github.com/jmorganca/ollama/gpu.CheckVRAM() /go/src/github.com/jmorganca/ollama/gpu/gpu.go:194 +0x1f fp=0xc0000e7ba8 sp=0xc0000e7b00 pc=0x7bafdf github.com/jmorganca/ollama/server.Serve({0x106c11d0, 0xc0004615a0}) /go/src/github.com/jmorganca/ollama/server/routes.go:972 +0x453 fp=0xc0000e7c98 sp=0xc0000e7ba8 pc=0x99b513 github.com/jmorganca/ollama/cmd.RunServer(0xc00048e300?, {0x10b06800?, 0x4?, 0xad25c1?}) /go/src/github.com/jmorganca/ollama/cmd/cmd.go:692 +0x199 fp=0xc0000e7d30 sp=0xc0000e7c98 pc=0x9ad9f9 github.com/spf13/cobra.(*Command).execute(0xc000463800, {0x10b06800, 0x0, 0x0}) /root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:940 +0x87c fp=0xc0000e7e68 sp=0xc0000e7d30 pc=0x7641dc github.com/spf13/cobra.(*Command).ExecuteC(0xc000462c00) /root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:1068 +0x3a5 fp=0xc0000e7f20 sp=0xc0000e7e68 pc=0x764a05 github.com/spf13/cobra.(*Command).Execute(...) /root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:992 github.com/spf13/cobra.(*Command).ExecuteContext(...) /root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:985 main.main() /go/src/github.com/jmorganca/ollama/main.go:11 +0x4d fp=0xc0000e7f40 sp=0xc0000e7f20 pc=0x9b5a2d runtime.main() /usr/local/go/src/runtime/proc.go:267 +0x2bb fp=0xc0000e7fe0 sp=0xc0000e7f40 pc=0x43e25b runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000e7fe8 sp=0xc0000e7fe0 pc=0x46e0a1 > > goroutine 2 [force gc (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000076fa8 sp=0xc000076f88 pc=0x43e6ae runtime.goparkunlock(...) /usr/local/go/src/runtime/proc.go:404 runtime.forcegchelper() /usr/local/go/src/runtime/proc.go:322 +0xb3 fp=0xc000076fe0 sp=0xc000076fa8 pc=0x43e533 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000076fe8 sp=0xc000076fe0 pc=0x46e0a1 created by runtime.init.6 in goroutine 1 /usr/local/go/src/runtime/proc.go:310 +0x1a > > goroutine 3 [GC sweep wait]: runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000077778 sp=0xc000077758 pc=0x43e6ae runtime.goparkunlock(...) /usr/local/go/src/runtime/proc.go:404 runtime.bgsweep(0x0?) /usr/local/go/src/runtime/mgcsweep.go:321 +0xdf fp=0xc0000777c8 sp=0xc000077778 pc=0x42a5ff runtime.gcenable.func1() /usr/local/go/src/runtime/mgc.go:200 +0x25 fp=0xc0000777e0 sp=0xc0000777c8 pc=0x41f725 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000777e8 sp=0xc0000777e0 pc=0x46e0a1 created by runtime.gcenable in goroutine 1 /usr/local/go/src/runtime/mgc.go:200 +0x66 > > goroutine 4 [GC scavenge wait]: runtime.gopark(0x7ce6fb?, 0x6f7fe8?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000077f70 sp=0xc000077f50 pc=0x43e6ae runtime.goparkunlock(...) /usr/local/go/src/runtime/proc.go:404 runtime.(*scavengerState).park(0x10ad6b80) /usr/local/go/src/runtime/mgcscavenge.go:425 +0x49 fp=0xc000077fa0 sp=0xc000077f70 pc=0x427e29 runtime.bgscavenge(0x0?) /usr/local/go/src/runtime/mgcscavenge.go:658 +0x59 fp=0xc000077fc8 sp=0xc000077fa0 pc=0x4283d9 runtime.gcenable.func2() /usr/local/go/src/runtime/mgc.go:201 +0x25 fp=0xc000077fe0 sp=0xc000077fc8 pc=0x41f6c5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000077fe8 sp=0xc000077fe0 pc=0x46e0a1 created by runtime.gcenable in goroutine 1 /usr/local/go/src/runtime/mgc.go:201 +0xa5 > > goroutine 5 [finalizer wait]: runtime.gopark(0xacb580?, 0x10043f801?, 0x0?, 0x0?, 0x446865?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000076628 sp=0xc000076608 pc=0x43e6ae runtime.runfinq() /usr/local/go/src/runtime/mfinal.go:193 +0x107 fp=0xc0000767e0 sp=0xc000076628 pc=0x41e7a7 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000767e8 sp=0xc0000767e0 pc=0x46e0a1 created by runtime.createfing in goroutine 1 /usr/local/go/src/runtime/mfinal.go:163 +0x3d > > goroutine 6 [select, locked to thread]: runtime.gopark(0xc0000787a8?, 0x2?, 0x49?, 0xe9?, 0xc0000787a4?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000078638 sp=0xc000078618 pc=0x43e6ae runtime.selectgo(0xc0000787a8, 0xc0000787a0, 0x0?, 0x0, 0x0?, 0x1) /usr/local/go/src/runtime/select.go:327 +0x725 fp=0xc000078758 sp=0xc000078638 pc=0x44e1e5 runtime.ensureSigM.func1() /usr/local/go/src/runtime/signal_unix.go:1014 +0x19f fp=0xc0000787e0 sp=0xc000078758 pc=0x46521f runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000787e8 sp=0xc0000787e0 pc=0x46e0a1 created by runtime.ensureSigM in goroutine 1 /usr/local/go/src/runtime/signal_unix.go:997 +0xc8 > > goroutine 18 [syscall]: runtime.notetsleepg(0x0?, 0x0?) /usr/local/go/src/runtime/lock_futex.go:236 +0x29 fp=0xc0000727a0 sp=0xc000072768 pc=0x411209 os/signal.signal_recv() /usr/local/go/src/runtime/sigqueue.go:152 +0x29 fp=0xc0000727c0 sp=0xc0000727a0 pc=0x46aa69 os/signal.loop() /usr/local/go/src/os/signal/signal_unix.go:23 +0x13 fp=0xc0000727e0 sp=0xc0000727c0 pc=0x6f3dd3 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000727e8 sp=0xc0000727e0 pc=0x46e0a1 created by os/signal.Notify.func1.1 in goroutine 1 /usr/local/go/src/os/signal/signal.go:151 +0x1f > > goroutine 19 [chan receive]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000072f18 sp=0xc000072ef8 pc=0x43e6ae runtime.chanrecv(0xc0001ad2c0, 0x0, 0x1) /usr/local/go/src/runtime/chan.go:583 +0x3cd fp=0xc000072f90 sp=0xc000072f18 pc=0x40beed runtime.chanrecv1(0x0?, 0x0?) /usr/local/go/src/runtime/chan.go:442 +0x12 fp=0xc000072fb8 sp=0xc000072f90 pc=0x40baf2 github.com/jmorganca/ollama/server.Serve.func1() /go/src/github.com/jmorganca/ollama/server/routes.go:959 +0x25 fp=0xc000072fe0 sp=0xc000072fb8 pc=0x99b5e5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000072fe8 sp=0xc000072fe0 pc=0x46e0a1 created by github.com/jmorganca/ollama/server.Serve in goroutine 1 /go/src/github.com/jmorganca/ollama/server/routes.go:958 +0x3f6 > > goroutine 20 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000073750 sp=0xc000073730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000737e0 sp=0xc000073750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000737e8 sp=0xc0000737e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c > > goroutine 21 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000073f50 sp=0xc000073f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000073fe0 sp=0xc000073f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000073fe8 sp=0xc000073fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c > > goroutine 34 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000514750 sp=0xc000514730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005147e0 sp=0xc000514750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005147e8 sp=0xc0005147e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c > > goroutine 7 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000078f50 sp=0xc000078f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000078fe0 sp=0xc000078f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000078fe8 sp=0xc000078fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c > > goroutine 22 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000074750 sp=0xc000074730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000747e0 sp=0xc000074750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000747e8 sp=0xc0000747e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c > > goroutine 23 [GC worker (idle)]: runtime.gopark(0x63fd946caf31?, 0x1?, 0x1e?, 0x50?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000074f50 sp=0xc000074f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000074fe0 sp=0xc000074f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000074fe8 sp=0xc000074fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c > > goroutine 24 [GC worker (idle)]: runtime.gopark(0x63fd946ce20b?, 0x1?, 0x2d?, 0xf?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000075750 sp=0xc000075730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000757e0 sp=0xc000075750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000757e8 sp=0xc0000757e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c > > goroutine 35 [GC worker (idle)]: runtime.gopark(0x63fd7654c30c?, 0x3?, 0x26?, 0x9?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000514f50 sp=0xc000514f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000514fe0 sp=0xc000514f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000514fe8 sp=0xc000514fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c > > goroutine 36 [GC worker (idle)]: runtime.gopark(0x63fd946c659e?, 0x3?, 0x69?, 0x3?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000515750 sp=0xc000515730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005157e0 sp=0xc000515750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005157e8 sp=0xc0005157e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c > > goroutine 37 [GC worker (idle)]: runtime.gopark(0x63fd946ce5b0?, 0x1?, 0xd0?, 0xfb?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000515f50 sp=0xc000515f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000515fe0 sp=0xc000515f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000515fe8 sp=0xc000515fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c > > goroutine 38 [GC worker (idle)]: runtime.gopark(0x63fd946ccb86?, 0x1?, 0x90?, 0xf5?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000516750 sp=0xc000516730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005167e0 sp=0xc000516750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005167e8 sp=0xc0005167e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c > > goroutine 25 [GC worker (idle)]: runtime.gopark(0x63fd5c3437c7?, 0x3?, 0x15?, 0x30?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000075f50 sp=0xc000075f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000075fe0 sp=0xc000075f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000075fe8 sp=0xc000075fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c > > goroutine 26 [GC worker (idle)]: runtime.gopark(0x63fd7654c109?, 0x1?, 0x34?, 0x7d?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000510750 sp=0xc000510730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005107e0 sp=0xc000510750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005107e8 sp=0xc0005107e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c > > goroutine 27 [GC worker (idle)]: runtime.gopark(0x63fd946d1ce4?, 0x3?, 0xcb?, 0x32?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000510f50 sp=0xc000510f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000510fe0 sp=0xc000510f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000510fe8 sp=0xc000510fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c > > goroutine 28 [GC worker (idle)]: runtime.gopark(0x63fd7654c427?, 0x1?, 0x54?, 0xd5?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000511750 sp=0xc000511730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005117e0 sp=0xc000511750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005117e8 sp=0xc0005117e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c > > goroutine 29 [GC worker (idle)]: runtime.gopark(0x63fd946ca944?, 0x1?, 0xd9?, 0x3f?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000511f50 sp=0xc000511f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000511fe0 sp=0xc000511f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000511fe8 sp=0xc000511fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c > > goroutine 30 [GC worker (idle)]: runtime.gopark(0x10b08520?, 0x1?, 0x10?, 0x2e?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000512750 sp=0xc000512730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005127e0 sp=0xc000512750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005127e8 sp=0xc0005127e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c > > goroutine 31 [GC worker (idle)]: runtime.gopark(0x10b08520?, 0x1?, 0x70?, 0x37?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000512f50 sp=0xc000512f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000512fe0 sp=0xc000512f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000512fe8 sp=0xc000512fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c > > goroutine 32 [GC worker (idle)]: runtime.gopark(0x63fd946c66ea?, 0x3?, 0x80?, 0x40?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000513750 sp=0xc000513730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005137e0 sp=0xc000513750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005137e8 sp=0xc0005137e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c > > goroutine 33 [GC worker (idle)]: runtime.gopark(0x63fd946c71ed?, 0x1?, 0xe1?, 0x2e?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000513f50 sp=0xc000513f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000513fe0 sp=0xc000513f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000513fe8 sp=0xc000513fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c > > rax 0x7180f4000bf0 rbx 0xc000490500 rcx 0x7180f4000030 rdx 0x1a rdi 0x71810cff8b60 rsi 0x100 rbp 0x71810cff8d80 rsp 0x71810cff8b58 r8 0x0 r9 0x7180f4000bf0 r10 0x7180f40004b0 r11 0x7180f4000090 r12 0x9 r13 0x71810cff8d50 r14 0x71810cff8b60 r15 0x0 rip 0x7180ec649a70 rflags 0x10206 cs 0x33 fs 0x0 gs 0x0 Same here
GiteaMirror commented 2026-05-03 12:53:50 -05:00
Author
Owner
Copy Link

@constra commented on GitHub (Jan 26, 2024):

same here
`2024/01/26 09:32:54 images.go:857: INFO total blobs: 0
2024/01/26 09:32:54 images.go:864: INFO total unused blobs removed: 0
2024/01/26 09:32:54 routes.go:950: INFO Listening on 127.0.0.1:11434 (version 0.1.21)
2024/01/26 09:32:54 payload_common.go:106: INFO Extracting dynamic libraries...
2024/01/26 09:32:58 payload_common.go:145: INFO Dynamic LLM libraries [cpu_avx2 cpu cuda_v11 cpu_avx rocm_v5 rocm_v6]
2024/01/26 09:32:58 gpu.go:93: INFO Detecting GPU type
2024/01/26 09:32:58 gpu.go:212: INFO Searching for GPU management library libnvidia-ml.so
2024/01/26 09:32:58 gpu.go:258: INFO Discovered GPU libraries: [/usr/lib64/libnvidia-ml.so.545.23.08]
SIGSEGV: segmentation violation
PC=0x7fdea683ca70 m=4 sigcode=1
signal arrived during cgo execution

goroutine 1 [syscall]:
runtime.cgocall(0x9b6eb0, 0xc0003838a8)
/usr/local/go/src/runtime/cgocall.go:157 +0x4b fp=0xc000383880 sp=0xc000383848 pc=0x409b0b
github.com/jmorganca/ollama/gpu._Cfunc_cuda_init(0x7fded8000f60, 0xc0001a6400)
_cgo_gotypes.go:248 +0x3f fp=0xc0003838a8 sp=0xc000383880 pc=0x7b9cdf
github.com/jmorganca/ollama/gpu.LoadCUDAMgmt.func2(0xc00003a130?, 0x24?)
/go/src/github.com/jmorganca/ollama/gpu/gpu.go:268 +0x4a fp=0xc0003838e8 sp=0xc0003838a8 pc=0x7bbaca
github.com/jmorganca/ollama/gpu.LoadCUDAMgmt({0xc00003a0b0, 0x1, 0xc00014c370?})
/go/src/github.com/jmorganca/ollama/gpu/gpu.go:268 +0x1b8 fp=0xc000383988 sp=0xc0003838e8 pc=0x7bb998
github.com/jmorganca/ollama/gpu.initGPUHandles()
/go/src/github.com/jmorganca/ollama/gpu/gpu.go:96 +0xd1 fp=0xc0003839f0 sp=0xc000383988 pc=0x7ba131
github.com/jmorganca/ollama/gpu.GetGPUInfo()
/go/src/github.com/jmorganca/ollama/gpu/gpu.go:121 +0xb5 fp=0xc000383b00 sp=0xc0003839f0 pc=0x7ba2f5
github.com/jmorganca/ollama/gpu.CheckVRAM()
/go/src/github.com/jmorganca/ollama/gpu/gpu.go:194 +0x1f fp=0xc000383ba8 sp=0xc000383b00 pc=0x7bafdf
github.com/jmorganca/ollama/server.Serve({0x106c11d0, 0xc000024020})
/go/src/github.com/jmorganca/ollama/server/routes.go:972 +0x453 fp=0xc000383c98 sp=0xc000383ba8 pc=0x99b513
github.com/jmorganca/ollama/cmd.RunServer(0xc000566b00?, {0x10b06800?, 0x4?, 0xad25c1?})
/go/src/github.com/jmorganca/ollama/cmd/cmd.go:692 +0x199 fp=0xc000383d30 sp=0xc000383c98 pc=0x9ad9f9
github.com/spf13/cobra.(*Command).execute(0xc00054b200, {0x10b06800, 0x0, 0x0})
/root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:940 +0x87c fp=0xc000383e68 sp=0xc000383d30 pc=0x7641dc
github.com/spf13/cobra.(*Command).ExecuteC(0xc00054a600)
/root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:1068 +0x3a5 fp=0xc000383f20 sp=0xc000383e68 pc=0x764a05
github.com/spf13/cobra.(*Command).Execute(...)
/root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:992
github.com/spf13/cobra.(*Command).ExecuteContext(...)
/root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:985
main.main()
/go/src/github.com/jmorganca/ollama/main.go:11 +0x4d fp=0xc000383f40 sp=0xc000383f20 pc=0x9b5a2d
runtime.main()
/usr/local/go/src/runtime/proc.go:267 +0x2bb fp=0xc000383fe0 sp=0xc000383f40 pc=0x43e25b
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000383fe8 sp=0xc000383fe0 pc=0x46e0a1

goroutine 2 [force gc (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000b0fa8 sp=0xc0000b0f88 pc=0x43e6ae
runtime.goparkunlock(...)
/usr/local/go/src/runtime/proc.go:404
runtime.forcegchelper()
/usr/local/go/src/runtime/proc.go:322 +0xb3 fp=0xc0000b0fe0 sp=0xc0000b0fa8 pc=0x43e533
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000b0fe8 sp=0xc0000b0fe0 pc=0x46e0a1
created by runtime.init.6 in goroutine 1
/usr/local/go/src/runtime/proc.go:310 +0x1a

goroutine 3 [GC sweep wait]:
runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000b1778 sp=0xc0000b1758 pc=0x43e6ae
runtime.goparkunlock(...)
/usr/local/go/src/runtime/proc.go:404
runtime.bgsweep(0x0?)
/usr/local/go/src/runtime/mgcsweep.go:321 +0xdf fp=0xc0000b17c8 sp=0xc0000b1778 pc=0x42a5ff
runtime.gcenable.func1()
/usr/local/go/src/runtime/mgc.go:200 +0x25 fp=0xc0000b17e0 sp=0xc0000b17c8 pc=0x41f725
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000b17e8 sp=0xc0000b17e0 pc=0x46e0a1
created by runtime.gcenable in goroutine 1
/usr/local/go/src/runtime/mgc.go:200 +0x66

goroutine 4 [GC scavenge wait]:
runtime.gopark(0x6d07c6?, 0x66e185?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000b1f70 sp=0xc0000b1f50 pc=0x43e6ae
runtime.goparkunlock(...)
/usr/local/go/src/runtime/proc.go:404
runtime.(*scavengerState).park(0x10ad6b80)
/usr/local/go/src/runtime/mgcscavenge.go:425 +0x49 fp=0xc0000b1fa0 sp=0xc0000b1f70 pc=0x427e29
runtime.bgscavenge(0x0?)
/usr/local/go/src/runtime/mgcscavenge.go:658 +0x59 fp=0xc0000b1fc8 sp=0xc0000b1fa0 pc=0x4283d9
runtime.gcenable.func2()
/usr/local/go/src/runtime/mgc.go:201 +0x25 fp=0xc0000b1fe0 sp=0xc0000b1fc8 pc=0x41f6c5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000b1fe8 sp=0xc0000b1fe0 pc=0x46e0a1
created by runtime.gcenable in goroutine 1
/usr/local/go/src/runtime/mgc.go:201 +0xa5

goroutine 18 [finalizer wait]:
runtime.gopark(0xacb580?, 0x10043f801?, 0x0?, 0x0?, 0x446865?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000b0628 sp=0xc0000b0608 pc=0x43e6ae
runtime.runfinq()
/usr/local/go/src/runtime/mfinal.go:193 +0x107 fp=0xc0000b07e0 sp=0xc0000b0628 pc=0x41e7a7
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000b07e8 sp=0xc0000b07e0 pc=0x46e0a1
created by runtime.createfing in goroutine 1
/usr/local/go/src/runtime/mfinal.go:163 +0x3d

goroutine 19 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000ac750 sp=0xc0000ac730 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000ac7e0 sp=0xc0000ac750 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000ac7e8 sp=0xc0000ac7e0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 5 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000b2750 sp=0xc0000b2730 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000b27e0 sp=0xc0000b2750 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000b27e8 sp=0xc0000b27e0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 6 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000b2f50 sp=0xc0000b2f30 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000b2fe0 sp=0xc0000b2f50 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000b2fe8 sp=0xc0000b2fe0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 20 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000acf50 sp=0xc0000acf30 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000acfe0 sp=0xc0000acf50 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000acfe8 sp=0xc0000acfe0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 21 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000ad750 sp=0xc0000ad730 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000ad7e0 sp=0xc0000ad750 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000ad7e8 sp=0xc0000ad7e0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 22 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000adf50 sp=0xc0000adf30 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000adfe0 sp=0xc0000adf50 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000adfe8 sp=0xc0000adfe0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 23 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000ae750 sp=0xc0000ae730 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000ae7e0 sp=0xc0000ae750 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000ae7e8 sp=0xc0000ae7e0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 7 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000b3750 sp=0xc0000b3730 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000b37e0 sp=0xc0000b3750 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000b37e8 sp=0xc0000b37e0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 8 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000b3f50 sp=0xc0000b3f30 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000b3fe0 sp=0xc0000b3f50 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000b3fe8 sp=0xc0000b3fe0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 24 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000aef50 sp=0xc0000aef30 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000aefe0 sp=0xc0000aef50 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000aefe8 sp=0xc0000aefe0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 9 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000ee750 sp=0xc0000ee730 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000ee7e0 sp=0xc0000ee750 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000ee7e8 sp=0xc0000ee7e0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 34 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000ea750 sp=0xc0000ea730 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000ea7e0 sp=0xc0000ea750 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000ea7e8 sp=0xc0000ea7e0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 35 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000eaf50 sp=0xc0000eaf30 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000eafe0 sp=0xc0000eaf50 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000eafe8 sp=0xc0000eafe0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 36 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000eb750 sp=0xc0000eb730 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000eb7e0 sp=0xc0000eb750 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000eb7e8 sp=0xc0000eb7e0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 37 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000ebf50 sp=0xc0000ebf30 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000ebfe0 sp=0xc0000ebf50 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000ebfe8 sp=0xc0000ebfe0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 38 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000ec750 sp=0xc0000ec730 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000ec7e0 sp=0xc0000ec750 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000ec7e8 sp=0xc0000ec7e0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 39 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000ecf50 sp=0xc0000ecf30 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000ecfe0 sp=0xc0000ecf50 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000ecfe8 sp=0xc0000ecfe0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 40 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000ed750 sp=0xc0000ed730 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000ed7e0 sp=0xc0000ed750 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000ed7e8 sp=0xc0000ed7e0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 41 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000edf50 sp=0xc0000edf30 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000edfe0 sp=0xc0000edf50 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000edfe8 sp=0xc0000edfe0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 42 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000488750 sp=0xc000488730 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0004887e0 sp=0xc000488750 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0004887e8 sp=0xc0004887e0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 10 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000eef50 sp=0xc0000eef30 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000eefe0 sp=0xc0000eef50 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000eefe8 sp=0xc0000eefe0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 43 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000488f50 sp=0xc000488f30 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000488fe0 sp=0xc000488f50 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000488fe8 sp=0xc000488fe0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 11 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000ef750 sp=0xc0000ef730 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000ef7e0 sp=0xc0000ef750 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000ef7e8 sp=0xc0000ef7e0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 25 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000af750 sp=0xc0000af730 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000af7e0 sp=0xc0000af750 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000af7e8 sp=0xc0000af7e0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 44 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000489750 sp=0xc000489730 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0004897e0 sp=0xc000489750 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0004897e8 sp=0xc0004897e0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 12 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000eff50 sp=0xc0000eff30 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000effe0 sp=0xc0000eff50 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000effe8 sp=0xc0000effe0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 45 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000489f50 sp=0xc000489f30 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000489fe0 sp=0xc000489f50 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000489fe8 sp=0xc000489fe0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 13 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000f0750 sp=0xc0000f0730 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000f07e0 sp=0xc0000f0750 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000f07e8 sp=0xc0000f07e0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 46 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc00048a750 sp=0xc00048a730 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc00048a7e0 sp=0xc00048a750 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc00048a7e8 sp=0xc00048a7e0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 47 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc00048af50 sp=0xc00048af30 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc00048afe0 sp=0xc00048af50 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc00048afe8 sp=0xc00048afe0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 48 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc00048b750 sp=0xc00048b730 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc00048b7e0 sp=0xc00048b750 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc00048b7e8 sp=0xc00048b7e0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 49 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc00048bf50 sp=0xc00048bf30 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc00048bfe0 sp=0xc00048bf50 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc00048bfe8 sp=0xc00048bfe0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 50 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000484750 sp=0xc000484730 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0004847e0 sp=0xc000484750 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0004847e8 sp=0xc0004847e0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 51 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000484f50 sp=0xc000484f30 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000484fe0 sp=0xc000484f50 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000484fe8 sp=0xc000484fe0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 52 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000485750 sp=0xc000485730 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0004857e0 sp=0xc000485750 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0004857e8 sp=0xc0004857e0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 53 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000485f50 sp=0xc000485f30 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000485fe0 sp=0xc000485f50 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000485fe8 sp=0xc000485fe0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 54 [GC worker (idle)]:
runtime.gopark(0x10b08520?, 0x1?, 0x82?, 0xf?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000486750 sp=0xc000486730 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0004867e0 sp=0xc000486750 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0004867e8 sp=0xc0004867e0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 55 [GC worker (idle)]:
runtime.gopark(0x10b08520?, 0x3?, 0x25?, 0x67?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000486f50 sp=0xc000486f30 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000486fe0 sp=0xc000486f50 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000486fe8 sp=0xc000486fe0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 56 [GC worker (idle)]:
runtime.gopark(0x23a3acaa28c?, 0x1?, 0x6?, 0x12?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000487750 sp=0xc000487730 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0004877e0 sp=0xc000487750 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0004877e8 sp=0xc0004877e0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 57 [GC worker (idle)]:
runtime.gopark(0x10b08520?, 0x1?, 0xb4?, 0x86?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000487f50 sp=0xc000487f30 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000487fe0 sp=0xc000487f50 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000487fe8 sp=0xc000487fe0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 58 [GC worker (idle)]:
runtime.gopark(0x10b08520?, 0x1?, 0x5f?, 0x20?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000494750 sp=0xc000494730 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0004947e0 sp=0xc000494750 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0004947e8 sp=0xc0004947e0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 59 [GC worker (idle)]:
runtime.gopark(0x23a3aca7828?, 0x3?, 0x6a?, 0x35?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000494f50 sp=0xc000494f30 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000494fe0 sp=0xc000494f50 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000494fe8 sp=0xc000494fe0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 60 [GC worker (idle)]:
runtime.gopark(0x10b08520?, 0x1?, 0x10?, 0xb8?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000495750 sp=0xc000495730 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0004957e0 sp=0xc000495750 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0004957e8 sp=0xc0004957e0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 61 [GC worker (idle)]:
runtime.gopark(0x23a3aca6dc2?, 0x1?, 0x32?, 0x3a?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000495f50 sp=0xc000495f30 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000495fe0 sp=0xc000495f50 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000495fe8 sp=0xc000495fe0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 26 [GC worker (idle)]:
runtime.gopark(0x10b08520?, 0x1?, 0x24?, 0x7c?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000aff50 sp=0xc0000aff30 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000affe0 sp=0xc0000aff50 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000affe8 sp=0xc0000affe0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 62 [GC worker (idle)]:
runtime.gopark(0x10b08520?, 0x1?, 0xf6?, 0xfb?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000496750 sp=0xc000496730 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0004967e0 sp=0xc000496750 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0004967e8 sp=0xc0004967e0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 14 [GC worker (idle)]:
runtime.gopark(0x10b08520?, 0x1?, 0xe6?, 0x15?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000f0f50 sp=0xc0000f0f30 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000f0fe0 sp=0xc0000f0f50 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000f0fe8 sp=0xc0000f0fe0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 27 [GC worker (idle)]:
runtime.gopark(0x23a3acaac56?, 0x1?, 0xbc?, 0x48?, 0x0?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000490750 sp=0xc000490730 pc=0x43e6ae
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0004907e0 sp=0xc000490750 pc=0x4212a5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0004907e8 sp=0xc0004907e0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 15 [select, locked to thread]:
runtime.gopark(0xc000497fa8?, 0x2?, 0x49?, 0xe9?, 0xc000497fa4?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000497e38 sp=0xc000497e18 pc=0x43e6ae
runtime.selectgo(0xc000497fa8, 0xc000497fa0, 0x0?, 0x0, 0x0?, 0x1)
/usr/local/go/src/runtime/select.go:327 +0x725 fp=0xc000497f58 sp=0xc000497e38 pc=0x44e1e5
runtime.ensureSigM.func1()
/usr/local/go/src/runtime/signal_unix.go:1014 +0x19f fp=0xc000497fe0 sp=0xc000497f58 pc=0x46521f
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000497fe8 sp=0xc000497fe0 pc=0x46e0a1
created by runtime.ensureSigM in goroutine 1
/usr/local/go/src/runtime/signal_unix.go:997 +0xc8

goroutine 16 [syscall]:
runtime.notetsleepg(0x0?, 0x0?)
/usr/local/go/src/runtime/lock_futex.go:236 +0x29 fp=0xc000490fa0 sp=0xc000490f68 pc=0x411209
os/signal.signal_recv()
/usr/local/go/src/runtime/sigqueue.go:152 +0x29 fp=0xc000490fc0 sp=0xc000490fa0 pc=0x46aa69
os/signal.loop()
/usr/local/go/src/os/signal/signal_unix.go:23 +0x13 fp=0xc000490fe0 sp=0xc000490fc0 pc=0x6f3dd3
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000490fe8 sp=0xc000490fe0 pc=0x46e0a1
created by os/signal.Notify.func1.1 in goroutine 1
/usr/local/go/src/os/signal/signal.go:151 +0x1f

goroutine 63 [chan receive]:
runtime.gopark(0xd00000018?, 0x1c0000001c?, 0x3a?, 0x0?, 0x8c?)
/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0001ce718 sp=0xc0001ce6f8 pc=0x43e6ae
runtime.chanrecv(0xc0001acb40, 0x0, 0x1)
/usr/local/go/src/runtime/chan.go:583 +0x3cd fp=0xc0001ce790 sp=0xc0001ce718 pc=0x40beed
runtime.chanrecv1(0x41bc73?, 0x412765?)
/usr/local/go/src/runtime/chan.go:442 +0x12 fp=0xc0001ce7b8 sp=0xc0001ce790 pc=0x40baf2
github.com/jmorganca/ollama/server.Serve.func1()
/go/src/github.com/jmorganca/ollama/server/routes.go:959 +0x25 fp=0xc0001ce7e0 sp=0xc0001ce7b8 pc=0x99b5e5
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0001ce7e8 sp=0xc0001ce7e0 pc=0x46e0a1
created by github.com/jmorganca/ollama/server.Serve in goroutine 1
/go/src/github.com/jmorganca/ollama/server/routes.go:958 +0x3f6

rax 0x7fded8000fc0
rbx 0xc0001a6400
rcx 0x1
rdx 0x1a
rdi 0x7fdee343bc00
rsi 0x100
rbp 0x7fdee343be20
rsp 0x7fdee343bbf8
r8 0xffff
r9 0x7fdee343b967
r10 0xa
r11 0x7fdf2b10c4d0
r12 0x9
r13 0x7fdee343bdf0
r14 0x7fdee343bc00
r15 0x0
rip 0x7fdea683ca70
rflags 0x10287
cs 0x33
fs 0x0
gs 0x0`

<!-- gh-comment-id:1911759882 --> @constra commented on GitHub (Jan 26, 2024): same here `2024/01/26 09:32:54 images.go:857: INFO total blobs: 0 2024/01/26 09:32:54 images.go:864: INFO total unused blobs removed: 0 2024/01/26 09:32:54 routes.go:950: INFO Listening on 127.0.0.1:11434 (version 0.1.21) 2024/01/26 09:32:54 payload_common.go:106: INFO Extracting dynamic libraries... 2024/01/26 09:32:58 payload_common.go:145: INFO Dynamic LLM libraries [cpu_avx2 cpu cuda_v11 cpu_avx rocm_v5 rocm_v6] 2024/01/26 09:32:58 gpu.go:93: INFO Detecting GPU type 2024/01/26 09:32:58 gpu.go:212: INFO Searching for GPU management library libnvidia-ml.so 2024/01/26 09:32:58 gpu.go:258: INFO Discovered GPU libraries: [/usr/lib64/libnvidia-ml.so.545.23.08] SIGSEGV: segmentation violation PC=0x7fdea683ca70 m=4 sigcode=1 signal arrived during cgo execution goroutine 1 [syscall]: runtime.cgocall(0x9b6eb0, 0xc0003838a8) /usr/local/go/src/runtime/cgocall.go:157 +0x4b fp=0xc000383880 sp=0xc000383848 pc=0x409b0b github.com/jmorganca/ollama/gpu._Cfunc_cuda_init(0x7fded8000f60, 0xc0001a6400) _cgo_gotypes.go:248 +0x3f fp=0xc0003838a8 sp=0xc000383880 pc=0x7b9cdf github.com/jmorganca/ollama/gpu.LoadCUDAMgmt.func2(0xc00003a130?, 0x24?) /go/src/github.com/jmorganca/ollama/gpu/gpu.go:268 +0x4a fp=0xc0003838e8 sp=0xc0003838a8 pc=0x7bbaca github.com/jmorganca/ollama/gpu.LoadCUDAMgmt({0xc00003a0b0, 0x1, 0xc00014c370?}) /go/src/github.com/jmorganca/ollama/gpu/gpu.go:268 +0x1b8 fp=0xc000383988 sp=0xc0003838e8 pc=0x7bb998 github.com/jmorganca/ollama/gpu.initGPUHandles() /go/src/github.com/jmorganca/ollama/gpu/gpu.go:96 +0xd1 fp=0xc0003839f0 sp=0xc000383988 pc=0x7ba131 github.com/jmorganca/ollama/gpu.GetGPUInfo() /go/src/github.com/jmorganca/ollama/gpu/gpu.go:121 +0xb5 fp=0xc000383b00 sp=0xc0003839f0 pc=0x7ba2f5 github.com/jmorganca/ollama/gpu.CheckVRAM() /go/src/github.com/jmorganca/ollama/gpu/gpu.go:194 +0x1f fp=0xc000383ba8 sp=0xc000383b00 pc=0x7bafdf github.com/jmorganca/ollama/server.Serve({0x106c11d0, 0xc000024020}) /go/src/github.com/jmorganca/ollama/server/routes.go:972 +0x453 fp=0xc000383c98 sp=0xc000383ba8 pc=0x99b513 github.com/jmorganca/ollama/cmd.RunServer(0xc000566b00?, {0x10b06800?, 0x4?, 0xad25c1?}) /go/src/github.com/jmorganca/ollama/cmd/cmd.go:692 +0x199 fp=0xc000383d30 sp=0xc000383c98 pc=0x9ad9f9 github.com/spf13/cobra.(*Command).execute(0xc00054b200, {0x10b06800, 0x0, 0x0}) /root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:940 +0x87c fp=0xc000383e68 sp=0xc000383d30 pc=0x7641dc github.com/spf13/cobra.(*Command).ExecuteC(0xc00054a600) /root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:1068 +0x3a5 fp=0xc000383f20 sp=0xc000383e68 pc=0x764a05 github.com/spf13/cobra.(*Command).Execute(...) /root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:992 github.com/spf13/cobra.(*Command).ExecuteContext(...) /root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:985 main.main() /go/src/github.com/jmorganca/ollama/main.go:11 +0x4d fp=0xc000383f40 sp=0xc000383f20 pc=0x9b5a2d runtime.main() /usr/local/go/src/runtime/proc.go:267 +0x2bb fp=0xc000383fe0 sp=0xc000383f40 pc=0x43e25b runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000383fe8 sp=0xc000383fe0 pc=0x46e0a1 goroutine 2 [force gc (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000b0fa8 sp=0xc0000b0f88 pc=0x43e6ae runtime.goparkunlock(...) /usr/local/go/src/runtime/proc.go:404 runtime.forcegchelper() /usr/local/go/src/runtime/proc.go:322 +0xb3 fp=0xc0000b0fe0 sp=0xc0000b0fa8 pc=0x43e533 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000b0fe8 sp=0xc0000b0fe0 pc=0x46e0a1 created by runtime.init.6 in goroutine 1 /usr/local/go/src/runtime/proc.go:310 +0x1a goroutine 3 [GC sweep wait]: runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000b1778 sp=0xc0000b1758 pc=0x43e6ae runtime.goparkunlock(...) /usr/local/go/src/runtime/proc.go:404 runtime.bgsweep(0x0?) /usr/local/go/src/runtime/mgcsweep.go:321 +0xdf fp=0xc0000b17c8 sp=0xc0000b1778 pc=0x42a5ff runtime.gcenable.func1() /usr/local/go/src/runtime/mgc.go:200 +0x25 fp=0xc0000b17e0 sp=0xc0000b17c8 pc=0x41f725 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000b17e8 sp=0xc0000b17e0 pc=0x46e0a1 created by runtime.gcenable in goroutine 1 /usr/local/go/src/runtime/mgc.go:200 +0x66 goroutine 4 [GC scavenge wait]: runtime.gopark(0x6d07c6?, 0x66e185?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000b1f70 sp=0xc0000b1f50 pc=0x43e6ae runtime.goparkunlock(...) /usr/local/go/src/runtime/proc.go:404 runtime.(*scavengerState).park(0x10ad6b80) /usr/local/go/src/runtime/mgcscavenge.go:425 +0x49 fp=0xc0000b1fa0 sp=0xc0000b1f70 pc=0x427e29 runtime.bgscavenge(0x0?) /usr/local/go/src/runtime/mgcscavenge.go:658 +0x59 fp=0xc0000b1fc8 sp=0xc0000b1fa0 pc=0x4283d9 runtime.gcenable.func2() /usr/local/go/src/runtime/mgc.go:201 +0x25 fp=0xc0000b1fe0 sp=0xc0000b1fc8 pc=0x41f6c5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000b1fe8 sp=0xc0000b1fe0 pc=0x46e0a1 created by runtime.gcenable in goroutine 1 /usr/local/go/src/runtime/mgc.go:201 +0xa5 goroutine 18 [finalizer wait]: runtime.gopark(0xacb580?, 0x10043f801?, 0x0?, 0x0?, 0x446865?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000b0628 sp=0xc0000b0608 pc=0x43e6ae runtime.runfinq() /usr/local/go/src/runtime/mfinal.go:193 +0x107 fp=0xc0000b07e0 sp=0xc0000b0628 pc=0x41e7a7 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000b07e8 sp=0xc0000b07e0 pc=0x46e0a1 created by runtime.createfing in goroutine 1 /usr/local/go/src/runtime/mfinal.go:163 +0x3d goroutine 19 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000ac750 sp=0xc0000ac730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000ac7e0 sp=0xc0000ac750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000ac7e8 sp=0xc0000ac7e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 5 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000b2750 sp=0xc0000b2730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000b27e0 sp=0xc0000b2750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000b27e8 sp=0xc0000b27e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 6 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000b2f50 sp=0xc0000b2f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000b2fe0 sp=0xc0000b2f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000b2fe8 sp=0xc0000b2fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 20 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000acf50 sp=0xc0000acf30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000acfe0 sp=0xc0000acf50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000acfe8 sp=0xc0000acfe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 21 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000ad750 sp=0xc0000ad730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000ad7e0 sp=0xc0000ad750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000ad7e8 sp=0xc0000ad7e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 22 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000adf50 sp=0xc0000adf30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000adfe0 sp=0xc0000adf50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000adfe8 sp=0xc0000adfe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 23 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000ae750 sp=0xc0000ae730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000ae7e0 sp=0xc0000ae750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000ae7e8 sp=0xc0000ae7e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 7 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000b3750 sp=0xc0000b3730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000b37e0 sp=0xc0000b3750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000b37e8 sp=0xc0000b37e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 8 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000b3f50 sp=0xc0000b3f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000b3fe0 sp=0xc0000b3f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000b3fe8 sp=0xc0000b3fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 24 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000aef50 sp=0xc0000aef30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000aefe0 sp=0xc0000aef50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000aefe8 sp=0xc0000aefe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 9 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000ee750 sp=0xc0000ee730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000ee7e0 sp=0xc0000ee750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000ee7e8 sp=0xc0000ee7e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 34 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000ea750 sp=0xc0000ea730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000ea7e0 sp=0xc0000ea750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000ea7e8 sp=0xc0000ea7e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 35 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000eaf50 sp=0xc0000eaf30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000eafe0 sp=0xc0000eaf50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000eafe8 sp=0xc0000eafe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 36 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000eb750 sp=0xc0000eb730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000eb7e0 sp=0xc0000eb750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000eb7e8 sp=0xc0000eb7e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 37 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000ebf50 sp=0xc0000ebf30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000ebfe0 sp=0xc0000ebf50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000ebfe8 sp=0xc0000ebfe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 38 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000ec750 sp=0xc0000ec730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000ec7e0 sp=0xc0000ec750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000ec7e8 sp=0xc0000ec7e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 39 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000ecf50 sp=0xc0000ecf30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000ecfe0 sp=0xc0000ecf50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000ecfe8 sp=0xc0000ecfe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 40 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000ed750 sp=0xc0000ed730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000ed7e0 sp=0xc0000ed750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000ed7e8 sp=0xc0000ed7e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 41 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000edf50 sp=0xc0000edf30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000edfe0 sp=0xc0000edf50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000edfe8 sp=0xc0000edfe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 42 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000488750 sp=0xc000488730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0004887e0 sp=0xc000488750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0004887e8 sp=0xc0004887e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 10 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000eef50 sp=0xc0000eef30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000eefe0 sp=0xc0000eef50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000eefe8 sp=0xc0000eefe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 43 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000488f50 sp=0xc000488f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000488fe0 sp=0xc000488f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000488fe8 sp=0xc000488fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 11 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000ef750 sp=0xc0000ef730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000ef7e0 sp=0xc0000ef750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000ef7e8 sp=0xc0000ef7e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 25 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000af750 sp=0xc0000af730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000af7e0 sp=0xc0000af750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000af7e8 sp=0xc0000af7e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 44 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000489750 sp=0xc000489730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0004897e0 sp=0xc000489750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0004897e8 sp=0xc0004897e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 12 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000eff50 sp=0xc0000eff30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000effe0 sp=0xc0000eff50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000effe8 sp=0xc0000effe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 45 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000489f50 sp=0xc000489f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000489fe0 sp=0xc000489f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000489fe8 sp=0xc000489fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 13 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000f0750 sp=0xc0000f0730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000f07e0 sp=0xc0000f0750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000f07e8 sp=0xc0000f07e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 46 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc00048a750 sp=0xc00048a730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc00048a7e0 sp=0xc00048a750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc00048a7e8 sp=0xc00048a7e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 47 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc00048af50 sp=0xc00048af30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc00048afe0 sp=0xc00048af50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc00048afe8 sp=0xc00048afe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 48 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc00048b750 sp=0xc00048b730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc00048b7e0 sp=0xc00048b750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc00048b7e8 sp=0xc00048b7e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 49 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc00048bf50 sp=0xc00048bf30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc00048bfe0 sp=0xc00048bf50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc00048bfe8 sp=0xc00048bfe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 50 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000484750 sp=0xc000484730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0004847e0 sp=0xc000484750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0004847e8 sp=0xc0004847e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 51 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000484f50 sp=0xc000484f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000484fe0 sp=0xc000484f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000484fe8 sp=0xc000484fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 52 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000485750 sp=0xc000485730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0004857e0 sp=0xc000485750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0004857e8 sp=0xc0004857e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 53 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000485f50 sp=0xc000485f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000485fe0 sp=0xc000485f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000485fe8 sp=0xc000485fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 54 [GC worker (idle)]: runtime.gopark(0x10b08520?, 0x1?, 0x82?, 0xf?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000486750 sp=0xc000486730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0004867e0 sp=0xc000486750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0004867e8 sp=0xc0004867e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 55 [GC worker (idle)]: runtime.gopark(0x10b08520?, 0x3?, 0x25?, 0x67?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000486f50 sp=0xc000486f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000486fe0 sp=0xc000486f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000486fe8 sp=0xc000486fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 56 [GC worker (idle)]: runtime.gopark(0x23a3acaa28c?, 0x1?, 0x6?, 0x12?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000487750 sp=0xc000487730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0004877e0 sp=0xc000487750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0004877e8 sp=0xc0004877e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 57 [GC worker (idle)]: runtime.gopark(0x10b08520?, 0x1?, 0xb4?, 0x86?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000487f50 sp=0xc000487f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000487fe0 sp=0xc000487f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000487fe8 sp=0xc000487fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 58 [GC worker (idle)]: runtime.gopark(0x10b08520?, 0x1?, 0x5f?, 0x20?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000494750 sp=0xc000494730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0004947e0 sp=0xc000494750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0004947e8 sp=0xc0004947e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 59 [GC worker (idle)]: runtime.gopark(0x23a3aca7828?, 0x3?, 0x6a?, 0x35?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000494f50 sp=0xc000494f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000494fe0 sp=0xc000494f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000494fe8 sp=0xc000494fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 60 [GC worker (idle)]: runtime.gopark(0x10b08520?, 0x1?, 0x10?, 0xb8?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000495750 sp=0xc000495730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0004957e0 sp=0xc000495750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0004957e8 sp=0xc0004957e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 61 [GC worker (idle)]: runtime.gopark(0x23a3aca6dc2?, 0x1?, 0x32?, 0x3a?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000495f50 sp=0xc000495f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000495fe0 sp=0xc000495f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000495fe8 sp=0xc000495fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 26 [GC worker (idle)]: runtime.gopark(0x10b08520?, 0x1?, 0x24?, 0x7c?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000aff50 sp=0xc0000aff30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000affe0 sp=0xc0000aff50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000affe8 sp=0xc0000affe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 62 [GC worker (idle)]: runtime.gopark(0x10b08520?, 0x1?, 0xf6?, 0xfb?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000496750 sp=0xc000496730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0004967e0 sp=0xc000496750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0004967e8 sp=0xc0004967e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 14 [GC worker (idle)]: runtime.gopark(0x10b08520?, 0x1?, 0xe6?, 0x15?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0000f0f50 sp=0xc0000f0f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000f0fe0 sp=0xc0000f0f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000f0fe8 sp=0xc0000f0fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 27 [GC worker (idle)]: runtime.gopark(0x23a3acaac56?, 0x1?, 0xbc?, 0x48?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000490750 sp=0xc000490730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0004907e0 sp=0xc000490750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0004907e8 sp=0xc0004907e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 15 [select, locked to thread]: runtime.gopark(0xc000497fa8?, 0x2?, 0x49?, 0xe9?, 0xc000497fa4?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000497e38 sp=0xc000497e18 pc=0x43e6ae runtime.selectgo(0xc000497fa8, 0xc000497fa0, 0x0?, 0x0, 0x0?, 0x1) /usr/local/go/src/runtime/select.go:327 +0x725 fp=0xc000497f58 sp=0xc000497e38 pc=0x44e1e5 runtime.ensureSigM.func1() /usr/local/go/src/runtime/signal_unix.go:1014 +0x19f fp=0xc000497fe0 sp=0xc000497f58 pc=0x46521f runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000497fe8 sp=0xc000497fe0 pc=0x46e0a1 created by runtime.ensureSigM in goroutine 1 /usr/local/go/src/runtime/signal_unix.go:997 +0xc8 goroutine 16 [syscall]: runtime.notetsleepg(0x0?, 0x0?) /usr/local/go/src/runtime/lock_futex.go:236 +0x29 fp=0xc000490fa0 sp=0xc000490f68 pc=0x411209 os/signal.signal_recv() /usr/local/go/src/runtime/sigqueue.go:152 +0x29 fp=0xc000490fc0 sp=0xc000490fa0 pc=0x46aa69 os/signal.loop() /usr/local/go/src/os/signal/signal_unix.go:23 +0x13 fp=0xc000490fe0 sp=0xc000490fc0 pc=0x6f3dd3 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000490fe8 sp=0xc000490fe0 pc=0x46e0a1 created by os/signal.Notify.func1.1 in goroutine 1 /usr/local/go/src/os/signal/signal.go:151 +0x1f goroutine 63 [chan receive]: runtime.gopark(0xd00000018?, 0x1c0000001c?, 0x3a?, 0x0?, 0x8c?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0001ce718 sp=0xc0001ce6f8 pc=0x43e6ae runtime.chanrecv(0xc0001acb40, 0x0, 0x1) /usr/local/go/src/runtime/chan.go:583 +0x3cd fp=0xc0001ce790 sp=0xc0001ce718 pc=0x40beed runtime.chanrecv1(0x41bc73?, 0x412765?) /usr/local/go/src/runtime/chan.go:442 +0x12 fp=0xc0001ce7b8 sp=0xc0001ce790 pc=0x40baf2 github.com/jmorganca/ollama/server.Serve.func1() /go/src/github.com/jmorganca/ollama/server/routes.go:959 +0x25 fp=0xc0001ce7e0 sp=0xc0001ce7b8 pc=0x99b5e5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0001ce7e8 sp=0xc0001ce7e0 pc=0x46e0a1 created by github.com/jmorganca/ollama/server.Serve in goroutine 1 /go/src/github.com/jmorganca/ollama/server/routes.go:958 +0x3f6 rax 0x7fded8000fc0 rbx 0xc0001a6400 rcx 0x1 rdx 0x1a rdi 0x7fdee343bc00 rsi 0x100 rbp 0x7fdee343be20 rsp 0x7fdee343bbf8 r8 0xffff r9 0x7fdee343b967 r10 0xa r11 0x7fdf2b10c4d0 r12 0x9 r13 0x7fdee343bdf0 r14 0x7fdee343bc00 r15 0x0 rip 0x7fdea683ca70 rflags 0x10287 cs 0x33 fs 0x0 gs 0x0`
GiteaMirror commented 2026-05-03 12:53:51 -05:00
Author
Owner
Copy Link

@hardik124 commented on GitHub (Jan 26, 2024):

This also fills up my home directory even though i have OLLAMA_MODELS setup to some place else.
I already have 44 Gigs of space in home, and just running "ollama serve" crashes and fills up

<!-- gh-comment-id:1911868479 --> @hardik124 commented on GitHub (Jan 26, 2024): This also fills up my home directory even though i have OLLAMA_MODELS setup to some place else. I already have 44 Gigs of space in home, and just running "ollama serve" crashes and fills up
GiteaMirror commented 2026-05-03 12:53:51 -05:00
Author
Owner
Copy Link

@elamribadrayour commented on GitHub (Jan 26, 2024):

I have the same error when I try to install the last version of ollama 0.1.21 (using the install.sh script).
I change the ollama curl in the install.sh to load the 0.1.20 and it works.

curl --fail --show-error --location --progress-bar -o $TEMP_DIR/ollama "https://github.com/ollama/ollama/releases/download/v0.1.20/ollama
<!-- gh-comment-id:1911948121 --> @elamribadrayour commented on GitHub (Jan 26, 2024): I have the same error when I try to install the last version of ollama 0.1.21 (using the install.sh script). I change the ollama curl in the install.sh to load the 0.1.20 and it works. ``` curl --fail --show-error --location --progress-bar -o $TEMP_DIR/ollama "https://github.com/ollama/ollama/releases/download/v0.1.20/ollama ```
GiteaMirror commented 2026-05-03 12:53:53 -05:00
Author
Owner
Copy Link

@hardik124 commented on GitHub (Jan 26, 2024):

I have the same error when I try to install the last version of ollama 0.1.21 (using the install.sh script). I change the ollama curl in the install.sh to load the 0.1.20 and it works.

curl --fail --show-error --location --progress-bar -o $TEMP_DIR/ollama "https://github.com/ollama/ollama/releases/download/v0.1.20/ollama

I downloaded 0.1.20 binary and it runs fine. I agree that the error might be in 0.1.21

<!-- gh-comment-id:1912111399 --> @hardik124 commented on GitHub (Jan 26, 2024): > I have the same error when I try to install the last version of ollama 0.1.21 (using the install.sh script). I change the ollama curl in the install.sh to load the 0.1.20 and it works. > > ``` > curl --fail --show-error --location --progress-bar -o $TEMP_DIR/ollama "https://github.com/ollama/ollama/releases/download/v0.1.20/ollama > ``` I downloaded 0.1.20 binary and it runs fine. I agree that the error might be in 0.1.21
GiteaMirror commented 2026-05-03 12:53:54 -05:00
Author
Owner
Copy Link

@constra commented on GitHub (Jan 26, 2024):

confirm that 0.1.20 runs well. thanks @elamribadrayour

<!-- gh-comment-id:1912113264 --> @constra commented on GitHub (Jan 26, 2024): confirm that 0.1.20 runs well. thanks @elamribadrayour
GiteaMirror commented 2026-05-03 12:53:56 -05:00
Author
Owner
Copy Link

@andr6 commented on GitHub (Jan 26, 2024):

Same here errors with 01.21 - Putting full URL to replace on install.sh


curl --fail --show-error --location --progress-bar -o $TEMP_DIR/ollama "https://github.com/ollama/ollama/releases/download/v0.1.20/ollama-linux-$ARCH"
<!-- gh-comment-id:1912159592 --> @andr6 commented on GitHub (Jan 26, 2024): Same here errors with 01.21 - Putting full URL to replace on install.sh ```shell curl --fail --show-error --location --progress-bar -o $TEMP_DIR/ollama "https://github.com/ollama/ollama/releases/download/v0.1.20/ollama-linux-$ARCH"
GiteaMirror commented 2026-05-03 12:53:57 -05:00
Author
Owner
Copy Link

@dhiltgen commented on GitHub (Jan 26, 2024):

@hardik124 (or others hitting this segfault) could you try running with debug logging turned on so we can get a little more information about where it's crashing?

OLLAMA_DEBUG=1 ollama serve
<!-- gh-comment-id:1912333317 --> @dhiltgen commented on GitHub (Jan 26, 2024): @hardik124 (or others hitting this segfault) could you try running with debug logging turned on so we can get a little more information about where it's crashing? ``` OLLAMA_DEBUG=1 ollama serve ```
GiteaMirror commented 2026-05-03 12:53:59 -05:00
Author
Owner
Copy Link

@khlopkov commented on GitHub (Jan 26, 2024):

Having the same for version 0.1.21

The command

OLLAMA_DEBUG=1 ollama serve

gives the following output:

time=2024-01-26T18:05:41.703+01:00 level=DEBUG source=/go/src/github.com/jmorganca/ollama/server/routes.go:926 msg="Debug logging enabled"
time=2024-01-26T18:05:41.704+01:00 level=INFO source=/go/src/github.com/jmorganca/ollama/server/images.go:857 msg="total blobs: 0"
time=2024-01-26T18:05:41.704+01:00 level=INFO source=/go/src/github.com/jmorganca/ollama/server/images.go:864 msg="total unused blobs removed: 0"
time=2024-01-26T18:05:41.704+01:00 level=INFO source=/go/src/github.com/jmorganca/ollama/server/routes.go:950 msg="Listening on 127.0.0.1:11434 (version 0.1.21)"
time=2024-01-26T18:05:41.704+01:00 level=INFO source=/go/src/github.com/jmorganca/ollama/llm/payload_common.go:106 msg="Extracting dynamic libraries..."
time=2024-01-26T18:05:43.454+01:00 level=INFO source=/go/src/github.com/jmorganca/ollama/llm/payload_common.go:145 msg="Dynamic LLM libraries [cpu_avx2 rocm_v6 cpu cpu_avx rocm_v5 cuda_v11]"
time=2024-01-26T18:05:43.454+01:00 level=DEBUG source=/go/src/github.com/jmorganca/ollama/llm/payload_common.go:146 msg="Override detection logic by setting OLLAMA_LLM_LIBRARY"
time=2024-01-26T18:05:43.454+01:00 level=INFO source=/go/src/github.com/jmorganca/ollama/gpu/gpu.go:93 msg="Detecting GPU type"
time=2024-01-26T18:05:43.454+01:00 level=INFO source=/go/src/github.com/jmorganca/ollama/gpu/gpu.go:212 msg="Searching for GPU management library libnvidia-ml.so"
time=2024-01-26T18:05:43.454+01:00 level=DEBUG source=/go/src/github.com/jmorganca/ollama/gpu/gpu.go:230 msg="gpu management search paths: [/usr/local/cuda/lib64/libnvidia-ml.so* /usr/lib/x86_64-linux-gnu/nvidia/current/libnvidia-ml.so* /usr/lib/x86_64-linux-gnu/libnvidia-ml.so* /usr/lib/wsl/lib/libnvidia-ml.so* /usr/lib/wsl/drivers/*/libnvidia-ml.so* /opt/cuda/lib64/libnvidia-ml.so* /usr/lib*/libnvidia-ml.so* /usr/local/lib*/libnvidia-ml.so* /usr/lib/aarch64-linux-gnu/nvidia/current/libnvidia-ml.so* /usr/lib/aarch64-linux-gnu/libnvidia-ml.so* /opt/cuda/targets/x86_64-linux/lib/stubs/libnvidia-ml.so* /nix/store/3vd7sbdqcyq8fwjayq491c276z2bh62m-mesa-23.1.9-drivers/lib/libnvidia-ml.so* /nix/store/7hrxsj2hhig5b29ys11gcy3442khhrai-mesa-23.1.9-drivers/lib/libnvidia-ml.so* /nix/store/aczx78ym4sxn5x0bk9rrn1gnfvhqkp5b-libvdpau-va-gl-0.4.2/lib/vdpau/libnvidia-ml.so* /nix/store/zy4608fdbi833gqp56mk26znzay7vdcj-libvdpau-va-gl-0.4.2/lib/vdpau/libnvidia-ml.so* /nix/store/zg7jz7rh90sgv0cib4r8bq3dqjf5mpm6-mesa_glxindirect/lib/libnvidia-ml.so* /nix/store/cnqf3bxcb77wc2vapx3dy9s36a7d6mz7-libglvnd-1.7.0/lib/libnvidia-ml.so*]"
time=2024-01-26T18:05:43.455+01:00 level=INFO source=/go/src/github.com/jmorganca/ollama/gpu/gpu.go:258 msg="Discovered GPU libraries: [/usr/lib/x86_64-linux-gnu/nvidia/current/libnvidia-ml.so.525.147.05]"
wiring nvidia management library functions in /usr/lib/x86_64-linux-gnu/nvidia/current/libnvidia-ml.so.525.147.05
dlsym: nvmlInit_v2
dlsym: nvmlShutdown
dlsym: nvmlDeviceGetHandleByIndex
dlsym: nvmlDeviceGetMemoryInfo
dlsym: nvmlDeviceGetCount_v2
dlsym: nvmlDeviceGetCudaComputeCapability
dlsym: nvmlSystemGetDriverVersion
dlsym: nvmlDeviceGetName
dlsym: nvmlDeviceGetSerial
dlsym: nvmlDeviceGetVbiosVersion
dlsym: nvmlDeviceGetBoardPartNumber
dlsym: nvmlDeviceGetBrand
nvmlInit_v2 err: 9
SIGSEGV: segmentation violation
PC=0x7f488f03d710 m=13 sigcode=1
signal arrived during cgo execution

goroutine 1 [syscall]:
runtime.cgocall(0x9b6eb0, 0xc0001658a8)
	/usr/local/go/src/runtime/cgocall.go:157 +0x4b fp=0xc000165880 sp=0xc000165848 pc=0x409b0b
github.com/jmorganca/ollama/gpu._Cfunc_cuda_init(0x7f4884000b70, 0xc000496500)
	_cgo_gotypes.go:248 +0x3f fp=0xc0001658a8 sp=0xc000165880 pc=0x7b9cdf
github.com/jmorganca/ollama/gpu.LoadCUDAMgmt.func2(0xc000042150?, 0x43?)
	/go/src/github.com/jmorganca/ollama/gpu/gpu.go:268 +0x4a fp=0xc0001658e8 sp=0xc0001658a8 pc=0x7bbaca
github.com/jmorganca/ollama/gpu.LoadCUDAMgmt({0xc000042230, 0x1, 0xc00014e4d0?})
	/go/src/github.com/jmorganca/ollama/gpu/gpu.go:268 +0x1b8 fp=0xc000165988 sp=0xc0001658e8 pc=0x7bb998
github.com/jmorganca/ollama/gpu.initGPUHandles()
	/go/src/github.com/jmorganca/ollama/gpu/gpu.go:96 +0xd1 fp=0xc0001659f0 sp=0xc000165988 pc=0x7ba131
github.com/jmorganca/ollama/gpu.GetGPUInfo()
	/go/src/github.com/jmorganca/ollama/gpu/gpu.go:121 +0xb5 fp=0xc000165b00 sp=0xc0001659f0 pc=0x7ba2f5
github.com/jmorganca/ollama/gpu.CheckVRAM()
	/go/src/github.com/jmorganca/ollama/gpu/gpu.go:194 +0x1f fp=0xc000165ba8 sp=0xc000165b00 pc=0x7bafdf
github.com/jmorganca/ollama/server.Serve({0x106c11d0, 0xc00046d560})
	/go/src/github.com/jmorganca/ollama/server/routes.go:972 +0x453 fp=0xc000165c98 sp=0xc000165ba8 pc=0x99b513
github.com/jmorganca/ollama/cmd.RunServer(0xc000494300?, {0x10b06800?, 0x4?, 0xad25c1?})
	/go/src/github.com/jmorganca/ollama/cmd/cmd.go:692 +0x199 fp=0xc000165d30 sp=0xc000165c98 pc=0x9ad9f9
github.com/spf13/cobra.(*Command).execute(0xc000459800, {0x10b06800, 0x0, 0x0})
	/root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:940 +0x87c fp=0xc000165e68 sp=0xc000165d30 pc=0x7641dc
github.com/spf13/cobra.(*Command).ExecuteC(0xc000458c00)
	/root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:1068 +0x3a5 fp=0xc000165f20 sp=0xc000165e68 pc=0x764a05
github.com/spf13/cobra.(*Command).Execute(...)
	/root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:992
github.com/spf13/cobra.(*Command).ExecuteContext(...)
	/root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:985
main.main()
	/go/src/github.com/jmorganca/ollama/main.go:11 +0x4d fp=0xc000165f40 sp=0xc000165f20 pc=0x9b5a2d
runtime.main()
	/usr/local/go/src/runtime/proc.go:267 +0x2bb fp=0xc000165fe0 sp=0xc000165f40 pc=0x43e25b
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000165fe8 sp=0xc000165fe0 pc=0x46e0a1

goroutine 2 [force gc (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000066fa8 sp=0xc000066f88 pc=0x43e6ae
runtime.goparkunlock(...)
	/usr/local/go/src/runtime/proc.go:404
runtime.forcegchelper()
	/usr/local/go/src/runtime/proc.go:322 +0xb3 fp=0xc000066fe0 sp=0xc000066fa8 pc=0x43e533
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000066fe8 sp=0xc000066fe0 pc=0x46e0a1
created by runtime.init.6 in goroutine 1
	/usr/local/go/src/runtime/proc.go:310 +0x1a

goroutine 3 [GC sweep wait]:
runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?)
	/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000067778 sp=0xc000067758 pc=0x43e6ae
runtime.goparkunlock(...)
	/usr/local/go/src/runtime/proc.go:404
runtime.bgsweep(0x0?)
	/usr/local/go/src/runtime/mgcsweep.go:321 +0xdf fp=0xc0000677c8 sp=0xc000067778 pc=0x42a5ff
runtime.gcenable.func1()
	/usr/local/go/src/runtime/mgc.go:200 +0x25 fp=0xc0000677e0 sp=0xc0000677c8 pc=0x41f725
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000677e8 sp=0xc0000677e0 pc=0x46e0a1
created by runtime.gcenable in goroutine 1
	/usr/local/go/src/runtime/mgc.go:200 +0x66

goroutine 4 [GC scavenge wait]:
runtime.gopark(0x18edcfe?, 0x18a33f5?, 0x0?, 0x0?, 0x0?)
	/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000067f70 sp=0xc000067f50 pc=0x43e6ae
runtime.goparkunlock(...)
	/usr/local/go/src/runtime/proc.go:404
runtime.(*scavengerState).park(0x10ad6b80)
	/usr/local/go/src/runtime/mgcscavenge.go:425 +0x49 fp=0xc000067fa0 sp=0xc000067f70 pc=0x427e29
runtime.bgscavenge(0x0?)
	/usr/local/go/src/runtime/mgcscavenge.go:658 +0x59 fp=0xc000067fc8 sp=0xc000067fa0 pc=0x4283d9
runtime.gcenable.func2()
	/usr/local/go/src/runtime/mgc.go:201 +0x25 fp=0xc000067fe0 sp=0xc000067fc8 pc=0x41f6c5
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000067fe8 sp=0xc000067fe0 pc=0x46e0a1
created by runtime.gcenable in goroutine 1
	/usr/local/go/src/runtime/mgc.go:201 +0xa5

goroutine 18 [finalizer wait]:
runtime.gopark(0xacb580?, 0x10043f801?, 0x0?, 0x0?, 0x446865?)
	/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000066628 sp=0xc000066608 pc=0x43e6ae
runtime.runfinq()
	/usr/local/go/src/runtime/mfinal.go:193 +0x107 fp=0xc0000667e0 sp=0xc000066628 pc=0x41e7a7
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000667e8 sp=0xc0000667e0 pc=0x46e0a1
created by runtime.createfing in goroutine 1
	/usr/local/go/src/runtime/mfinal.go:163 +0x3d

goroutine 19 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000062750 sp=0xc000062730 pc=0x43e6ae
runtime.gcBgMarkWorker()
	/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000627e0 sp=0xc000062750 pc=0x4212a5
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000627e8 sp=0xc0000627e0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 20 [GC worker (idle)]:
runtime.gopark(0x1494598b4808?, 0x0?, 0x0?, 0x0?, 0x0?)
	/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000062f50 sp=0xc000062f30 pc=0x43e6ae
runtime.gcBgMarkWorker()
	/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000062fe0 sp=0xc000062f50 pc=0x4212a5
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000062fe8 sp=0xc000062fe0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 21 [GC worker (idle)]:
runtime.gopark(0x149469d1a165?, 0x1?, 0xea?, 0x60?, 0x0?)
	/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000063750 sp=0xc000063730 pc=0x43e6ae
runtime.gcBgMarkWorker()
	/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000637e0 sp=0xc000063750 pc=0x4212a5
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000637e8 sp=0xc0000637e0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 22 [GC worker (idle)]:
runtime.gopark(0x1494598b4556?, 0x3?, 0x5a?, 0xed?, 0x0?)
	/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000063f50 sp=0xc000063f30 pc=0x43e6ae
runtime.gcBgMarkWorker()
	/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000063fe0 sp=0xc000063f50 pc=0x4212a5
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000063fe8 sp=0xc000063fe0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 23 [GC worker (idle)]:
runtime.gopark(0x1494598b47e0?, 0x1?, 0x4e?, 0x3e?, 0x0?)
	/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000064750 sp=0xc000064730 pc=0x43e6ae
runtime.gcBgMarkWorker()
	/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000647e0 sp=0xc000064750 pc=0x4212a5
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000647e8 sp=0xc0000647e0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 24 [GC worker (idle)]:
runtime.gopark(0x149469d19689?, 0x3?, 0xcb?, 0x41?, 0x0?)
	/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000064f50 sp=0xc000064f30 pc=0x43e6ae
runtime.gcBgMarkWorker()
	/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000064fe0 sp=0xc000064f50 pc=0x4212a5
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000064fe8 sp=0xc000064fe0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 25 [GC worker (idle)]:
runtime.gopark(0x149469d19f53?, 0x3?, 0x44?, 0x9f?, 0x0?)
	/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000065750 sp=0xc000065730 pc=0x43e6ae
runtime.gcBgMarkWorker()
	/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000657e0 sp=0xc000065750 pc=0x4212a5
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000657e8 sp=0xc0000657e0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 26 [GC worker (idle)]:
runtime.gopark(0x149469d21037?, 0x1?, 0x96?, 0x19?, 0x0?)
	/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000065f50 sp=0xc000065f30 pc=0x43e6ae
runtime.gcBgMarkWorker()
	/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000065fe0 sp=0xc000065f50 pc=0x4212a5
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000065fe8 sp=0xc000065fe0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 27 [GC worker (idle)]:
runtime.gopark(0x149469d1a089?, 0x1?, 0x63?, 0x33?, 0x0?)
	/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0004b2750 sp=0xc0004b2730 pc=0x43e6ae
runtime.gcBgMarkWorker()
	/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0004b27e0 sp=0xc0004b2750 pc=0x4212a5
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0004b27e8 sp=0xc0004b27e0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 28 [GC worker (idle)]:
runtime.gopark(0x149469d19625?, 0x1?, 0x7f?, 0x20?, 0x0?)
	/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0004b2f50 sp=0xc0004b2f30 pc=0x43e6ae
runtime.gcBgMarkWorker()
	/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0004b2fe0 sp=0xc0004b2f50 pc=0x4212a5
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0004b2fe8 sp=0xc0004b2fe0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 29 [GC worker (idle)]:
runtime.gopark(0x149469d319ad?, 0x3?, 0xf9?, 0x1e?, 0x0?)
	/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0004b3750 sp=0xc0004b3730 pc=0x43e6ae
runtime.gcBgMarkWorker()
	/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0004b37e0 sp=0xc0004b3750 pc=0x4212a5
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0004b37e8 sp=0xc0004b37e0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 30 [GC worker (idle)]:
runtime.gopark(0x10b08520?, 0x1?, 0x8f?, 0x21?, 0x0?)
	/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0004b3f50 sp=0xc0004b3f30 pc=0x43e6ae
runtime.gcBgMarkWorker()
	/usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0004b3fe0 sp=0xc0004b3f50 pc=0x4212a5
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0004b3fe8 sp=0xc0004b3fe0 pc=0x46e0a1
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 34 [select, locked to thread]:
runtime.gopark(0xc0004ae7a8?, 0x2?, 0x60?, 0xe6?, 0xc0004ae7a4?)
	/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0004ae638 sp=0xc0004ae618 pc=0x43e6ae
runtime.selectgo(0xc0004ae7a8, 0xc0004ae7a0, 0x0?, 0x0, 0x0?, 0x1)
	/usr/local/go/src/runtime/select.go:327 +0x725 fp=0xc0004ae758 sp=0xc0004ae638 pc=0x44e1e5
runtime.ensureSigM.func1()
	/usr/local/go/src/runtime/signal_unix.go:1014 +0x19f fp=0xc0004ae7e0 sp=0xc0004ae758 pc=0x46521f
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0004ae7e8 sp=0xc0004ae7e0 pc=0x46e0a1
created by runtime.ensureSigM in goroutine 1
	/usr/local/go/src/runtime/signal_unix.go:997 +0xc8

goroutine 35 [syscall]:
runtime.notetsleepg(0x0?, 0x0?)
	/usr/local/go/src/runtime/lock_futex.go:236 +0x29 fp=0xc0004aefa0 sp=0xc0004aef68 pc=0x411209
os/signal.signal_recv()
	/usr/local/go/src/runtime/sigqueue.go:152 +0x29 fp=0xc0004aefc0 sp=0xc0004aefa0 pc=0x46aa69
os/signal.loop()
	/usr/local/go/src/os/signal/signal_unix.go:23 +0x13 fp=0xc0004aefe0 sp=0xc0004aefc0 pc=0x6f3dd3
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0004aefe8 sp=0xc0004aefe0 pc=0x46e0a1
created by os/signal.Notify.func1.1 in goroutine 1
	/usr/local/go/src/os/signal/signal.go:151 +0x1f

goroutine 36 [chan receive]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0004af718 sp=0xc0004af6f8 pc=0x43e6ae
runtime.chanrecv(0xc0006220c0, 0x0, 0x1)
	/usr/local/go/src/runtime/chan.go:583 +0x3cd fp=0xc0004af790 sp=0xc0004af718 pc=0x40beed
runtime.chanrecv1(0x0?, 0x0?)
	/usr/local/go/src/runtime/chan.go:442 +0x12 fp=0xc0004af7b8 sp=0xc0004af790 pc=0x40baf2
github.com/jmorganca/ollama/server.Serve.func1()
	/go/src/github.com/jmorganca/ollama/server/routes.go:959 +0x25 fp=0xc0004af7e0 sp=0xc0004af7b8 pc=0x99b5e5
runtime.goexit()
	/usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0004af7e8 sp=0xc0004af7e0 pc=0x46e0a1
created by github.com/jmorganca/ollama/server.Serve in goroutine 1
	/go/src/github.com/jmorganca/ollama/server/routes.go:958 +0x3f6

rax    0x7f4884000c10
rbx    0xc000496500
rcx    0x7f4884000030
rdx    0x1a
rdi    0x7f489b7fdbe0
rsi    0x100
rbp    0x7f489b7fde00
rsp    0x7f489b7fdbd8
r8     0x7f48840004c0
r9     0x7f48840004c0
r10    0x0
r11    0x30
r12    0x9
r13    0x7f489b7fddd0
r14    0x7f489b7fdbe0
r15    0x0
rip    0x7f488f03d710
rflags 0x10206
cs     0x33
fs     0x0
gs     0x0
<!-- gh-comment-id:1912395194 --> @khlopkov commented on GitHub (Jan 26, 2024): Having the same for version `0.1.21` The command ```bash OLLAMA_DEBUG=1 ollama serve ``` gives the following output: ```log time=2024-01-26T18:05:41.703+01:00 level=DEBUG source=/go/src/github.com/jmorganca/ollama/server/routes.go:926 msg="Debug logging enabled" time=2024-01-26T18:05:41.704+01:00 level=INFO source=/go/src/github.com/jmorganca/ollama/server/images.go:857 msg="total blobs: 0" time=2024-01-26T18:05:41.704+01:00 level=INFO source=/go/src/github.com/jmorganca/ollama/server/images.go:864 msg="total unused blobs removed: 0" time=2024-01-26T18:05:41.704+01:00 level=INFO source=/go/src/github.com/jmorganca/ollama/server/routes.go:950 msg="Listening on 127.0.0.1:11434 (version 0.1.21)" time=2024-01-26T18:05:41.704+01:00 level=INFO source=/go/src/github.com/jmorganca/ollama/llm/payload_common.go:106 msg="Extracting dynamic libraries..." time=2024-01-26T18:05:43.454+01:00 level=INFO source=/go/src/github.com/jmorganca/ollama/llm/payload_common.go:145 msg="Dynamic LLM libraries [cpu_avx2 rocm_v6 cpu cpu_avx rocm_v5 cuda_v11]" time=2024-01-26T18:05:43.454+01:00 level=DEBUG source=/go/src/github.com/jmorganca/ollama/llm/payload_common.go:146 msg="Override detection logic by setting OLLAMA_LLM_LIBRARY" time=2024-01-26T18:05:43.454+01:00 level=INFO source=/go/src/github.com/jmorganca/ollama/gpu/gpu.go:93 msg="Detecting GPU type" time=2024-01-26T18:05:43.454+01:00 level=INFO source=/go/src/github.com/jmorganca/ollama/gpu/gpu.go:212 msg="Searching for GPU management library libnvidia-ml.so" time=2024-01-26T18:05:43.454+01:00 level=DEBUG source=/go/src/github.com/jmorganca/ollama/gpu/gpu.go:230 msg="gpu management search paths: [/usr/local/cuda/lib64/libnvidia-ml.so* /usr/lib/x86_64-linux-gnu/nvidia/current/libnvidia-ml.so* /usr/lib/x86_64-linux-gnu/libnvidia-ml.so* /usr/lib/wsl/lib/libnvidia-ml.so* /usr/lib/wsl/drivers/*/libnvidia-ml.so* /opt/cuda/lib64/libnvidia-ml.so* /usr/lib*/libnvidia-ml.so* /usr/local/lib*/libnvidia-ml.so* /usr/lib/aarch64-linux-gnu/nvidia/current/libnvidia-ml.so* /usr/lib/aarch64-linux-gnu/libnvidia-ml.so* /opt/cuda/targets/x86_64-linux/lib/stubs/libnvidia-ml.so* /nix/store/3vd7sbdqcyq8fwjayq491c276z2bh62m-mesa-23.1.9-drivers/lib/libnvidia-ml.so* /nix/store/7hrxsj2hhig5b29ys11gcy3442khhrai-mesa-23.1.9-drivers/lib/libnvidia-ml.so* /nix/store/aczx78ym4sxn5x0bk9rrn1gnfvhqkp5b-libvdpau-va-gl-0.4.2/lib/vdpau/libnvidia-ml.so* /nix/store/zy4608fdbi833gqp56mk26znzay7vdcj-libvdpau-va-gl-0.4.2/lib/vdpau/libnvidia-ml.so* /nix/store/zg7jz7rh90sgv0cib4r8bq3dqjf5mpm6-mesa_glxindirect/lib/libnvidia-ml.so* /nix/store/cnqf3bxcb77wc2vapx3dy9s36a7d6mz7-libglvnd-1.7.0/lib/libnvidia-ml.so*]" time=2024-01-26T18:05:43.455+01:00 level=INFO source=/go/src/github.com/jmorganca/ollama/gpu/gpu.go:258 msg="Discovered GPU libraries: [/usr/lib/x86_64-linux-gnu/nvidia/current/libnvidia-ml.so.525.147.05]" wiring nvidia management library functions in /usr/lib/x86_64-linux-gnu/nvidia/current/libnvidia-ml.so.525.147.05 dlsym: nvmlInit_v2 dlsym: nvmlShutdown dlsym: nvmlDeviceGetHandleByIndex dlsym: nvmlDeviceGetMemoryInfo dlsym: nvmlDeviceGetCount_v2 dlsym: nvmlDeviceGetCudaComputeCapability dlsym: nvmlSystemGetDriverVersion dlsym: nvmlDeviceGetName dlsym: nvmlDeviceGetSerial dlsym: nvmlDeviceGetVbiosVersion dlsym: nvmlDeviceGetBoardPartNumber dlsym: nvmlDeviceGetBrand nvmlInit_v2 err: 9 SIGSEGV: segmentation violation PC=0x7f488f03d710 m=13 sigcode=1 signal arrived during cgo execution goroutine 1 [syscall]: runtime.cgocall(0x9b6eb0, 0xc0001658a8) /usr/local/go/src/runtime/cgocall.go:157 +0x4b fp=0xc000165880 sp=0xc000165848 pc=0x409b0b github.com/jmorganca/ollama/gpu._Cfunc_cuda_init(0x7f4884000b70, 0xc000496500) _cgo_gotypes.go:248 +0x3f fp=0xc0001658a8 sp=0xc000165880 pc=0x7b9cdf github.com/jmorganca/ollama/gpu.LoadCUDAMgmt.func2(0xc000042150?, 0x43?) /go/src/github.com/jmorganca/ollama/gpu/gpu.go:268 +0x4a fp=0xc0001658e8 sp=0xc0001658a8 pc=0x7bbaca github.com/jmorganca/ollama/gpu.LoadCUDAMgmt({0xc000042230, 0x1, 0xc00014e4d0?}) /go/src/github.com/jmorganca/ollama/gpu/gpu.go:268 +0x1b8 fp=0xc000165988 sp=0xc0001658e8 pc=0x7bb998 github.com/jmorganca/ollama/gpu.initGPUHandles() /go/src/github.com/jmorganca/ollama/gpu/gpu.go:96 +0xd1 fp=0xc0001659f0 sp=0xc000165988 pc=0x7ba131 github.com/jmorganca/ollama/gpu.GetGPUInfo() /go/src/github.com/jmorganca/ollama/gpu/gpu.go:121 +0xb5 fp=0xc000165b00 sp=0xc0001659f0 pc=0x7ba2f5 github.com/jmorganca/ollama/gpu.CheckVRAM() /go/src/github.com/jmorganca/ollama/gpu/gpu.go:194 +0x1f fp=0xc000165ba8 sp=0xc000165b00 pc=0x7bafdf github.com/jmorganca/ollama/server.Serve({0x106c11d0, 0xc00046d560}) /go/src/github.com/jmorganca/ollama/server/routes.go:972 +0x453 fp=0xc000165c98 sp=0xc000165ba8 pc=0x99b513 github.com/jmorganca/ollama/cmd.RunServer(0xc000494300?, {0x10b06800?, 0x4?, 0xad25c1?}) /go/src/github.com/jmorganca/ollama/cmd/cmd.go:692 +0x199 fp=0xc000165d30 sp=0xc000165c98 pc=0x9ad9f9 github.com/spf13/cobra.(*Command).execute(0xc000459800, {0x10b06800, 0x0, 0x0}) /root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:940 +0x87c fp=0xc000165e68 sp=0xc000165d30 pc=0x7641dc github.com/spf13/cobra.(*Command).ExecuteC(0xc000458c00) /root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:1068 +0x3a5 fp=0xc000165f20 sp=0xc000165e68 pc=0x764a05 github.com/spf13/cobra.(*Command).Execute(...) /root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:992 github.com/spf13/cobra.(*Command).ExecuteContext(...) /root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:985 main.main() /go/src/github.com/jmorganca/ollama/main.go:11 +0x4d fp=0xc000165f40 sp=0xc000165f20 pc=0x9b5a2d runtime.main() /usr/local/go/src/runtime/proc.go:267 +0x2bb fp=0xc000165fe0 sp=0xc000165f40 pc=0x43e25b runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000165fe8 sp=0xc000165fe0 pc=0x46e0a1 goroutine 2 [force gc (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000066fa8 sp=0xc000066f88 pc=0x43e6ae runtime.goparkunlock(...) /usr/local/go/src/runtime/proc.go:404 runtime.forcegchelper() /usr/local/go/src/runtime/proc.go:322 +0xb3 fp=0xc000066fe0 sp=0xc000066fa8 pc=0x43e533 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000066fe8 sp=0xc000066fe0 pc=0x46e0a1 created by runtime.init.6 in goroutine 1 /usr/local/go/src/runtime/proc.go:310 +0x1a goroutine 3 [GC sweep wait]: runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000067778 sp=0xc000067758 pc=0x43e6ae runtime.goparkunlock(...) /usr/local/go/src/runtime/proc.go:404 runtime.bgsweep(0x0?) /usr/local/go/src/runtime/mgcsweep.go:321 +0xdf fp=0xc0000677c8 sp=0xc000067778 pc=0x42a5ff runtime.gcenable.func1() /usr/local/go/src/runtime/mgc.go:200 +0x25 fp=0xc0000677e0 sp=0xc0000677c8 pc=0x41f725 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000677e8 sp=0xc0000677e0 pc=0x46e0a1 created by runtime.gcenable in goroutine 1 /usr/local/go/src/runtime/mgc.go:200 +0x66 goroutine 4 [GC scavenge wait]: runtime.gopark(0x18edcfe?, 0x18a33f5?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000067f70 sp=0xc000067f50 pc=0x43e6ae runtime.goparkunlock(...) /usr/local/go/src/runtime/proc.go:404 runtime.(*scavengerState).park(0x10ad6b80) /usr/local/go/src/runtime/mgcscavenge.go:425 +0x49 fp=0xc000067fa0 sp=0xc000067f70 pc=0x427e29 runtime.bgscavenge(0x0?) /usr/local/go/src/runtime/mgcscavenge.go:658 +0x59 fp=0xc000067fc8 sp=0xc000067fa0 pc=0x4283d9 runtime.gcenable.func2() /usr/local/go/src/runtime/mgc.go:201 +0x25 fp=0xc000067fe0 sp=0xc000067fc8 pc=0x41f6c5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000067fe8 sp=0xc000067fe0 pc=0x46e0a1 created by runtime.gcenable in goroutine 1 /usr/local/go/src/runtime/mgc.go:201 +0xa5 goroutine 18 [finalizer wait]: runtime.gopark(0xacb580?, 0x10043f801?, 0x0?, 0x0?, 0x446865?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000066628 sp=0xc000066608 pc=0x43e6ae runtime.runfinq() /usr/local/go/src/runtime/mfinal.go:193 +0x107 fp=0xc0000667e0 sp=0xc000066628 pc=0x41e7a7 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000667e8 sp=0xc0000667e0 pc=0x46e0a1 created by runtime.createfing in goroutine 1 /usr/local/go/src/runtime/mfinal.go:163 +0x3d goroutine 19 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000062750 sp=0xc000062730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000627e0 sp=0xc000062750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000627e8 sp=0xc0000627e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 20 [GC worker (idle)]: runtime.gopark(0x1494598b4808?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000062f50 sp=0xc000062f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000062fe0 sp=0xc000062f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000062fe8 sp=0xc000062fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 21 [GC worker (idle)]: runtime.gopark(0x149469d1a165?, 0x1?, 0xea?, 0x60?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000063750 sp=0xc000063730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000637e0 sp=0xc000063750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000637e8 sp=0xc0000637e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 22 [GC worker (idle)]: runtime.gopark(0x1494598b4556?, 0x3?, 0x5a?, 0xed?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000063f50 sp=0xc000063f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000063fe0 sp=0xc000063f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000063fe8 sp=0xc000063fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 23 [GC worker (idle)]: runtime.gopark(0x1494598b47e0?, 0x1?, 0x4e?, 0x3e?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000064750 sp=0xc000064730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000647e0 sp=0xc000064750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000647e8 sp=0xc0000647e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 24 [GC worker (idle)]: runtime.gopark(0x149469d19689?, 0x3?, 0xcb?, 0x41?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000064f50 sp=0xc000064f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000064fe0 sp=0xc000064f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000064fe8 sp=0xc000064fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 25 [GC worker (idle)]: runtime.gopark(0x149469d19f53?, 0x3?, 0x44?, 0x9f?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000065750 sp=0xc000065730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000657e0 sp=0xc000065750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000657e8 sp=0xc0000657e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 26 [GC worker (idle)]: runtime.gopark(0x149469d21037?, 0x1?, 0x96?, 0x19?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000065f50 sp=0xc000065f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000065fe0 sp=0xc000065f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000065fe8 sp=0xc000065fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 27 [GC worker (idle)]: runtime.gopark(0x149469d1a089?, 0x1?, 0x63?, 0x33?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0004b2750 sp=0xc0004b2730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0004b27e0 sp=0xc0004b2750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0004b27e8 sp=0xc0004b27e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 28 [GC worker (idle)]: runtime.gopark(0x149469d19625?, 0x1?, 0x7f?, 0x20?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0004b2f50 sp=0xc0004b2f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0004b2fe0 sp=0xc0004b2f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0004b2fe8 sp=0xc0004b2fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 29 [GC worker (idle)]: runtime.gopark(0x149469d319ad?, 0x3?, 0xf9?, 0x1e?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0004b3750 sp=0xc0004b3730 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0004b37e0 sp=0xc0004b3750 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0004b37e8 sp=0xc0004b37e0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 30 [GC worker (idle)]: runtime.gopark(0x10b08520?, 0x1?, 0x8f?, 0x21?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0004b3f50 sp=0xc0004b3f30 pc=0x43e6ae runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0004b3fe0 sp=0xc0004b3f50 pc=0x4212a5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0004b3fe8 sp=0xc0004b3fe0 pc=0x46e0a1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 34 [select, locked to thread]: runtime.gopark(0xc0004ae7a8?, 0x2?, 0x60?, 0xe6?, 0xc0004ae7a4?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0004ae638 sp=0xc0004ae618 pc=0x43e6ae runtime.selectgo(0xc0004ae7a8, 0xc0004ae7a0, 0x0?, 0x0, 0x0?, 0x1) /usr/local/go/src/runtime/select.go:327 +0x725 fp=0xc0004ae758 sp=0xc0004ae638 pc=0x44e1e5 runtime.ensureSigM.func1() /usr/local/go/src/runtime/signal_unix.go:1014 +0x19f fp=0xc0004ae7e0 sp=0xc0004ae758 pc=0x46521f runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0004ae7e8 sp=0xc0004ae7e0 pc=0x46e0a1 created by runtime.ensureSigM in goroutine 1 /usr/local/go/src/runtime/signal_unix.go:997 +0xc8 goroutine 35 [syscall]: runtime.notetsleepg(0x0?, 0x0?) /usr/local/go/src/runtime/lock_futex.go:236 +0x29 fp=0xc0004aefa0 sp=0xc0004aef68 pc=0x411209 os/signal.signal_recv() /usr/local/go/src/runtime/sigqueue.go:152 +0x29 fp=0xc0004aefc0 sp=0xc0004aefa0 pc=0x46aa69 os/signal.loop() /usr/local/go/src/os/signal/signal_unix.go:23 +0x13 fp=0xc0004aefe0 sp=0xc0004aefc0 pc=0x6f3dd3 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0004aefe8 sp=0xc0004aefe0 pc=0x46e0a1 created by os/signal.Notify.func1.1 in goroutine 1 /usr/local/go/src/os/signal/signal.go:151 +0x1f goroutine 36 [chan receive]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0004af718 sp=0xc0004af6f8 pc=0x43e6ae runtime.chanrecv(0xc0006220c0, 0x0, 0x1) /usr/local/go/src/runtime/chan.go:583 +0x3cd fp=0xc0004af790 sp=0xc0004af718 pc=0x40beed runtime.chanrecv1(0x0?, 0x0?) /usr/local/go/src/runtime/chan.go:442 +0x12 fp=0xc0004af7b8 sp=0xc0004af790 pc=0x40baf2 github.com/jmorganca/ollama/server.Serve.func1() /go/src/github.com/jmorganca/ollama/server/routes.go:959 +0x25 fp=0xc0004af7e0 sp=0xc0004af7b8 pc=0x99b5e5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0004af7e8 sp=0xc0004af7e0 pc=0x46e0a1 created by github.com/jmorganca/ollama/server.Serve in goroutine 1 /go/src/github.com/jmorganca/ollama/server/routes.go:958 +0x3f6 rax 0x7f4884000c10 rbx 0xc000496500 rcx 0x7f4884000030 rdx 0x1a rdi 0x7f489b7fdbe0 rsi 0x100 rbp 0x7f489b7fde00 rsp 0x7f489b7fdbd8 r8 0x7f48840004c0 r9 0x7f48840004c0 r10 0x0 r11 0x30 r12 0x9 r13 0x7f489b7fddd0 r14 0x7f489b7fdbe0 r15 0x0 rip 0x7f488f03d710 rflags 0x10206 cs 0x33 fs 0x0 gs 0x0 ```
GiteaMirror commented 2026-05-03 12:54:00 -05:00
Author
Owner
Copy Link

@dhiltgen commented on GitHub (Jan 26, 2024):

Thanks @khlopkov! I see the bug now - fix will be up shortly.

No need for anyone else to grab debug logs.

<!-- gh-comment-id:1912400763 --> @dhiltgen commented on GitHub (Jan 26, 2024): Thanks @khlopkov! I see the bug now - fix will be up shortly. No need for anyone else to grab debug logs.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
 python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
No Label bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#63293
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?