github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-05-07 00:22:43 -05:00
Code Issues 14.5k Packages Projects Releases 120 Wiki Activity

[GH-ISSUE #2573] Ollama for Windows, seems to crash on GPU with cuda #48025

New Issue
Closed
opened 2026-04-28 06:27:47 -05:00 by GiteaMirror · 2 comments
GiteaMirror commented 2026-04-28 06:27:47 -05:00
Owner
Copy Link

Originally created by @amonpaike on GitHub (Feb 18, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/2573

My GTX 1060 gpu has little vram, 3GB but with the smaller models it works great and on native linux it is super fast with for example tinyllama stablelm2 phi2 etc.

On windows with cuda it seems to crash. I start a model with for example "ollama run stablelm2" and after a few seconds it crashes.

On the CPU even if my cpu only uses AVX. It's slow but seems to work well. To start a model on CPU I must first start some app that consumes all the GPU VRAM, and olllama starts on CPU. (It's a trick I used due to lack of knowledge.)

Analyzing the log from the "ollama serve" command, it seems that there are some paths that aren't there on my computer:
C:/Program Files/Go/ etc...
and
C:/Users/jeff/git/ollama/ etc...
I don't know if the crash depends on this, in my little knowledge it's the only thing that seems anomalous to me.
I am on latest nvidia drivers available on windows: 531.79

On other llm management apps on windows 11 like llm studo and text-generation-webui I have no problems getting the models to work on the GPU.

C:\Users\noki>ollama serve
time=2024-02-18T12:16:23.109+01:00 level=INFO source=images.go:706 msg="total blobs: `10"`
time=2024-02-18T12:16:23.233+01:00 level=INFO source=images.go:713 msg="total unused blobs removed: 0"
time=2024-02-18T12:16:23.286+01:00 level=INFO source=routes.go:1014 msg="Listening on 127.0.0.1:11434 (version 0.1.25)"
time=2024-02-18T12:16:23.306+01:00 level=INFO source=payload_common.go:107 msg="Extracting dynamic libraries..."
time=2024-02-18T12:16:23.937+01:00 level=INFO source=payload_common.go:146 msg="Dynamic LLM libraries [cpu_avx cpu_avx2 cpu cuda_v11.3]"
[GIN] 2024/02/18 - 12:16:58 | 200 |            0s |       127.0.0.1 | HEAD     "/"
[GIN] 2024/02/18 - 12:16:58 | 200 |       3.832ms |       127.0.0.1 | POST     "/api/show"
[GIN] 2024/02/18 - 12:16:58 | 200 |      2.2639ms |       127.0.0.1 | POST     "/api/show"
time=2024-02-18T12:17:01.899+01:00 level=INFO source=gpu.go:94 msg="Detecting GPU type"
time=2024-02-18T12:17:01.899+01:00 level=INFO source=gpu.go:262 msg="Searching for GPU management library nvml.dll"
time=2024-02-18T12:17:01.909+01:00 level=INFO source=gpu.go:308 msg="Discovered GPU libraries: [c:\\Windows\\System32\\nvml.dll C:\\Windows\\system32\\nvml.dll]"
time=2024-02-18T12:17:01.945+01:00 level=INFO source=gpu.go:99 msg="Nvidia GPU detected"
time=2024-02-18T12:17:01.947+01:00 level=INFO source=cpu_common.go:15 msg="CPU has AVX"
time=2024-02-18T12:17:01.953+01:00 level=INFO source=gpu.go:146 msg="CUDA Compute Capability detected: 6.1"
time=2024-02-18T12:17:01.953+01:00 level=INFO source=cpu_common.go:15 msg="CPU has AVX"
time=2024-02-18T12:17:01.953+01:00 level=INFO source=gpu.go:146 msg="CUDA Compute Capability detected: 6.1"
time=2024-02-18T12:17:01.953+01:00 level=INFO source=cpu_common.go:15 msg="CPU has AVX"
time=2024-02-18T12:17:01.954+01:00 level=INFO source=dyn_ext_server.go:380 msg="Updating PATH to C:\\Users\\noki\\AppData\\Local\\Temp\\ollama1799801675\\cuda_v11.3;C:\\Windows\\system32;C:\\Windows;C:\\Windows\\System32\\Wbem;C:\\Windows\\System32\\WindowsPowerShell\\v1.0\\;C:\\Windows\\System32\\OpenSSH\\;C:\\Program Files (x86)\\ATI Technologies\\ATI.ACE\\Core-Static;C:\\Program Files (x86)\\NVIDIA Corporation\\PhysX\\Common;C:\\Program Files\\dotnet\\;C:\\Program Files\\gsudo\\Current;C:\\Users\\noki\\AppData\\Local\\Microsoft\\WindowsApps;C:\\adb;C:\\Users\\noki\\AppData\\Local\\Programs\\Python\\Python311\\Scripts\\;C:\\Users\\noki\\AppData\\Local\\Programs\\Python\\Python311\\;C:\\Users\\noki\\AppData\\Local\\Microsoft\\WindowsApps;;C:\\Users\\noki\\AppData\\Local\\Programs\\Ollama"
loading library C:\Users\noki\AppData\Local\Temp\ollama1799801675\cuda_v11.3\ext_server.dll
time=2024-02-18T12:17:02.756+01:00 level=INFO source=dyn_ext_server.go:90 msg="Loading Dynamic llm server: C:\\Users\\noki\\AppData\\Local\\Temp\\ollama1799801675\\cuda_v11.3\\ext_server.dll"
time=2024-02-18T12:17:02.756+01:00 level=INFO source=dyn_ext_server.go:145 msg="Initializing llama server"
ggml_init_cublas: GGML_CUDA_FORCE_MMQ:   no
ggml_init_cublas: CUDA_USE_TENSOR_CORES: yes
ggml_init_cublas: found 1 CUDA devices:
  Device 0: NVIDIA GeForce GTX 1060 3GB, compute capability 6.1, VMM: yes
Exception 0xc000001d 0x0 0x0 0x7ffa57df99dd
PC=0x7ffa57df99dd
signal arrived during external code execution

runtime.cgocall(0x7ff6cdf553c0, 0xc0001a6758)
        C:/Program Files/Go/src/runtime/cgocall.go:157 +0x3e fp=0xc0001a6730 sp=0xc0001a66f8 pc=0x7ff6cd9691be
github.com/jmorganca/ollama/llm._Cfunc_dyn_llama_server_init({0x7ffa57db0000, 0x7ffa57e3a1e0, 0x7ffa57e3ae00, 0x7ffa57e3ae80, 0x7ffa57e38660, 0x7ffa57e38820, 0x7ffa57e387a0, 0x7ffa57e3ade0, 0x7ffa57e3b540, 0x7ffa57e39560, ...}, ...)
        _cgo_gotypes.go:282 +0x4d fp=0xc0001a6758 sp=0xc0001a6730 pc=0x7ff6cdd58b8d
github.com/jmorganca/ollama/llm.newDynExtServer.func7(0xc0004ac140, 0xc00058e510)
        C:/Users/jeff/git/ollama/llm/dyn_ext_server.go:148 +0x112 fp=0xc0001a6898 sp=0xc0001a6758 pc=0x7ff6cdd5a2d2
github.com/jmorganca/ollama/llm.newDynExtServer({0xc0000cb700, 0x4b}, {0xc00022a180, _}, {_, _, _}, {0x0, 0x0, 0x0}, ...)
        C:/Users/jeff/git/ollama/llm/dyn_ext_server.go:148 +0xac5 fp=0xc0001a6ae0 sp=0xc0001a6898 pc=0x7ff6cdd59f05
github.com/jmorganca/ollama/llm.newLlmServer({{_, _, _}, {_, _}, {_, _}}, {_, _}, {0xc00022a180, ...}, ...)
        C:/Users/jeff/git/ollama/llm/llm.go:158 +0x4c5 fp=0xc0001a6ca0 sp=0xc0001a6ae0 pc=0x7ff6cdd563c5
github.com/jmorganca/ollama/llm.New({0xc0000208c0, 0x31}, {0xc00022a180, _}, {_, _, _}, {0x0, 0x0, 0x0}, ...)
        C:/Users/jeff/git/ollama/llm/llm.go:123 +0x78e fp=0xc0001a6f20 sp=0xc0001a6ca0 pc=0x7ff6cdd55cae
github.com/jmorganca/ollama/server.load(0xc00017e000, 0xc0001cc000, {{0x0, 0x800, 0x200, 0x1, 0xffffffffffffffff, 0x0, 0x0, 0x1, ...}, ...}, ...)
        C:/Users/jeff/git/ollama/server/routes.go:85 +0x3a9 fp=0xc0001a7090 sp=0xc0001a6f20 pc=0x7ff6cdf29c69
github.com/jmorganca/ollama/server.ChatHandler(0xc00017e000)
        C:/Users/jeff/git/ollama/server/routes.go:1163 +0x60b fp=0xc0001a7770 sp=0xc0001a7090 pc=0x7ff6cdf34ccb
github.com/gin-gonic/gin.(*Context).Next(...)
        C:/Users/jeff/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/context.go:174
github.com/jmorganca/ollama/server.(*Server).GenerateRoutes.func1(0xc00017e000)
        C:/Users/jeff/git/ollama/server/routes.go:938 +0x68 fp=0xc0001a77a8 sp=0xc0001a7770 pc=0x7ff6cdf338a8
github.com/gin-gonic/gin.(*Context).Next(...)
        C:/Users/jeff/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/context.go:174
github.com/gin-gonic/gin.CustomRecoveryWithWriter.func1(0xc00017e000)
        C:/Users/jeff/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/recovery.go:102 +0x7a fp=0xc0001a77f8 sp=0xc0001a77a8 pc=0x7ff6cdf0afda
github.com/gin-gonic/gin.(*Context).Next(...)
        C:/Users/jeff/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/context.go:174
github.com/gin-gonic/gin.LoggerWithConfig.func1(0xc00017e000)
        C:/Users/jeff/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/logger.go:240 +0xdd fp=0xc0001a79a8 sp=0xc0001a77f8 pc=0x7ff6cdf0a11d
github.com/gin-gonic/gin.(*Context).Next(...)
        C:/Users/jeff/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/context.go:174
github.com/gin-gonic/gin.(*Engine).handleHTTPRequest(0xc0004d41a0, 0xc00017e000)
        C:/Users/jeff/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/gin.go:620 +0x66e fp=0xc0001a7b28 sp=0xc0001a79a8 pc=0x7ff6cdf0964e
github.com/gin-gonic/gin.(*Engine).ServeHTTP(0xc0004d41a0, {0x7ff6cf3e5f00, 0xc00016c380}, 0xc000166360)
        C:/Users/jeff/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/gin.go:576 +0x1b2 fp=0xc0001a7b60 sp=0xc0001a7b28 pc=0x7ff6cdf08e12
net/http.serverHandler.ServeHTTP({0x7ff6cf3e41c0?}, {0x7ff6cf3e5f00?, 0xc00016c380?}, 0x6?)
        C:/Program Files/Go/src/net/http/server.go:3137 +0x8e fp=0xc0001a7b90 sp=0xc0001a7b60 pc=0x7ff6cdc5968e
net/http.(*conn).serve(0xc00016ac60, {0x7ff6cf3e7568, 0xc0004aa3c0})
        C:/Program Files/Go/src/net/http/server.go:2039 +0x5e8 fp=0xc0001a7fb8 sp=0xc0001a7b90 pc=0x7ff6cdc54a48
net/http.(*Server).Serve.gowrap3()
        C:/Program Files/Go/src/net/http/server.go:3285 +0x28 fp=0xc0001a7fe0 sp=0xc0001a7fb8 pc=0x7ff6cdc59ea8
runtime.goexit({})
        C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc0001a7fe8 sp=0xc0001a7fe0 pc=0x7ff6cd9d2081
created by net/http.(*Server).Serve in goroutine 1
        C:/Program Files/Go/src/net/http/server.go:3285 +0x4b4

goroutine 1 gp=0xc000058000 m=nil [IO wait]:
runtime.gopark(0xc000065008?, 0x7ff6cdfb6560?, 0xa0?, 0x16?, 0xc0001016d0?)
        C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc00051b6f8 sp=0xc00051b6d8 pc=0x7ff6cd9a12ee
runtime.netpollblock(0x1e4?, 0xcd968cc6?, 0xf6?)
        C:/Program Files/Go/src/runtime/netpoll.go:573 +0xf7 fp=0xc00051b730 sp=0xc00051b6f8 pc=0x7ff6cd998c37
internal/poll.runtime_pollWait(0x1b97d601ee0, 0x72)
        C:/Program Files/Go/src/runtime/netpoll.go:345 +0x85 fp=0xc00051b750 sp=0xc00051b730 pc=0x7ff6cd9cbb25
internal/poll.(*pollDesc).wait(0xc000065408?, 0x0?, 0x0)
        C:/Program Files/Go/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc00051b778 sp=0xc00051b750 pc=0x7ff6cda63bc7
internal/poll.execIO(0xc0001016a0, 0xc00051b818)
        C:/Program Files/Go/src/internal/poll/fd_windows.go:175 +0xe6 fp=0xc00051b7e8 sp=0xc00051b778 pc=0x7ff6cda650a6
internal/poll.(*FD).acceptOne(0xc000101688, 0x284, {0xc0004b80f0?, 0x0?, 0x0?}, 0xc000065008?)
        C:/Program Files/Go/src/internal/poll/fd_windows.go:944 +0x67 fp=0xc00051b848 sp=0xc00051b7e8 pc=0x7ff6cda69767
internal/poll.(*FD).Accept(0xc000101688, 0xc00051b9f8)
        C:/Program Files/Go/src/internal/poll/fd_windows.go:978 +0x1bc fp=0xc00051b900 sp=0xc00051b848 pc=0x7ff6cda69a9c
net.(*netFD).accept(0xc000101688)
        C:/Program Files/Go/src/net/fd_windows.go:178 +0x54 fp=0xc00051ba18 sp=0xc00051b900 pc=0x7ff6cdae50d4
net.(*TCPListener).accept(0xc000436420)
        C:/Program Files/Go/src/net/tcpsock_posix.go:159 +0x1e fp=0xc00051ba40 sp=0xc00051ba18 pc=0x7ff6cdafa57e
net.(*TCPListener).Accept(0xc000436420)
        C:/Program Files/Go/src/net/tcpsock.go:327 +0x30 fp=0xc00051ba70 sp=0xc00051ba40 pc=0x7ff6cdaf9670
net/http.(*onceCloseListener).Accept(0xc00016ac60?)
        <autogenerated>:1 +0x24 fp=0xc00051ba88 sp=0xc00051ba70 pc=0x7ff6cdc7c064
net/http.(*Server).Serve(0xc0001d4000, {0x7ff6cf3e5cf0, 0xc000436420})
        C:/Program Files/Go/src/net/http/server.go:3255 +0x33e fp=0xc00051bbb8 sp=0xc00051ba88 pc=0x7ff6cdc59abe
github.com/jmorganca/ollama/server.Serve({0x7ff6cf3e5cf0, 0xc000436420})
        C:/Users/jeff/git/ollama/server/routes.go:1041 +0x46f fp=0xc00051bcc0 sp=0xc00051bbb8 pc=0x7ff6cdf33d6f
github.com/jmorganca/ollama/cmd.RunServer(0xc0004ceb00?, {0x7ff6cf8718a0?, 0x4?, 0x7ff6ce0f0f6b?})
        C:/Users/jeff/git/ollama/cmd/cmd.go:706 +0x1a5 fp=0xc00051bd58 sp=0xc00051bcc0 pc=0x7ff6cdf4cbc5
github.com/spf13/cobra.(*Command).execute(0xc00001a908, {0x7ff6cf8718a0, 0x0, 0x0})
        C:/Users/jeff/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:940 +0x882 fp=0xc00051be78 sp=0xc00051bd58 pc=0x7ff6cdcf5462
github.com/spf13/cobra.(*Command).ExecuteC(0xc0000f7808)
        C:/Users/jeff/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:1068 +0x3a5 fp=0xc00051bf30 sp=0xc00051be78 pc=0x7ff6cdcf5ca5
github.com/spf13/cobra.(*Command).Execute(...)
        C:/Users/jeff/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:992
github.com/spf13/cobra.(*Command).ExecuteContext(...)
        C:/Users/jeff/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:985
main.main()
        C:/Users/jeff/git/ollama/main.go:11 +0x4d fp=0xc00051bf50 sp=0xc00051bf30 pc=0x7ff6cdf5512d
runtime.main()
        C:/Program Files/Go/src/runtime/proc.go:271 +0x28b fp=0xc00051bfe0 sp=0xc00051bf50 pc=0x7ff6cd9a0eeb
runtime.goexit({})
        C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc00051bfe8 sp=0xc00051bfe0 pc=0x7ff6cd9d2081

goroutine 2 gp=0xc000058700 m=nil [force gc (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
        C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc00005bfa8 sp=0xc00005bf88 pc=0x7ff6cd9a12ee
runtime.goparkunlock(...)
        C:/Program Files/Go/src/runtime/proc.go:408
runtime.forcegchelper()
        C:/Program Files/Go/src/runtime/proc.go:326 +0xb8 fp=0xc00005bfe0 sp=0xc00005bfa8 pc=0x7ff6cd9a1178
runtime.goexit({})
        C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc00005bfe8 sp=0xc00005bfe0 pc=0x7ff6cd9d2081
created by runtime.init.6 in goroutine 1
        C:/Program Files/Go/src/runtime/proc.go:314 +0x1a

goroutine 3 gp=0xc000058a80 m=nil [GC sweep wait]:
runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?)
        C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc00005df80 sp=0xc00005df60 pc=0x7ff6cd9a12ee
runtime.goparkunlock(...)
        C:/Program Files/Go/src/runtime/proc.go:408
runtime.bgsweep(0xc000028070)
        C:/Program Files/Go/src/runtime/mgcsweep.go:318 +0xdf fp=0xc00005dfc8 sp=0xc00005df80 pc=0x7ff6cd98b43f
runtime.gcenable.gowrap1()
        C:/Program Files/Go/src/runtime/mgc.go:203 +0x25 fp=0xc00005dfe0 sp=0xc00005dfc8 pc=0x7ff6cd97fce5
runtime.goexit({})
        C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc00005dfe8 sp=0xc00005dfe0 pc=0x7ff6cd9d2081
created by runtime.gcenable in goroutine 1
        C:/Program Files/Go/src/runtime/mgc.go:203 +0x66

goroutine 4 gp=0xc000058c40 m=nil [GC scavenge wait]:
runtime.gopark(0xe8ab48?, 0x7e6c93?, 0x0?, 0x0?, 0x0?)
        C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc00006df78 sp=0xc00006df58 pc=0x7ff6cd9a12ee
runtime.goparkunlock(...)
        C:/Program Files/Go/src/runtime/proc.go:408
runtime.(*scavengerState).park(0x7ff6cf7eaae0)
        C:/Program Files/Go/src/runtime/mgcscavenge.go:425 +0x49 fp=0xc00006dfa8 sp=0xc00006df78 pc=0x7ff6cd988dc9
runtime.bgscavenge(0xc000028070)
        C:/Program Files/Go/src/runtime/mgcscavenge.go:658 +0x59 fp=0xc00006dfc8 sp=0xc00006dfa8 pc=0x7ff6cd989379
runtime.gcenable.gowrap2()
        C:/Program Files/Go/src/runtime/mgc.go:204 +0x25 fp=0xc00006dfe0 sp=0xc00006dfc8 pc=0x7ff6cd97fc85
runtime.goexit({})
        C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc00006dfe8 sp=0xc00006dfe0 pc=0x7ff6cd9d2081
created by runtime.gcenable in goroutine 1
        C:/Program Files/Go/src/runtime/mgc.go:204 +0xa5

goroutine 5 gp=0xc000059180 m=nil [finalizer wait]:
runtime.gopark(0xc00005fe48?, 0x7ff6cd9730a5?, 0xa8?, 0x1?, 0xc000058000?)
        C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc00005fe20 sp=0xc00005fe00 pc=0x7ff6cd9a12ee
runtime.runfinq()
        C:/Program Files/Go/src/runtime/mfinal.go:194 +0x107 fp=0xc00005ffe0 sp=0xc00005fe20 pc=0x7ff6cd97ed67
runtime.goexit({})
        C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc00005ffe8 sp=0xc00005ffe0 pc=0x7ff6cd9d2081
created by runtime.createfing in goroutine 1
        C:/Program Files/Go/src/runtime/mfinal.go:164 +0x3d

goroutine 18 gp=0xc000084fc0 m=nil [GC worker (idle)]:
runtime.gopark(0x261f3dcbb704?, 0x1?, 0xfc?, 0xfa?, 0x0?)
        C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc000069f50 sp=0xc000069f30 pc=0x7ff6cd9a12ee
runtime.gcBgMarkWorker()
        C:/Program Files/Go/src/runtime/mgc.go:1310 +0xe5 fp=0xc000069fe0 sp=0xc000069f50 pc=0x7ff6cd981e25
runtime.goexit({})
        C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000069fe8 sp=0xc000069fe0 pc=0x7ff6cd9d2081
created by runtime.gcBgMarkStartWorkers in goroutine 1
        C:/Program Files/Go/src/runtime/mgc.go:1234 +0x1c

goroutine 19 gp=0xc000085180 m=nil [GC worker (idle)]:
runtime.gopark(0x261f3d139e80?, 0x3?, 0x0?, 0x0?, 0x0?)
        C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc00006bf50 sp=0xc00006bf30 pc=0x7ff6cd9a12ee
runtime.gcBgMarkWorker()
        C:/Program Files/Go/src/runtime/mgc.go:1310 +0xe5 fp=0xc00006bfe0 sp=0xc00006bf50 pc=0x7ff6cd981e25
runtime.goexit({})
        C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc00006bfe8 sp=0xc00006bfe0 pc=0x7ff6cd9d2081
created by runtime.gcBgMarkStartWorkers in goroutine 1
        C:/Program Files/Go/src/runtime/mgc.go:1234 +0x1c

goroutine 34 gp=0xc000482000 m=nil [GC worker (idle)]:
runtime.gopark(0x261f3dcbb704?, 0x3?, 0xfc?, 0xfa?, 0x0?)
        C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc000489f50 sp=0xc000489f30 pc=0x7ff6cd9a12ee
runtime.gcBgMarkWorker()
        C:/Program Files/Go/src/runtime/mgc.go:1310 +0xe5 fp=0xc000489fe0 sp=0xc000489f50 pc=0x7ff6cd981e25
runtime.goexit({})
        C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000489fe8 sp=0xc000489fe0 pc=0x7ff6cd9d2081
created by runtime.gcBgMarkStartWorkers in goroutine 1
        C:/Program Files/Go/src/runtime/mgc.go:1234 +0x1c

goroutine 35 gp=0xc0004821c0 m=nil [GC worker (idle)]:
runtime.gopark(0x261f3dcbb704?, 0x3?, 0xf8?, 0xca?, 0x0?)
        C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc00048bf50 sp=0xc00048bf30 pc=0x7ff6cd9a12ee
runtime.gcBgMarkWorker()
        C:/Program Files/Go/src/runtime/mgc.go:1310 +0xe5 fp=0xc00048bfe0 sp=0xc00048bf50 pc=0x7ff6cd981e25
runtime.goexit({})
        C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc00048bfe8 sp=0xc00048bfe0 pc=0x7ff6cd9d2081
created by runtime.gcBgMarkStartWorkers in goroutine 1
        C:/Program Files/Go/src/runtime/mgc.go:1234 +0x1c

goroutine 36 gp=0xc000482380 m=nil [GC worker (idle)]:
runtime.gopark(0x261f3dcbb704?, 0x3?, 0x0?, 0x0?, 0x0?)
        C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc000485f50 sp=0xc000485f30 pc=0x7ff6cd9a12ee
runtime.gcBgMarkWorker()
        C:/Program Files/Go/src/runtime/mgc.go:1310 +0xe5 fp=0xc000485fe0 sp=0xc000485f50 pc=0x7ff6cd981e25
runtime.goexit({})
        C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000485fe8 sp=0xc000485fe0 pc=0x7ff6cd9d2081
created by runtime.gcBgMarkStartWorkers in goroutine 1
        C:/Program Files/Go/src/runtime/mgc.go:1234 +0x1c

goroutine 37 gp=0xc000482540 m=nil [GC worker (idle)]:
runtime.gopark(0x261f3dcbb704?, 0x3?, 0xfc?, 0xfa?, 0x0?)
        C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc000487f50 sp=0xc000487f30 pc=0x7ff6cd9a12ee
runtime.gcBgMarkWorker()
        C:/Program Files/Go/src/runtime/mgc.go:1310 +0xe5 fp=0xc000487fe0 sp=0xc000487f50 pc=0x7ff6cd981e25
runtime.goexit({})
        C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000487fe8 sp=0xc000487fe0 pc=0x7ff6cd9d2081
created by runtime.gcBgMarkStartWorkers in goroutine 1
        C:/Program Files/Go/src/runtime/mgc.go:1234 +0x1c

goroutine 38 gp=0xc000482700 m=nil [GC worker (idle)]:
runtime.gopark(0x261f3dcbb704?, 0x1?, 0x0?, 0x0?, 0x0?)
        C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc000493f50 sp=0xc000493f30 pc=0x7ff6cd9a12ee
runtime.gcBgMarkWorker()
        C:/Program Files/Go/src/runtime/mgc.go:1310 +0xe5 fp=0xc000493fe0 sp=0xc000493f50 pc=0x7ff6cd981e25
runtime.goexit({})
        C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000493fe8 sp=0xc000493fe0 pc=0x7ff6cd9d2081
created by runtime.gcBgMarkStartWorkers in goroutine 1
        C:/Program Files/Go/src/runtime/mgc.go:1234 +0x1c

goroutine 6 gp=0xc000059500 m=nil [GC worker (idle)]:
runtime.gopark(0x261f3dcbb704?, 0x1?, 0x0?, 0x0?, 0x0?)
        C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc00006ff50 sp=0xc00006ff30 pc=0x7ff6cd9a12ee
runtime.gcBgMarkWorker()
        C:/Program Files/Go/src/runtime/mgc.go:1310 +0xe5 fp=0xc00006ffe0 sp=0xc00006ff50 pc=0x7ff6cd981e25
runtime.goexit({})
        C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc00006ffe8 sp=0xc00006ffe0 pc=0x7ff6cd9d2081
created by runtime.gcBgMarkStartWorkers in goroutine 1
        C:/Program Files/Go/src/runtime/mgc.go:1234 +0x1c

goroutine 7 gp=0xc0006041c0 m=0 mp=0x7ff6cf7ec420 [syscall]:
runtime.notetsleepg(0x7ff6cf872380, 0xffffffffffffffff)
        C:/Program Files/Go/src/runtime/lock_sema.go:296 +0x31 fp=0xc000491fa0 sp=0xc000491f68 pc=0x7ff6cd971671
os/signal.signal_recv()
        C:/Program Files/Go/src/runtime/sigqueue.go:152 +0x29 fp=0xc000491fc0 sp=0xc000491fa0 pc=0x7ff6cd9cdd69
os/signal.loop()
        C:/Program Files/Go/src/os/signal/signal_unix.go:23 +0x13 fp=0xc000491fe0 sp=0xc000491fc0 pc=0x7ff6cdc7e413
runtime.goexit({})
        C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000491fe8 sp=0xc000491fe0 pc=0x7ff6cd9d2081
created by os/signal.Notify.func1.1 in goroutine 1
        C:/Program Files/Go/src/os/signal/signal.go:151 +0x1f

goroutine 8 gp=0xc000604380 m=nil [chan receive]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
        C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc000495f18 sp=0xc000495ef8 pc=0x7ff6cd9a12ee
runtime.chanrecv(0xc00038c5a0, 0x0, 0x1)
        C:/Program Files/Go/src/runtime/chan.go:583 +0x3cd fp=0xc000495f90 sp=0xc000495f18 pc=0x7ff6cd96b84d
runtime.chanrecv1(0x0?, 0x0?)
        C:/Program Files/Go/src/runtime/chan.go:442 +0x12 fp=0xc000495fb8 sp=0xc000495f90 pc=0x7ff6cd96b452
github.com/jmorganca/ollama/server.Serve.func2()
        C:/Users/jeff/git/ollama/server/routes.go:1023 +0x25 fp=0xc000495fe0 sp=0xc000495fb8 pc=0x7ff6cdf33e05
runtime.goexit({})
        C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000495fe8 sp=0xc000495fe0 pc=0x7ff6cd9d2081
created by github.com/jmorganca/ollama/server.Serve in goroutine 1
        C:/Users/jeff/git/ollama/server/routes.go:1022 +0x3f6

goroutine 20 gp=0xc000085a40 m=nil [IO wait]:
runtime.gopark(0x0?, 0xc0006211a0?, 0x50?, 0x12?, 0xc0006211d0?)
        C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc000641890 sp=0xc000641870 pc=0x7ff6cd9a12ee
runtime.netpollblock(0x2a8?, 0xcd968cc6?, 0xf6?)
        C:/Program Files/Go/src/runtime/netpoll.go:573 +0xf7 fp=0xc0006418c8 sp=0xc000641890 pc=0x7ff6cd998c37
internal/poll.runtime_pollWait(0x1b97d601de8, 0x72)
        C:/Program Files/Go/src/runtime/netpoll.go:345 +0x85 fp=0xc0006418e8 sp=0xc0006418c8 pc=0x7ff6cd9cbb25
internal/poll.(*pollDesc).wait(0xc00050f968?, 0x7ff6cd97b6fd?, 0x0)
        C:/Program Files/Go/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc000641910 sp=0xc0006418e8 pc=0x7ff6cda63bc7
internal/poll.execIO(0xc0006211a0, 0x7ff6cf325970)
        C:/Program Files/Go/src/internal/poll/fd_windows.go:175 +0xe6 fp=0xc000641980 sp=0xc000641910 pc=0x7ff6cda650a6
internal/poll.(*FD).Read(0xc000621188, {0xc000649000, 0x1000, 0x1000})
        C:/Program Files/Go/src/internal/poll/fd_windows.go:436 +0x2b1 fp=0xc000641a28 sp=0xc000641980 pc=0x7ff6cda65d51
net.(*netFD).Read(0xc000621188, {0xc000649000?, 0xc00050fa98?, 0x7ff6cda640a5?})
        C:/Program Files/Go/src/net/fd_posix.go:55 +0x25 fp=0xc000641a70 sp=0xc000641a28 pc=0x7ff6cdae31e5
net.(*conn).Read(0xc0004c4020, {0xc000649000?, 0x0?, 0xc00002a638?})
        C:/Program Files/Go/src/net/net.go:179 +0x45 fp=0xc000641ab8 sp=0xc000641a70 pc=0x7ff6cdaf2265
net.(*TCPConn).Read(0xc00002a630?, {0xc000649000?, 0xc000621188?, 0xc00050faf0?})
        <autogenerated>:1 +0x25 fp=0xc000641ae8 sp=0xc000641ab8 pc=0x7ff6cdb02285
net/http.(*connReader).Read(0xc00002a630, {0xc000649000, 0x1000, 0x1000})
        C:/Program Files/Go/src/net/http/server.go:789 +0x14b fp=0xc000641b38 sp=0xc000641ae8 pc=0x7ff6cdc4ee4b
bufio.(*Reader).fill(0xc000686060)
        C:/Program Files/Go/src/bufio/bufio.go:110 +0x103 fp=0xc000641b70 sp=0xc000641b38 pc=0x7ff6cdbd28c3
bufio.(*Reader).Peek(0xc000686060, 0x4)
        C:/Program Files/Go/src/bufio/bufio.go:148 +0x53 fp=0xc000641b90 sp=0xc000641b70 pc=0x7ff6cdbd29f3
net/http.(*conn).serve(0xc00016a1b0, {0x7ff6cf3e7568, 0xc0004aa3c0})
        C:/Program Files/Go/src/net/http/server.go:2074 +0x749 fp=0xc000641fb8 sp=0xc000641b90 pc=0x7ff6cdc54ba9
net/http.(*Server).Serve.gowrap3()
        C:/Program Files/Go/src/net/http/server.go:3285 +0x28 fp=0xc000641fe0 sp=0xc000641fb8 pc=0x7ff6cdc59ea8
runtime.goexit({})
        C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000641fe8 sp=0xc000641fe0 pc=0x7ff6cd9d2081
created by net/http.(*Server).Serve in goroutine 1
        C:/Program Files/Go/src/net/http/server.go:3285 +0x4b4

goroutine 21 gp=0xc000085c00 m=nil [IO wait]:
runtime.gopark(0x0?, 0xc000621420?, 0xd0?, 0x14?, 0xc000621450?)
        C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc000645890 sp=0xc000645870 pc=0x7ff6cd9a12ee
runtime.netpollblock(0x2a4?, 0xcd968cc6?, 0xf6?)
        C:/Program Files/Go/src/runtime/netpoll.go:573 +0xf7 fp=0xc0006458c8 sp=0xc000645890 pc=0x7ff6cd998c37
internal/poll.runtime_pollWait(0x1b97d601cf0, 0x72)
        C:/Program Files/Go/src/runtime/netpoll.go:345 +0x85 fp=0xc0006458e8 sp=0xc0006458c8 pc=0x7ff6cd9cbb25
internal/poll.(*pollDesc).wait(0xc00050b930?, 0x7ff6cda6397c?, 0x0)
        C:/Program Files/Go/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc000645910 sp=0xc0006458e8 pc=0x7ff6cda63bc7
internal/poll.execIO(0xc000621420, 0x7ff6cf325970)
        C:/Program Files/Go/src/internal/poll/fd_windows.go:175 +0xe6 fp=0xc000645980 sp=0xc000645910 pc=0x7ff6cda650a6
internal/poll.(*FD).Read(0xc000621408, {0xc000528000, 0x1000, 0x1000})
        C:/Program Files/Go/src/internal/poll/fd_windows.go:436 +0x2b1 fp=0xc000645a28 sp=0xc000645980 pc=0x7ff6cda65d51
net.(*netFD).Read(0xc000621408, {0xc000528000?, 0xc00050ba98?, 0x7ff6cda640a5?})
        C:/Program Files/Go/src/net/fd_posix.go:55 +0x25 fp=0xc000645a70 sp=0xc000645a28 pc=0x7ff6cdae31e5
net.(*conn).Read(0xc0004c4028, {0xc000528000?, 0x0?, 0xc00002b6e8?})
        C:/Program Files/Go/src/net/net.go:179 +0x45 fp=0xc000645ab8 sp=0xc000645a70 pc=0x7ff6cdaf2265
net.(*TCPConn).Read(0xc00002b6e0?, {0xc000528000?, 0xc000621408?, 0xc00050baf0?})
        <autogenerated>:1 +0x25 fp=0xc000645ae8 sp=0xc000645ab8 pc=0x7ff6cdb02285
net/http.(*connReader).Read(0xc00002b6e0, {0xc000528000, 0x1000, 0x1000})
        C:/Program Files/Go/src/net/http/server.go:789 +0x14b fp=0xc000645b38 sp=0xc000645ae8 pc=0x7ff6cdc4ee4b
bufio.(*Reader).fill(0xc000686180)
        C:/Program Files/Go/src/bufio/bufio.go:110 +0x103 fp=0xc000645b70 sp=0xc000645b38 pc=0x7ff6cdbd28c3
bufio.(*Reader).Peek(0xc000686180, 0x4)
        C:/Program Files/Go/src/bufio/bufio.go:148 +0x53 fp=0xc000645b90 sp=0xc000645b70 pc=0x7ff6cdbd29f3
net/http.(*conn).serve(0xc00016a240, {0x7ff6cf3e7568, 0xc0004aa3c0})
        C:/Program Files/Go/src/net/http/server.go:2074 +0x749 fp=0xc000645fb8 sp=0xc000645b90 pc=0x7ff6cdc54ba9
net/http.(*Server).Serve.gowrap3()
        C:/Program Files/Go/src/net/http/server.go:3285 +0x28 fp=0xc000645fe0 sp=0xc000645fb8 pc=0x7ff6cdc59ea8
runtime.goexit({})
        C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000645fe8 sp=0xc000645fe0 pc=0x7ff6cd9d2081
created by net/http.(*Server).Serve in goroutine 1
        C:/Program Files/Go/src/net/http/server.go:3285 +0x4b4

goroutine 39 gp=0xc0005841c0 m=nil [IO wait]:
runtime.gopark(0x0?, 0xc000620ca0?, 0x50?, 0xd?, 0xc000620cd0?)
        C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc00048fd28 sp=0xc00048fd08 pc=0x7ff6cd9a12ee
runtime.netpollblock(0x2a0?, 0xcd968cc6?, 0xf6?)
        C:/Program Files/Go/src/runtime/netpoll.go:573 +0xf7 fp=0xc00048fd60 sp=0xc00048fd28 pc=0x7ff6cd998c37
internal/poll.runtime_pollWait(0x1b97d601bf8, 0x72)
        C:/Program Files/Go/src/runtime/netpoll.go:345 +0x85 fp=0xc00048fd80 sp=0xc00048fd60 pc=0x7ff6cd9cbb25
internal/poll.(*pollDesc).wait(0x10?, 0x10?, 0x0)
        C:/Program Files/Go/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc00048fda8 sp=0xc00048fd80 pc=0x7ff6cda63bc7
internal/poll.execIO(0xc000620ca0, 0x7ff6cf325970)
        C:/Program Files/Go/src/internal/poll/fd_windows.go:175 +0xe6 fp=0xc00048fe18 sp=0xc00048fda8 pc=0x7ff6cda650a6
internal/poll.(*FD).Read(0xc000620c88, {0xc0000882b1, 0x1, 0x1})
        C:/Program Files/Go/src/internal/poll/fd_windows.go:436 +0x2b1 fp=0xc00048fec0 sp=0xc00048fe18 pc=0x7ff6cda65d51
net.(*netFD).Read(0xc000620c88, {0xc0000882b1?, 0xc00048ff48?, 0x7ff6cd9cdab0?})
        C:/Program Files/Go/src/net/fd_posix.go:55 +0x25 fp=0xc00048ff08 sp=0xc00048fec0 pc=0x7ff6cdae31e5
net.(*conn).Read(0xc0004c41d0, {0xc0000882b1?, 0xc00048feb8?, 0x7ff6cf8718a0?})
        C:/Program Files/Go/src/net/net.go:179 +0x45 fp=0xc00048ff50 sp=0xc00048ff08 pc=0x7ff6cdaf2265
net.(*TCPConn).Read(0x7ff6cdfad8b0?, {0xc0000882b1?, 0xc00003b200?, 0x7ff6cdd4c480?})
        <autogenerated>:1 +0x25 fp=0xc00048ff80 sp=0xc00048ff50 pc=0x7ff6cdb02285
net/http.(*connReader).backgroundRead(0xc0000882a0)
        C:/Program Files/Go/src/net/http/server.go:681 +0x37 fp=0xc00048ffc8 sp=0xc00048ff80 pc=0x7ff6cdc4e9b7
net/http.(*connReader).startBackgroundRead.gowrap2()
        C:/Program Files/Go/src/net/http/server.go:677 +0x25 fp=0xc00048ffe0 sp=0xc00048ffc8 pc=0x7ff6cdc4e8e5
runtime.goexit({})
        C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc00048ffe8 sp=0xc00048ffe0 pc=0x7ff6cd9d2081
created by net/http.(*connReader).startBackgroundRead in goroutine 9
        C:/Program Files/Go/src/net/http/server.go:677 +0xba
rax     0xfffffffffffffff
rbx     0x1b97c194ae8
rcx     0x1b97c194b90
rdx     0x8
rdi     0x8f881ff900
rsi     0x1b97c194b90
rbp     0x1b97c0cd710
rsp     0x8f881ff2e0
r8      0x3b
r9      0x1
r10     0x7ffaadaf0000
r11     0x8f881ff2f0
r12     0xd6bf94d5e57a42bd
r13     0x0
r14     0x1b97c194b30
r15     0x1b97c0cd7c0
rip     0x7ffa57df99dd
rflags  0x10202
cs      0x33
fs      0x53
gs      0x2b
Originally created by @amonpaike on GitHub (Feb 18, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/2573 My GTX 1060 gpu has little vram, 3GB but with the smaller models **it works great and on native linux it is super fast** with for example tinyllama stablelm2 phi2 etc. **On windows with cuda it seems to crash. I start a model with for example "ollama run stablelm2" and after a few seconds it crashes.** On the CPU even if my cpu only uses AVX. It's slow but seems to work well. To start a model on CPU I must first start some app that consumes all the GPU VRAM, and olllama starts on CPU. (It's a trick I used due to lack of knowledge.) Analyzing the log from the "ollama serve" command, it seems that there are some paths that aren't there on my computer: **C:/Program Files/Go/ etc... and C:/Users/jeff/git/ollama/ etc...** I don't know if the crash depends on this, in my little knowledge it's the only thing that seems anomalous to me. I am on latest nvidia drivers available on windows: 531.79 On other llm management apps on windows 11 like **llm studo** and **text-generation-webu**i I have no problems getting the models to work on the GPU. ``` C:\Users\noki>ollama serve time=2024-02-18T12:16:23.109+01:00 level=INFO source=images.go:706 msg="total blobs: `10"` time=2024-02-18T12:16:23.233+01:00 level=INFO source=images.go:713 msg="total unused blobs removed: 0" time=2024-02-18T12:16:23.286+01:00 level=INFO source=routes.go:1014 msg="Listening on 127.0.0.1:11434 (version 0.1.25)" time=2024-02-18T12:16:23.306+01:00 level=INFO source=payload_common.go:107 msg="Extracting dynamic libraries..." time=2024-02-18T12:16:23.937+01:00 level=INFO source=payload_common.go:146 msg="Dynamic LLM libraries [cpu_avx cpu_avx2 cpu cuda_v11.3]" [GIN] 2024/02/18 - 12:16:58 | 200 | 0s | 127.0.0.1 | HEAD "/" [GIN] 2024/02/18 - 12:16:58 | 200 | 3.832ms | 127.0.0.1 | POST "/api/show" [GIN] 2024/02/18 - 12:16:58 | 200 | 2.2639ms | 127.0.0.1 | POST "/api/show" time=2024-02-18T12:17:01.899+01:00 level=INFO source=gpu.go:94 msg="Detecting GPU type" time=2024-02-18T12:17:01.899+01:00 level=INFO source=gpu.go:262 msg="Searching for GPU management library nvml.dll" time=2024-02-18T12:17:01.909+01:00 level=INFO source=gpu.go:308 msg="Discovered GPU libraries: [c:\\Windows\\System32\\nvml.dll C:\\Windows\\system32\\nvml.dll]" time=2024-02-18T12:17:01.945+01:00 level=INFO source=gpu.go:99 msg="Nvidia GPU detected" time=2024-02-18T12:17:01.947+01:00 level=INFO source=cpu_common.go:15 msg="CPU has AVX" time=2024-02-18T12:17:01.953+01:00 level=INFO source=gpu.go:146 msg="CUDA Compute Capability detected: 6.1" time=2024-02-18T12:17:01.953+01:00 level=INFO source=cpu_common.go:15 msg="CPU has AVX" time=2024-02-18T12:17:01.953+01:00 level=INFO source=gpu.go:146 msg="CUDA Compute Capability detected: 6.1" time=2024-02-18T12:17:01.953+01:00 level=INFO source=cpu_common.go:15 msg="CPU has AVX" time=2024-02-18T12:17:01.954+01:00 level=INFO source=dyn_ext_server.go:380 msg="Updating PATH to C:\\Users\\noki\\AppData\\Local\\Temp\\ollama1799801675\\cuda_v11.3;C:\\Windows\\system32;C:\\Windows;C:\\Windows\\System32\\Wbem;C:\\Windows\\System32\\WindowsPowerShell\\v1.0\\;C:\\Windows\\System32\\OpenSSH\\;C:\\Program Files (x86)\\ATI Technologies\\ATI.ACE\\Core-Static;C:\\Program Files (x86)\\NVIDIA Corporation\\PhysX\\Common;C:\\Program Files\\dotnet\\;C:\\Program Files\\gsudo\\Current;C:\\Users\\noki\\AppData\\Local\\Microsoft\\WindowsApps;C:\\adb;C:\\Users\\noki\\AppData\\Local\\Programs\\Python\\Python311\\Scripts\\;C:\\Users\\noki\\AppData\\Local\\Programs\\Python\\Python311\\;C:\\Users\\noki\\AppData\\Local\\Microsoft\\WindowsApps;;C:\\Users\\noki\\AppData\\Local\\Programs\\Ollama" loading library C:\Users\noki\AppData\Local\Temp\ollama1799801675\cuda_v11.3\ext_server.dll time=2024-02-18T12:17:02.756+01:00 level=INFO source=dyn_ext_server.go:90 msg="Loading Dynamic llm server: C:\\Users\\noki\\AppData\\Local\\Temp\\ollama1799801675\\cuda_v11.3\\ext_server.dll" time=2024-02-18T12:17:02.756+01:00 level=INFO source=dyn_ext_server.go:145 msg="Initializing llama server" ggml_init_cublas: GGML_CUDA_FORCE_MMQ: no ggml_init_cublas: CUDA_USE_TENSOR_CORES: yes ggml_init_cublas: found 1 CUDA devices: Device 0: NVIDIA GeForce GTX 1060 3GB, compute capability 6.1, VMM: yes Exception 0xc000001d 0x0 0x0 0x7ffa57df99dd PC=0x7ffa57df99dd signal arrived during external code execution runtime.cgocall(0x7ff6cdf553c0, 0xc0001a6758) C:/Program Files/Go/src/runtime/cgocall.go:157 +0x3e fp=0xc0001a6730 sp=0xc0001a66f8 pc=0x7ff6cd9691be github.com/jmorganca/ollama/llm._Cfunc_dyn_llama_server_init({0x7ffa57db0000, 0x7ffa57e3a1e0, 0x7ffa57e3ae00, 0x7ffa57e3ae80, 0x7ffa57e38660, 0x7ffa57e38820, 0x7ffa57e387a0, 0x7ffa57e3ade0, 0x7ffa57e3b540, 0x7ffa57e39560, ...}, ...) _cgo_gotypes.go:282 +0x4d fp=0xc0001a6758 sp=0xc0001a6730 pc=0x7ff6cdd58b8d github.com/jmorganca/ollama/llm.newDynExtServer.func7(0xc0004ac140, 0xc00058e510) C:/Users/jeff/git/ollama/llm/dyn_ext_server.go:148 +0x112 fp=0xc0001a6898 sp=0xc0001a6758 pc=0x7ff6cdd5a2d2 github.com/jmorganca/ollama/llm.newDynExtServer({0xc0000cb700, 0x4b}, {0xc00022a180, _}, {_, _, _}, {0x0, 0x0, 0x0}, ...) C:/Users/jeff/git/ollama/llm/dyn_ext_server.go:148 +0xac5 fp=0xc0001a6ae0 sp=0xc0001a6898 pc=0x7ff6cdd59f05 github.com/jmorganca/ollama/llm.newLlmServer({{_, _, _}, {_, _}, {_, _}}, {_, _}, {0xc00022a180, ...}, ...) C:/Users/jeff/git/ollama/llm/llm.go:158 +0x4c5 fp=0xc0001a6ca0 sp=0xc0001a6ae0 pc=0x7ff6cdd563c5 github.com/jmorganca/ollama/llm.New({0xc0000208c0, 0x31}, {0xc00022a180, _}, {_, _, _}, {0x0, 0x0, 0x0}, ...) C:/Users/jeff/git/ollama/llm/llm.go:123 +0x78e fp=0xc0001a6f20 sp=0xc0001a6ca0 pc=0x7ff6cdd55cae github.com/jmorganca/ollama/server.load(0xc00017e000, 0xc0001cc000, {{0x0, 0x800, 0x200, 0x1, 0xffffffffffffffff, 0x0, 0x0, 0x1, ...}, ...}, ...) C:/Users/jeff/git/ollama/server/routes.go:85 +0x3a9 fp=0xc0001a7090 sp=0xc0001a6f20 pc=0x7ff6cdf29c69 github.com/jmorganca/ollama/server.ChatHandler(0xc00017e000) C:/Users/jeff/git/ollama/server/routes.go:1163 +0x60b fp=0xc0001a7770 sp=0xc0001a7090 pc=0x7ff6cdf34ccb github.com/gin-gonic/gin.(*Context).Next(...) C:/Users/jeff/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/context.go:174 github.com/jmorganca/ollama/server.(*Server).GenerateRoutes.func1(0xc00017e000) C:/Users/jeff/git/ollama/server/routes.go:938 +0x68 fp=0xc0001a77a8 sp=0xc0001a7770 pc=0x7ff6cdf338a8 github.com/gin-gonic/gin.(*Context).Next(...) C:/Users/jeff/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/context.go:174 github.com/gin-gonic/gin.CustomRecoveryWithWriter.func1(0xc00017e000) C:/Users/jeff/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/recovery.go:102 +0x7a fp=0xc0001a77f8 sp=0xc0001a77a8 pc=0x7ff6cdf0afda github.com/gin-gonic/gin.(*Context).Next(...) C:/Users/jeff/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/context.go:174 github.com/gin-gonic/gin.LoggerWithConfig.func1(0xc00017e000) C:/Users/jeff/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/logger.go:240 +0xdd fp=0xc0001a79a8 sp=0xc0001a77f8 pc=0x7ff6cdf0a11d github.com/gin-gonic/gin.(*Context).Next(...) C:/Users/jeff/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/context.go:174 github.com/gin-gonic/gin.(*Engine).handleHTTPRequest(0xc0004d41a0, 0xc00017e000) C:/Users/jeff/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/gin.go:620 +0x66e fp=0xc0001a7b28 sp=0xc0001a79a8 pc=0x7ff6cdf0964e github.com/gin-gonic/gin.(*Engine).ServeHTTP(0xc0004d41a0, {0x7ff6cf3e5f00, 0xc00016c380}, 0xc000166360) C:/Users/jeff/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/gin.go:576 +0x1b2 fp=0xc0001a7b60 sp=0xc0001a7b28 pc=0x7ff6cdf08e12 net/http.serverHandler.ServeHTTP({0x7ff6cf3e41c0?}, {0x7ff6cf3e5f00?, 0xc00016c380?}, 0x6?) C:/Program Files/Go/src/net/http/server.go:3137 +0x8e fp=0xc0001a7b90 sp=0xc0001a7b60 pc=0x7ff6cdc5968e net/http.(*conn).serve(0xc00016ac60, {0x7ff6cf3e7568, 0xc0004aa3c0}) C:/Program Files/Go/src/net/http/server.go:2039 +0x5e8 fp=0xc0001a7fb8 sp=0xc0001a7b90 pc=0x7ff6cdc54a48 net/http.(*Server).Serve.gowrap3() C:/Program Files/Go/src/net/http/server.go:3285 +0x28 fp=0xc0001a7fe0 sp=0xc0001a7fb8 pc=0x7ff6cdc59ea8 runtime.goexit({}) C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc0001a7fe8 sp=0xc0001a7fe0 pc=0x7ff6cd9d2081 created by net/http.(*Server).Serve in goroutine 1 C:/Program Files/Go/src/net/http/server.go:3285 +0x4b4 goroutine 1 gp=0xc000058000 m=nil [IO wait]: runtime.gopark(0xc000065008?, 0x7ff6cdfb6560?, 0xa0?, 0x16?, 0xc0001016d0?) C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc00051b6f8 sp=0xc00051b6d8 pc=0x7ff6cd9a12ee runtime.netpollblock(0x1e4?, 0xcd968cc6?, 0xf6?) C:/Program Files/Go/src/runtime/netpoll.go:573 +0xf7 fp=0xc00051b730 sp=0xc00051b6f8 pc=0x7ff6cd998c37 internal/poll.runtime_pollWait(0x1b97d601ee0, 0x72) C:/Program Files/Go/src/runtime/netpoll.go:345 +0x85 fp=0xc00051b750 sp=0xc00051b730 pc=0x7ff6cd9cbb25 internal/poll.(*pollDesc).wait(0xc000065408?, 0x0?, 0x0) C:/Program Files/Go/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc00051b778 sp=0xc00051b750 pc=0x7ff6cda63bc7 internal/poll.execIO(0xc0001016a0, 0xc00051b818) C:/Program Files/Go/src/internal/poll/fd_windows.go:175 +0xe6 fp=0xc00051b7e8 sp=0xc00051b778 pc=0x7ff6cda650a6 internal/poll.(*FD).acceptOne(0xc000101688, 0x284, {0xc0004b80f0?, 0x0?, 0x0?}, 0xc000065008?) C:/Program Files/Go/src/internal/poll/fd_windows.go:944 +0x67 fp=0xc00051b848 sp=0xc00051b7e8 pc=0x7ff6cda69767 internal/poll.(*FD).Accept(0xc000101688, 0xc00051b9f8) C:/Program Files/Go/src/internal/poll/fd_windows.go:978 +0x1bc fp=0xc00051b900 sp=0xc00051b848 pc=0x7ff6cda69a9c net.(*netFD).accept(0xc000101688) C:/Program Files/Go/src/net/fd_windows.go:178 +0x54 fp=0xc00051ba18 sp=0xc00051b900 pc=0x7ff6cdae50d4 net.(*TCPListener).accept(0xc000436420) C:/Program Files/Go/src/net/tcpsock_posix.go:159 +0x1e fp=0xc00051ba40 sp=0xc00051ba18 pc=0x7ff6cdafa57e net.(*TCPListener).Accept(0xc000436420) C:/Program Files/Go/src/net/tcpsock.go:327 +0x30 fp=0xc00051ba70 sp=0xc00051ba40 pc=0x7ff6cdaf9670 net/http.(*onceCloseListener).Accept(0xc00016ac60?) <autogenerated>:1 +0x24 fp=0xc00051ba88 sp=0xc00051ba70 pc=0x7ff6cdc7c064 net/http.(*Server).Serve(0xc0001d4000, {0x7ff6cf3e5cf0, 0xc000436420}) C:/Program Files/Go/src/net/http/server.go:3255 +0x33e fp=0xc00051bbb8 sp=0xc00051ba88 pc=0x7ff6cdc59abe github.com/jmorganca/ollama/server.Serve({0x7ff6cf3e5cf0, 0xc000436420}) C:/Users/jeff/git/ollama/server/routes.go:1041 +0x46f fp=0xc00051bcc0 sp=0xc00051bbb8 pc=0x7ff6cdf33d6f github.com/jmorganca/ollama/cmd.RunServer(0xc0004ceb00?, {0x7ff6cf8718a0?, 0x4?, 0x7ff6ce0f0f6b?}) C:/Users/jeff/git/ollama/cmd/cmd.go:706 +0x1a5 fp=0xc00051bd58 sp=0xc00051bcc0 pc=0x7ff6cdf4cbc5 github.com/spf13/cobra.(*Command).execute(0xc00001a908, {0x7ff6cf8718a0, 0x0, 0x0}) C:/Users/jeff/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:940 +0x882 fp=0xc00051be78 sp=0xc00051bd58 pc=0x7ff6cdcf5462 github.com/spf13/cobra.(*Command).ExecuteC(0xc0000f7808) C:/Users/jeff/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:1068 +0x3a5 fp=0xc00051bf30 sp=0xc00051be78 pc=0x7ff6cdcf5ca5 github.com/spf13/cobra.(*Command).Execute(...) C:/Users/jeff/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:992 github.com/spf13/cobra.(*Command).ExecuteContext(...) C:/Users/jeff/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:985 main.main() C:/Users/jeff/git/ollama/main.go:11 +0x4d fp=0xc00051bf50 sp=0xc00051bf30 pc=0x7ff6cdf5512d runtime.main() C:/Program Files/Go/src/runtime/proc.go:271 +0x28b fp=0xc00051bfe0 sp=0xc00051bf50 pc=0x7ff6cd9a0eeb runtime.goexit({}) C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc00051bfe8 sp=0xc00051bfe0 pc=0x7ff6cd9d2081 goroutine 2 gp=0xc000058700 m=nil [force gc (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc00005bfa8 sp=0xc00005bf88 pc=0x7ff6cd9a12ee runtime.goparkunlock(...) C:/Program Files/Go/src/runtime/proc.go:408 runtime.forcegchelper() C:/Program Files/Go/src/runtime/proc.go:326 +0xb8 fp=0xc00005bfe0 sp=0xc00005bfa8 pc=0x7ff6cd9a1178 runtime.goexit({}) C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc00005bfe8 sp=0xc00005bfe0 pc=0x7ff6cd9d2081 created by runtime.init.6 in goroutine 1 C:/Program Files/Go/src/runtime/proc.go:314 +0x1a goroutine 3 gp=0xc000058a80 m=nil [GC sweep wait]: runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?) C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc00005df80 sp=0xc00005df60 pc=0x7ff6cd9a12ee runtime.goparkunlock(...) C:/Program Files/Go/src/runtime/proc.go:408 runtime.bgsweep(0xc000028070) C:/Program Files/Go/src/runtime/mgcsweep.go:318 +0xdf fp=0xc00005dfc8 sp=0xc00005df80 pc=0x7ff6cd98b43f runtime.gcenable.gowrap1() C:/Program Files/Go/src/runtime/mgc.go:203 +0x25 fp=0xc00005dfe0 sp=0xc00005dfc8 pc=0x7ff6cd97fce5 runtime.goexit({}) C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc00005dfe8 sp=0xc00005dfe0 pc=0x7ff6cd9d2081 created by runtime.gcenable in goroutine 1 C:/Program Files/Go/src/runtime/mgc.go:203 +0x66 goroutine 4 gp=0xc000058c40 m=nil [GC scavenge wait]: runtime.gopark(0xe8ab48?, 0x7e6c93?, 0x0?, 0x0?, 0x0?) C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc00006df78 sp=0xc00006df58 pc=0x7ff6cd9a12ee runtime.goparkunlock(...) C:/Program Files/Go/src/runtime/proc.go:408 runtime.(*scavengerState).park(0x7ff6cf7eaae0) C:/Program Files/Go/src/runtime/mgcscavenge.go:425 +0x49 fp=0xc00006dfa8 sp=0xc00006df78 pc=0x7ff6cd988dc9 runtime.bgscavenge(0xc000028070) C:/Program Files/Go/src/runtime/mgcscavenge.go:658 +0x59 fp=0xc00006dfc8 sp=0xc00006dfa8 pc=0x7ff6cd989379 runtime.gcenable.gowrap2() C:/Program Files/Go/src/runtime/mgc.go:204 +0x25 fp=0xc00006dfe0 sp=0xc00006dfc8 pc=0x7ff6cd97fc85 runtime.goexit({}) C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc00006dfe8 sp=0xc00006dfe0 pc=0x7ff6cd9d2081 created by runtime.gcenable in goroutine 1 C:/Program Files/Go/src/runtime/mgc.go:204 +0xa5 goroutine 5 gp=0xc000059180 m=nil [finalizer wait]: runtime.gopark(0xc00005fe48?, 0x7ff6cd9730a5?, 0xa8?, 0x1?, 0xc000058000?) C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc00005fe20 sp=0xc00005fe00 pc=0x7ff6cd9a12ee runtime.runfinq() C:/Program Files/Go/src/runtime/mfinal.go:194 +0x107 fp=0xc00005ffe0 sp=0xc00005fe20 pc=0x7ff6cd97ed67 runtime.goexit({}) C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc00005ffe8 sp=0xc00005ffe0 pc=0x7ff6cd9d2081 created by runtime.createfing in goroutine 1 C:/Program Files/Go/src/runtime/mfinal.go:164 +0x3d goroutine 18 gp=0xc000084fc0 m=nil [GC worker (idle)]: runtime.gopark(0x261f3dcbb704?, 0x1?, 0xfc?, 0xfa?, 0x0?) C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc000069f50 sp=0xc000069f30 pc=0x7ff6cd9a12ee runtime.gcBgMarkWorker() C:/Program Files/Go/src/runtime/mgc.go:1310 +0xe5 fp=0xc000069fe0 sp=0xc000069f50 pc=0x7ff6cd981e25 runtime.goexit({}) C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000069fe8 sp=0xc000069fe0 pc=0x7ff6cd9d2081 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/Program Files/Go/src/runtime/mgc.go:1234 +0x1c goroutine 19 gp=0xc000085180 m=nil [GC worker (idle)]: runtime.gopark(0x261f3d139e80?, 0x3?, 0x0?, 0x0?, 0x0?) C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc00006bf50 sp=0xc00006bf30 pc=0x7ff6cd9a12ee runtime.gcBgMarkWorker() C:/Program Files/Go/src/runtime/mgc.go:1310 +0xe5 fp=0xc00006bfe0 sp=0xc00006bf50 pc=0x7ff6cd981e25 runtime.goexit({}) C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc00006bfe8 sp=0xc00006bfe0 pc=0x7ff6cd9d2081 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/Program Files/Go/src/runtime/mgc.go:1234 +0x1c goroutine 34 gp=0xc000482000 m=nil [GC worker (idle)]: runtime.gopark(0x261f3dcbb704?, 0x3?, 0xfc?, 0xfa?, 0x0?) C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc000489f50 sp=0xc000489f30 pc=0x7ff6cd9a12ee runtime.gcBgMarkWorker() C:/Program Files/Go/src/runtime/mgc.go:1310 +0xe5 fp=0xc000489fe0 sp=0xc000489f50 pc=0x7ff6cd981e25 runtime.goexit({}) C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000489fe8 sp=0xc000489fe0 pc=0x7ff6cd9d2081 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/Program Files/Go/src/runtime/mgc.go:1234 +0x1c goroutine 35 gp=0xc0004821c0 m=nil [GC worker (idle)]: runtime.gopark(0x261f3dcbb704?, 0x3?, 0xf8?, 0xca?, 0x0?) C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc00048bf50 sp=0xc00048bf30 pc=0x7ff6cd9a12ee runtime.gcBgMarkWorker() C:/Program Files/Go/src/runtime/mgc.go:1310 +0xe5 fp=0xc00048bfe0 sp=0xc00048bf50 pc=0x7ff6cd981e25 runtime.goexit({}) C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc00048bfe8 sp=0xc00048bfe0 pc=0x7ff6cd9d2081 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/Program Files/Go/src/runtime/mgc.go:1234 +0x1c goroutine 36 gp=0xc000482380 m=nil [GC worker (idle)]: runtime.gopark(0x261f3dcbb704?, 0x3?, 0x0?, 0x0?, 0x0?) C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc000485f50 sp=0xc000485f30 pc=0x7ff6cd9a12ee runtime.gcBgMarkWorker() C:/Program Files/Go/src/runtime/mgc.go:1310 +0xe5 fp=0xc000485fe0 sp=0xc000485f50 pc=0x7ff6cd981e25 runtime.goexit({}) C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000485fe8 sp=0xc000485fe0 pc=0x7ff6cd9d2081 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/Program Files/Go/src/runtime/mgc.go:1234 +0x1c goroutine 37 gp=0xc000482540 m=nil [GC worker (idle)]: runtime.gopark(0x261f3dcbb704?, 0x3?, 0xfc?, 0xfa?, 0x0?) C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc000487f50 sp=0xc000487f30 pc=0x7ff6cd9a12ee runtime.gcBgMarkWorker() C:/Program Files/Go/src/runtime/mgc.go:1310 +0xe5 fp=0xc000487fe0 sp=0xc000487f50 pc=0x7ff6cd981e25 runtime.goexit({}) C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000487fe8 sp=0xc000487fe0 pc=0x7ff6cd9d2081 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/Program Files/Go/src/runtime/mgc.go:1234 +0x1c goroutine 38 gp=0xc000482700 m=nil [GC worker (idle)]: runtime.gopark(0x261f3dcbb704?, 0x1?, 0x0?, 0x0?, 0x0?) C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc000493f50 sp=0xc000493f30 pc=0x7ff6cd9a12ee runtime.gcBgMarkWorker() C:/Program Files/Go/src/runtime/mgc.go:1310 +0xe5 fp=0xc000493fe0 sp=0xc000493f50 pc=0x7ff6cd981e25 runtime.goexit({}) C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000493fe8 sp=0xc000493fe0 pc=0x7ff6cd9d2081 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/Program Files/Go/src/runtime/mgc.go:1234 +0x1c goroutine 6 gp=0xc000059500 m=nil [GC worker (idle)]: runtime.gopark(0x261f3dcbb704?, 0x1?, 0x0?, 0x0?, 0x0?) C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc00006ff50 sp=0xc00006ff30 pc=0x7ff6cd9a12ee runtime.gcBgMarkWorker() C:/Program Files/Go/src/runtime/mgc.go:1310 +0xe5 fp=0xc00006ffe0 sp=0xc00006ff50 pc=0x7ff6cd981e25 runtime.goexit({}) C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc00006ffe8 sp=0xc00006ffe0 pc=0x7ff6cd9d2081 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/Program Files/Go/src/runtime/mgc.go:1234 +0x1c goroutine 7 gp=0xc0006041c0 m=0 mp=0x7ff6cf7ec420 [syscall]: runtime.notetsleepg(0x7ff6cf872380, 0xffffffffffffffff) C:/Program Files/Go/src/runtime/lock_sema.go:296 +0x31 fp=0xc000491fa0 sp=0xc000491f68 pc=0x7ff6cd971671 os/signal.signal_recv() C:/Program Files/Go/src/runtime/sigqueue.go:152 +0x29 fp=0xc000491fc0 sp=0xc000491fa0 pc=0x7ff6cd9cdd69 os/signal.loop() C:/Program Files/Go/src/os/signal/signal_unix.go:23 +0x13 fp=0xc000491fe0 sp=0xc000491fc0 pc=0x7ff6cdc7e413 runtime.goexit({}) C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000491fe8 sp=0xc000491fe0 pc=0x7ff6cd9d2081 created by os/signal.Notify.func1.1 in goroutine 1 C:/Program Files/Go/src/os/signal/signal.go:151 +0x1f goroutine 8 gp=0xc000604380 m=nil [chan receive]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc000495f18 sp=0xc000495ef8 pc=0x7ff6cd9a12ee runtime.chanrecv(0xc00038c5a0, 0x0, 0x1) C:/Program Files/Go/src/runtime/chan.go:583 +0x3cd fp=0xc000495f90 sp=0xc000495f18 pc=0x7ff6cd96b84d runtime.chanrecv1(0x0?, 0x0?) C:/Program Files/Go/src/runtime/chan.go:442 +0x12 fp=0xc000495fb8 sp=0xc000495f90 pc=0x7ff6cd96b452 github.com/jmorganca/ollama/server.Serve.func2() C:/Users/jeff/git/ollama/server/routes.go:1023 +0x25 fp=0xc000495fe0 sp=0xc000495fb8 pc=0x7ff6cdf33e05 runtime.goexit({}) C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000495fe8 sp=0xc000495fe0 pc=0x7ff6cd9d2081 created by github.com/jmorganca/ollama/server.Serve in goroutine 1 C:/Users/jeff/git/ollama/server/routes.go:1022 +0x3f6 goroutine 20 gp=0xc000085a40 m=nil [IO wait]: runtime.gopark(0x0?, 0xc0006211a0?, 0x50?, 0x12?, 0xc0006211d0?) C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc000641890 sp=0xc000641870 pc=0x7ff6cd9a12ee runtime.netpollblock(0x2a8?, 0xcd968cc6?, 0xf6?) C:/Program Files/Go/src/runtime/netpoll.go:573 +0xf7 fp=0xc0006418c8 sp=0xc000641890 pc=0x7ff6cd998c37 internal/poll.runtime_pollWait(0x1b97d601de8, 0x72) C:/Program Files/Go/src/runtime/netpoll.go:345 +0x85 fp=0xc0006418e8 sp=0xc0006418c8 pc=0x7ff6cd9cbb25 internal/poll.(*pollDesc).wait(0xc00050f968?, 0x7ff6cd97b6fd?, 0x0) C:/Program Files/Go/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc000641910 sp=0xc0006418e8 pc=0x7ff6cda63bc7 internal/poll.execIO(0xc0006211a0, 0x7ff6cf325970) C:/Program Files/Go/src/internal/poll/fd_windows.go:175 +0xe6 fp=0xc000641980 sp=0xc000641910 pc=0x7ff6cda650a6 internal/poll.(*FD).Read(0xc000621188, {0xc000649000, 0x1000, 0x1000}) C:/Program Files/Go/src/internal/poll/fd_windows.go:436 +0x2b1 fp=0xc000641a28 sp=0xc000641980 pc=0x7ff6cda65d51 net.(*netFD).Read(0xc000621188, {0xc000649000?, 0xc00050fa98?, 0x7ff6cda640a5?}) C:/Program Files/Go/src/net/fd_posix.go:55 +0x25 fp=0xc000641a70 sp=0xc000641a28 pc=0x7ff6cdae31e5 net.(*conn).Read(0xc0004c4020, {0xc000649000?, 0x0?, 0xc00002a638?}) C:/Program Files/Go/src/net/net.go:179 +0x45 fp=0xc000641ab8 sp=0xc000641a70 pc=0x7ff6cdaf2265 net.(*TCPConn).Read(0xc00002a630?, {0xc000649000?, 0xc000621188?, 0xc00050faf0?}) <autogenerated>:1 +0x25 fp=0xc000641ae8 sp=0xc000641ab8 pc=0x7ff6cdb02285 net/http.(*connReader).Read(0xc00002a630, {0xc000649000, 0x1000, 0x1000}) C:/Program Files/Go/src/net/http/server.go:789 +0x14b fp=0xc000641b38 sp=0xc000641ae8 pc=0x7ff6cdc4ee4b bufio.(*Reader).fill(0xc000686060) C:/Program Files/Go/src/bufio/bufio.go:110 +0x103 fp=0xc000641b70 sp=0xc000641b38 pc=0x7ff6cdbd28c3 bufio.(*Reader).Peek(0xc000686060, 0x4) C:/Program Files/Go/src/bufio/bufio.go:148 +0x53 fp=0xc000641b90 sp=0xc000641b70 pc=0x7ff6cdbd29f3 net/http.(*conn).serve(0xc00016a1b0, {0x7ff6cf3e7568, 0xc0004aa3c0}) C:/Program Files/Go/src/net/http/server.go:2074 +0x749 fp=0xc000641fb8 sp=0xc000641b90 pc=0x7ff6cdc54ba9 net/http.(*Server).Serve.gowrap3() C:/Program Files/Go/src/net/http/server.go:3285 +0x28 fp=0xc000641fe0 sp=0xc000641fb8 pc=0x7ff6cdc59ea8 runtime.goexit({}) C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000641fe8 sp=0xc000641fe0 pc=0x7ff6cd9d2081 created by net/http.(*Server).Serve in goroutine 1 C:/Program Files/Go/src/net/http/server.go:3285 +0x4b4 goroutine 21 gp=0xc000085c00 m=nil [IO wait]: runtime.gopark(0x0?, 0xc000621420?, 0xd0?, 0x14?, 0xc000621450?) C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc000645890 sp=0xc000645870 pc=0x7ff6cd9a12ee runtime.netpollblock(0x2a4?, 0xcd968cc6?, 0xf6?) C:/Program Files/Go/src/runtime/netpoll.go:573 +0xf7 fp=0xc0006458c8 sp=0xc000645890 pc=0x7ff6cd998c37 internal/poll.runtime_pollWait(0x1b97d601cf0, 0x72) C:/Program Files/Go/src/runtime/netpoll.go:345 +0x85 fp=0xc0006458e8 sp=0xc0006458c8 pc=0x7ff6cd9cbb25 internal/poll.(*pollDesc).wait(0xc00050b930?, 0x7ff6cda6397c?, 0x0) C:/Program Files/Go/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc000645910 sp=0xc0006458e8 pc=0x7ff6cda63bc7 internal/poll.execIO(0xc000621420, 0x7ff6cf325970) C:/Program Files/Go/src/internal/poll/fd_windows.go:175 +0xe6 fp=0xc000645980 sp=0xc000645910 pc=0x7ff6cda650a6 internal/poll.(*FD).Read(0xc000621408, {0xc000528000, 0x1000, 0x1000}) C:/Program Files/Go/src/internal/poll/fd_windows.go:436 +0x2b1 fp=0xc000645a28 sp=0xc000645980 pc=0x7ff6cda65d51 net.(*netFD).Read(0xc000621408, {0xc000528000?, 0xc00050ba98?, 0x7ff6cda640a5?}) C:/Program Files/Go/src/net/fd_posix.go:55 +0x25 fp=0xc000645a70 sp=0xc000645a28 pc=0x7ff6cdae31e5 net.(*conn).Read(0xc0004c4028, {0xc000528000?, 0x0?, 0xc00002b6e8?}) C:/Program Files/Go/src/net/net.go:179 +0x45 fp=0xc000645ab8 sp=0xc000645a70 pc=0x7ff6cdaf2265 net.(*TCPConn).Read(0xc00002b6e0?, {0xc000528000?, 0xc000621408?, 0xc00050baf0?}) <autogenerated>:1 +0x25 fp=0xc000645ae8 sp=0xc000645ab8 pc=0x7ff6cdb02285 net/http.(*connReader).Read(0xc00002b6e0, {0xc000528000, 0x1000, 0x1000}) C:/Program Files/Go/src/net/http/server.go:789 +0x14b fp=0xc000645b38 sp=0xc000645ae8 pc=0x7ff6cdc4ee4b bufio.(*Reader).fill(0xc000686180) C:/Program Files/Go/src/bufio/bufio.go:110 +0x103 fp=0xc000645b70 sp=0xc000645b38 pc=0x7ff6cdbd28c3 bufio.(*Reader).Peek(0xc000686180, 0x4) C:/Program Files/Go/src/bufio/bufio.go:148 +0x53 fp=0xc000645b90 sp=0xc000645b70 pc=0x7ff6cdbd29f3 net/http.(*conn).serve(0xc00016a240, {0x7ff6cf3e7568, 0xc0004aa3c0}) C:/Program Files/Go/src/net/http/server.go:2074 +0x749 fp=0xc000645fb8 sp=0xc000645b90 pc=0x7ff6cdc54ba9 net/http.(*Server).Serve.gowrap3() C:/Program Files/Go/src/net/http/server.go:3285 +0x28 fp=0xc000645fe0 sp=0xc000645fb8 pc=0x7ff6cdc59ea8 runtime.goexit({}) C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000645fe8 sp=0xc000645fe0 pc=0x7ff6cd9d2081 created by net/http.(*Server).Serve in goroutine 1 C:/Program Files/Go/src/net/http/server.go:3285 +0x4b4 goroutine 39 gp=0xc0005841c0 m=nil [IO wait]: runtime.gopark(0x0?, 0xc000620ca0?, 0x50?, 0xd?, 0xc000620cd0?) C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc00048fd28 sp=0xc00048fd08 pc=0x7ff6cd9a12ee runtime.netpollblock(0x2a0?, 0xcd968cc6?, 0xf6?) C:/Program Files/Go/src/runtime/netpoll.go:573 +0xf7 fp=0xc00048fd60 sp=0xc00048fd28 pc=0x7ff6cd998c37 internal/poll.runtime_pollWait(0x1b97d601bf8, 0x72) C:/Program Files/Go/src/runtime/netpoll.go:345 +0x85 fp=0xc00048fd80 sp=0xc00048fd60 pc=0x7ff6cd9cbb25 internal/poll.(*pollDesc).wait(0x10?, 0x10?, 0x0) C:/Program Files/Go/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc00048fda8 sp=0xc00048fd80 pc=0x7ff6cda63bc7 internal/poll.execIO(0xc000620ca0, 0x7ff6cf325970) C:/Program Files/Go/src/internal/poll/fd_windows.go:175 +0xe6 fp=0xc00048fe18 sp=0xc00048fda8 pc=0x7ff6cda650a6 internal/poll.(*FD).Read(0xc000620c88, {0xc0000882b1, 0x1, 0x1}) C:/Program Files/Go/src/internal/poll/fd_windows.go:436 +0x2b1 fp=0xc00048fec0 sp=0xc00048fe18 pc=0x7ff6cda65d51 net.(*netFD).Read(0xc000620c88, {0xc0000882b1?, 0xc00048ff48?, 0x7ff6cd9cdab0?}) C:/Program Files/Go/src/net/fd_posix.go:55 +0x25 fp=0xc00048ff08 sp=0xc00048fec0 pc=0x7ff6cdae31e5 net.(*conn).Read(0xc0004c41d0, {0xc0000882b1?, 0xc00048feb8?, 0x7ff6cf8718a0?}) C:/Program Files/Go/src/net/net.go:179 +0x45 fp=0xc00048ff50 sp=0xc00048ff08 pc=0x7ff6cdaf2265 net.(*TCPConn).Read(0x7ff6cdfad8b0?, {0xc0000882b1?, 0xc00003b200?, 0x7ff6cdd4c480?}) <autogenerated>:1 +0x25 fp=0xc00048ff80 sp=0xc00048ff50 pc=0x7ff6cdb02285 net/http.(*connReader).backgroundRead(0xc0000882a0) C:/Program Files/Go/src/net/http/server.go:681 +0x37 fp=0xc00048ffc8 sp=0xc00048ff80 pc=0x7ff6cdc4e9b7 net/http.(*connReader).startBackgroundRead.gowrap2() C:/Program Files/Go/src/net/http/server.go:677 +0x25 fp=0xc00048ffe0 sp=0xc00048ffc8 pc=0x7ff6cdc4e8e5 runtime.goexit({}) C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc00048ffe8 sp=0xc00048ffe0 pc=0x7ff6cd9d2081 created by net/http.(*connReader).startBackgroundRead in goroutine 9 C:/Program Files/Go/src/net/http/server.go:677 +0xba rax 0xfffffffffffffff rbx 0x1b97c194ae8 rcx 0x1b97c194b90 rdx 0x8 rdi 0x8f881ff900 rsi 0x1b97c194b90 rbp 0x1b97c0cd710 rsp 0x8f881ff2e0 r8 0x3b r9 0x1 r10 0x7ffaadaf0000 r11 0x8f881ff2f0 r12 0xd6bf94d5e57a42bd r13 0x0 r14 0x1b97c194b30 r15 0x1b97c0cd7c0 rip 0x7ffa57df99dd rflags 0x10202 cs 0x33 fs 0x53 gs 0x2b ```
GiteaMirror commented 2026-04-28 06:27:50 -05:00
Author
Owner
Copy Link

@banias commented on GitHub (Feb 18, 2024):

I'm having the same issue:
Windows 10, RTX 3060 12 GB

ggml_init_cublas: GGML_CUDA_FORCE_MMQ:   no
ggml_init_cublas: CUDA_USE_TENSOR_CORES: yes
ggml_init_cublas: found 1 CUDA devices:
  Device 0: NVIDIA GeForce RTX 3060, compute capability 8.6, VMM: yes
Exception 0xc000001d 0x0 0x0 0x7ff8729a99dd
PC=0x7ff8729a99dd
signal arrived during external code execution

runtime.cgocall(0x7ff6916c53c0, 0xc00026a4f8)
	C:/Program Files/Go/src/runtime/cgocall.go:157 +0x3e fp=0xc00026a4d0 sp=0xc00026a498 pc=0x7ff6910d91be
github.com/jmorganca/ollama/llm._Cfunc_dyn_llama_server_init({0x7ff872960000, 0x7ff8729ea1e0, 0x7ff8729eae00, 0x7ff8729eae80, 0x7ff8729e8660, 0x7ff8729e8820, 0x7ff8729e87a0, 0x7ff8729eade0, 0x7ff8729eb540, 0x7ff8729e9560, ...}, ...)
	_cgo_gotypes.go:282 +0x4d fp=0xc00026a4f8 sp=0xc00026a4d0 pc=0x7ff6914c8b8d
github.com/jmorganca/ollama/llm.newDynExtServer.func7(0xc00027c0a0, 0xc001db6090)
	C:/Users/jeff/git/ollama/llm/dyn_ext_server.go:148 +0x112 fp=0xc00026a638 sp=0xc00026a4f8 pc=0x7ff6914ca2d2
github.com/jmorganca/ollama/llm.newDynExtServer({0xc000344180, 0x4d}, {0xc000612180, _}, {_, _, _}, {0x0, 0x0, 0x0}, ...)
	C:/Users/jeff/git/ollama/llm/dyn_ext_server.go:148 +0xac5 fp=0xc00026a880 sp=0xc00026a638 pc=0x7ff6914c9f05
github.com/jmorganca/ollama/llm.newLlmServer({{_, _, _}, {_, _}, {_, _}}, {_, _}, {0xc000612180, ...}, ...)
	C:/Users/jeff/git/ollama/llm/llm.go:158 +0x4c5 fp=0xc00026aa40 sp=0xc00026a880 pc=0x7ff6914c63c5
github.com/jmorganca/ollama/llm.New({0xc000334440, 0x33}, {0xc000612180, _}, {_, _, _}, {0x0, 0x0, 0x0}, ...)
	C:/Users/jeff/git/ollama/llm/llm.go:123 +0x78e fp=0xc00026acc0 sp=0xc00026aa40 pc=0x7ff6914c5cae
github.com/jmorganca/ollama/server.load(0xc00039ae00, 0xc000002000, {{0x0, 0x800, 0x200, 0x1, 0xffffffffffffffff, 0x0, 0x0, 0x1, ...}, ...}, ...)
	C:/Users/jeff/git/ollama/server/routes.go:85 +0x3a9 fp=0xc00026ae30 sp=0xc00026acc0 pc=0x7ff691699c69
github.com/jmorganca/ollama/server.ChatHandler(0xc00039ae00)
	C:/Users/jeff/git/ollama/server/routes.go:1163 +0x60b fp=0xc00026b510 sp=0xc00026ae30 pc=0x7ff6916a4ccb
github.com/gin-gonic/gin.(*Context).Next(0xc00039ae00)
	C:/Users/jeff/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/context.go:174 +0x2b fp=0xc00026b530 sp=0xc00026b510 pc=0x7ff69166e02b
github.com/jmorganca/ollama/server.(*Server).GenerateRoutes.Middleware.func4(0xc00039ae00)
	C:/Users/jeff/git/ollama/openai/openai.go:320 +0x277 fp=0xc00026b770 sp=0xc00026b530 pc=0x7ff6916ab217
github.com/gin-gonic/gin.(*Context).Next(...)
	C:/Users/jeff/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/context.go:174
github.com/jmorganca/ollama/server.(*Server).GenerateRoutes.func1(0xc00039ae00)
	C:/Users/jeff/git/ollama/server/routes.go:938 +0x68 fp=0xc00026b7a8 sp=0xc00026b770 pc=0x7ff6916a38a8
github.com/gin-gonic/gin.(*Context).Next(...)
	C:/Users/jeff/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/context.go:174
github.com/gin-gonic/gin.CustomRecoveryWithWriter.func1(0xc00039ae00)
	C:/Users/jeff/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/recovery.go:102 +0x7a fp=0xc00026b7f8 sp=0xc00026b7a8 pc=0x7ff69167afda
github.com/gin-gonic/gin.(*Context).Next(...)
	C:/Users/jeff/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/context.go:174
github.com/gin-gonic/gin.LoggerWithConfig.func1(0xc00039ae00)
	C:/Users/jeff/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/logger.go:240 +0xdd fp=0xc00026b9a8 sp=0xc00026b7f8 pc=0x7ff69167a11d
github.com/gin-gonic/gin.(*Context).Next(...)
	C:/Users/jeff/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/context.go:174
github.com/gin-gonic/gin.(*Engine).handleHTTPRequest(0xc0000ae1a0, 0xc00039ae00)
	C:/Users/jeff/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/gin.go:620 +0x66e fp=0xc00026bb28 sp=0xc00026b9a8 pc=0x7ff69167964e
github.com/gin-gonic/gin.(*Engine).ServeHTTP(0xc0000ae1a0, {0x7ff692b55f00, 0xc0000e00e0}, 0xc0000da360)
	C:/Users/jeff/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/gin.go:576 +0x1b2 fp=0xc00026bb60 sp=0xc00026bb28 pc=0x7ff691678e12
net/http.serverHandler.ServeHTTP({0x7ff692b541c0?}, {0x7ff692b55f00?, 0xc0000e00e0?}, 0x6?)
	C:/Program Files/Go/src/net/http/server.go:3137 +0x8e fp=0xc00026bb90 sp=0xc00026bb60 pc=0x7ff6913c968e
net/http.(*conn).serve(0xc0003ea090, {0x7ff692b57568, 0xc00007c540})
	C:/Program Files/Go/src/net/http/server.go:2039 +0x5e8 fp=0xc00026bfb8 sp=0xc00026bb90 pc=0x7ff6913c4a48
net/http.(*Server).Serve.gowrap3()
	C:/Program Files/Go/src/net/http/server.go:3285 +0x28 fp=0xc00026bfe0 sp=0xc00026bfb8 pc=0x7ff6913c9ea8
runtime.goexit({})
	C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc00026bfe8 sp=0xc00026bfe0 pc=0x7ff691142081
created by net/http.(*Server).Serve in goroutine 1
	C:/Program Files/Go/src/net/http/server.go:3285 +0x4b4

goroutine 1 gp=0xc00004e000 m=nil [IO wait]:
runtime.gopark(0xc000300008?, 0x7ff691726560?, 0xa0?, 0xb6?, 0xc0002eb6d0?)
	C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc0002816f8 sp=0xc0002816d8 pc=0x7ff6911112ee
runtime.netpollblock(0x198?, 0x910d8cc6?, 0xf6?)
	C:/Program Files/Go/src/runtime/netpoll.go:573 +0xf7 fp=0xc000281730 sp=0xc0002816f8 pc=0x7ff691108c37
internal/poll.runtime_pollWait(0x1c44c634e78, 0x72)
	C:/Program Files/Go/src/runtime/netpoll.go:345 +0x85 fp=0xc000281750 sp=0xc000281730 pc=0x7ff69113bb25
internal/poll.(*pollDesc).wait(0x7ff6910f0096?, 0x7ff692fe34a0?, 0x0)
	C:/Program Files/Go/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc000281778 sp=0xc000281750 pc=0x7ff6911d3bc7
internal/poll.execIO(0xc0002eb6a0, 0xc000281818)
	C:/Program Files/Go/src/internal/poll/fd_windows.go:175 +0xe6 fp=0xc0002817e8 sp=0xc000281778 pc=0x7ff6911d50a6
internal/poll.(*FD).acceptOne(0xc0002eb688, 0x6cc, {0xc000210000?, 0x0?, 0x100000000?}, 0xc000300008?)
	C:/Program Files/Go/src/internal/poll/fd_windows.go:944 +0x67 fp=0xc000281848 sp=0xc0002817e8 pc=0x7ff6911d9767
internal/poll.(*FD).Accept(0xc0002eb688, 0xc0002819f8)
	C:/Program Files/Go/src/internal/poll/fd_windows.go:978 +0x1bc fp=0xc000281900 sp=0xc000281848 pc=0x7ff6911d9a9c
net.(*netFD).accept(0xc0002eb688)
	C:/Program Files/Go/src/net/fd_windows.go:178 +0x54 fp=0xc000281a18 sp=0xc000281900 pc=0x7ff6912550d4
net.(*TCPListener).accept(0xc0003d4120)
	C:/Program Files/Go/src/net/tcpsock_posix.go:159 +0x1e fp=0xc000281a40 sp=0xc000281a18 pc=0x7ff69126a57e
net.(*TCPListener).Accept(0xc0003d4120)
	C:/Program Files/Go/src/net/tcpsock.go:327 +0x30 fp=0xc000281a70 sp=0xc000281a40 pc=0x7ff691269670
net/http.(*onceCloseListener).Accept(0xc0003ea090?)
	<autogenerated>:1 +0x24 fp=0xc000281a88 sp=0xc000281a70 pc=0x7ff6913ec064
net/http.(*Server).Serve(0xc000142000, {0x7ff692b55cf0, 0xc0003d4120})
	C:/Program Files/Go/src/net/http/server.go:3255 +0x33e fp=0xc000281bb8 sp=0xc000281a88 pc=0x7ff6913c9abe
github.com/jmorganca/ollama/server.Serve({0x7ff692b55cf0, 0xc0003d4120})
	C:/Users/jeff/git/ollama/server/routes.go:1041 +0x46f fp=0xc000281cc0 sp=0xc000281bb8 pc=0x7ff6916a3d6f
github.com/jmorganca/ollama/cmd.RunServer(0xc00039ab00?, {0x7ff692fe18a0?, 0x4?, 0x7ff691860f6b?})
	C:/Users/jeff/git/ollama/cmd/cmd.go:706 +0x1a5 fp=0xc000281d58 sp=0xc000281cc0 pc=0x7ff6916bcbc5
github.com/spf13/cobra.(*Command).execute(0xc0002fe908, {0x7ff692fe18a0, 0x0, 0x0})
	C:/Users/jeff/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:940 +0x882 fp=0xc000281e78 sp=0xc000281d58 pc=0x7ff691465462
github.com/spf13/cobra.(*Command).ExecuteC(0xc000349b08)
	C:/Users/jeff/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:1068 +0x3a5 fp=0xc000281f30 sp=0xc000281e78 pc=0x7ff691465ca5
github.com/spf13/cobra.(*Command).Execute(...)
	C:/Users/jeff/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:992
github.com/spf13/cobra.(*Command).ExecuteContext(...)
	C:/Users/jeff/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:985
main.main()
	C:/Users/jeff/git/ollama/main.go:11 +0x4d fp=0xc000281f50 sp=0xc000281f30 pc=0x7ff6916c512d
runtime.main()
	C:/Program Files/Go/src/runtime/proc.go:271 +0x28b fp=0xc000281fe0 sp=0xc000281f50 pc=0x7ff691110eeb
runtime.goexit({})
	C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000281fe8 sp=0xc000281fe0 pc=0x7ff691142081

goroutine 2 gp=0xc00004e700 m=nil [force gc (idle), 2 minutes]:
runtime.gopark(0x7a2c37a57e8?, 0x0?, 0x0?, 0x0?, 0x0?)
	C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc000051fa8 sp=0xc000051f88 pc=0x7ff6911112ee
runtime.goparkunlock(...)
	C:/Program Files/Go/src/runtime/proc.go:408
runtime.forcegchelper()
	C:/Program Files/Go/src/runtime/proc.go:326 +0xb8 fp=0xc000051fe0 sp=0xc000051fa8 pc=0x7ff691111178
runtime.goexit({})
	C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000051fe8 sp=0xc000051fe0 pc=0x7ff691142081
created by runtime.init.6 in goroutine 1
	C:/Program Files/Go/src/runtime/proc.go:314 +0x1a

goroutine 3 gp=0xc00004ea80 m=nil [GC sweep wait]:
runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?)
	C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc000053f80 sp=0xc000053f60 pc=0x7ff6911112ee
runtime.goparkunlock(...)
	C:/Program Files/Go/src/runtime/proc.go:408
runtime.bgsweep(0xc00005c000)
	C:/Program Files/Go/src/runtime/mgcsweep.go:318 +0xdf fp=0xc000053fc8 sp=0xc000053f80 pc=0x7ff6910fb43f
runtime.gcenable.gowrap1()
	C:/Program Files/Go/src/runtime/mgc.go:203 +0x25 fp=0xc000053fe0 sp=0xc000053fc8 pc=0x7ff6910efce5
runtime.goexit({})
	C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000053fe8 sp=0xc000053fe0 pc=0x7ff691142081
created by runtime.gcenable in goroutine 1
	C:/Program Files/Go/src/runtime/mgc.go:203 +0x66

goroutine 4 gp=0xc00004ec40 m=nil [GC scavenge wait]:
runtime.gopark(0x275d58?, 0x1a3a02?, 0x0?, 0x0?, 0x0?)
	C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc000063f78 sp=0xc000063f58 pc=0x7ff6911112ee
runtime.goparkunlock(...)
	C:/Program Files/Go/src/runtime/proc.go:408
runtime.(*scavengerState).park(0x7ff692f5aae0)
	C:/Program Files/Go/src/runtime/mgcscavenge.go:425 +0x49 fp=0xc000063fa8 sp=0xc000063f78 pc=0x7ff6910f8dc9
runtime.bgscavenge(0xc00005c000)
	C:/Program Files/Go/src/runtime/mgcscavenge.go:658 +0x59 fp=0xc000063fc8 sp=0xc000063fa8 pc=0x7ff6910f9379
runtime.gcenable.gowrap2()
	C:/Program Files/Go/src/runtime/mgc.go:204 +0x25 fp=0xc000063fe0 sp=0xc000063fc8 pc=0x7ff6910efc85
runtime.goexit({})
	C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000063fe8 sp=0xc000063fe0 pc=0x7ff691142081
created by runtime.gcenable in goroutine 1
	C:/Program Files/Go/src/runtime/mgc.go:204 +0xa5

goroutine 5 gp=0xc00004f180 m=nil [finalizer wait, 8 minutes]:
runtime.gopark(0x0?, 0xc001a9d488?, 0xa0?, 0xc0?, 0x1000000010?)
	C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc000055e20 sp=0xc000055e00 pc=0x7ff6911112ee
runtime.runfinq()
	C:/Program Files/Go/src/runtime/mfinal.go:194 +0x107 fp=0xc000055fe0 sp=0xc000055e20 pc=0x7ff6910eed67
runtime.goexit({})
	C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000055fe8 sp=0xc000055fe0 pc=0x7ff691142081
created by runtime.createfing in goroutine 1
	C:/Program Files/Go/src/runtime/mfinal.go:164 +0x3d

goroutine 18 gp=0xc000304e00 m=nil [GC worker (idle)]:
runtime.gopark(0x7a475f43c08?, 0x3?, 0x4c?, 0x50?, 0x0?)
	C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc00005ff50 sp=0xc00005ff30 pc=0x7ff6911112ee
runtime.gcBgMarkWorker()
	C:/Program Files/Go/src/runtime/mgc.go:1310 +0xe5 fp=0xc00005ffe0 sp=0xc00005ff50 pc=0x7ff6910f1e25
runtime.goexit({})
	C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc00005ffe8 sp=0xc00005ffe0 pc=0x7ff691142081
created by runtime.gcBgMarkStartWorkers in goroutine 1
	C:/Program Files/Go/src/runtime/mgc.go:1234 +0x1c

goroutine 19 gp=0xc000304fc0 m=nil [GC worker (idle)]:
runtime.gopark(0x7a476037f10?, 0x3?, 0x0?, 0x0?, 0x0?)
	C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc000061f50 sp=0xc000061f30 pc=0x7ff6911112ee
runtime.gcBgMarkWorker()
	C:/Program Files/Go/src/runtime/mgc.go:1310 +0xe5 fp=0xc000061fe0 sp=0xc000061f50 pc=0x7ff6910f1e25
runtime.goexit({})
	C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000061fe8 sp=0xc000061fe0 pc=0x7ff691142081
created by runtime.gcBgMarkStartWorkers in goroutine 1
	C:/Program Files/Go/src/runtime/mgc.go:1234 +0x1c

goroutine 20 gp=0xc000305180 m=nil [GC worker (idle)]:
runtime.gopark(0x7a46288ccec?, 0x3?, 0x0?, 0x0?, 0x0?)
	C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc000419f50 sp=0xc000419f30 pc=0x7ff6911112ee
runtime.gcBgMarkWorker()
	C:/Program Files/Go/src/runtime/mgc.go:1310 +0xe5 fp=0xc000419fe0 sp=0xc000419f50 pc=0x7ff6910f1e25
runtime.goexit({})
	C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000419fe8 sp=0xc000419fe0 pc=0x7ff691142081
created by runtime.gcBgMarkStartWorkers in goroutine 1
	C:/Program Files/Go/src/runtime/mgc.go:1234 +0x1c

goroutine 34 gp=0xc000480000 m=nil [GC worker (idle)]:
runtime.gopark(0x7a475f43c08?, 0x3?, 0xfc?, 0x3e?, 0x0?)
	C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc000415f50 sp=0xc000415f30 pc=0x7ff6911112ee
runtime.gcBgMarkWorker()
	C:/Program Files/Go/src/runtime/mgc.go:1310 +0xe5 fp=0xc000415fe0 sp=0xc000415f50 pc=0x7ff6910f1e25
runtime.goexit({})
	C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000415fe8 sp=0xc000415fe0 pc=0x7ff691142081
created by runtime.gcBgMarkStartWorkers in goroutine 1
	C:/Program Files/Go/src/runtime/mgc.go:1234 +0x1c

goroutine 50 gp=0xc0004801c0 m=7 mp=0xc0001c5008 [syscall, 26 minutes]:
runtime.notetsleepg(0x7ff692fe2380, 0xffffffffffffffff)
	C:/Program Files/Go/src/runtime/lock_sema.go:296 +0x31 fp=0xc00041bfa0 sp=0xc00041bf68 pc=0x7ff6910e1671
os/signal.signal_recv()
	C:/Program Files/Go/src/runtime/sigqueue.go:152 +0x29 fp=0xc00041bfc0 sp=0xc00041bfa0 pc=0x7ff69113dd69
os/signal.loop()
	C:/Program Files/Go/src/os/signal/signal_unix.go:23 +0x13 fp=0xc00041bfe0 sp=0xc00041bfc0 pc=0x7ff6913ee413
runtime.goexit({})
	C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc00041bfe8 sp=0xc00041bfe0 pc=0x7ff691142081
created by os/signal.Notify.func1.1 in goroutine 1
	C:/Program Files/Go/src/os/signal/signal.go:151 +0x1f

goroutine 51 gp=0xc000480380 m=nil [chan receive, 26 minutes]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc000065f18 sp=0xc000065ef8 pc=0x7ff6911112ee
runtime.chanrecv(0xc0000f0ae0, 0x0, 0x1)
	C:/Program Files/Go/src/runtime/chan.go:583 +0x3cd fp=0xc000065f90 sp=0xc000065f18 pc=0x7ff6910db84d
runtime.chanrecv1(0x0?, 0x0?)
	C:/Program Files/Go/src/runtime/chan.go:442 +0x12 fp=0xc000065fb8 sp=0xc000065f90 pc=0x7ff6910db452
github.com/jmorganca/ollama/server.Serve.func2()
	C:/Users/jeff/git/ollama/server/routes.go:1023 +0x25 fp=0xc000065fe0 sp=0xc000065fb8 pc=0x7ff6916a3e05
runtime.goexit({})
	C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000065fe8 sp=0xc000065fe0 pc=0x7ff691142081
created by github.com/jmorganca/ollama/server.Serve in goroutine 1
	C:/Users/jeff/git/ollama/server/routes.go:1022 +0x3f6

goroutine 2479 gp=0xc0004fae00 m=nil [IO wait]:
runtime.gopark(0x0?, 0xc0002eb1a0?, 0x50?, 0xb2?, 0xc0002eb1d0?)
	C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc000515d28 sp=0xc000515d08 pc=0x7ff6911112ee
runtime.netpollblock(0x1a0?, 0x910d8cc6?, 0xf6?)
	C:/Program Files/Go/src/runtime/netpoll.go:573 +0xf7 fp=0xc000515d60 sp=0xc000515d28 pc=0x7ff691108c37
internal/poll.runtime_pollWait(0x1c44cd9a3f8, 0x72)
	C:/Program Files/Go/src/runtime/netpoll.go:345 +0x85 fp=0xc000515d80 sp=0xc000515d60 pc=0x7ff69113bb25
internal/poll.(*pollDesc).wait(0xc000515dc8?, 0x7ff69139e8cb?, 0x0)
	C:/Program Files/Go/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc000515da8 sp=0xc000515d80 pc=0x7ff6911d3bc7
internal/poll.execIO(0xc0002eb1a0, 0x7ff692a95970)
	C:/Program Files/Go/src/internal/poll/fd_windows.go:175 +0xe6 fp=0xc000515e18 sp=0xc000515da8 pc=0x7ff6911d50a6
internal/poll.(*FD).Read(0xc0002eb188, {0xc00002e581, 0x1, 0x1})
	C:/Program Files/Go/src/internal/poll/fd_windows.go:436 +0x2b1 fp=0xc000515ec0 sp=0xc000515e18 pc=0x7ff6911d5d51
net.(*netFD).Read(0xc0002eb188, {0xc00002e581?, 0xc001926048?, 0x11?})
	C:/Program Files/Go/src/net/fd_posix.go:55 +0x25 fp=0xc000515f08 sp=0xc000515ec0 pc=0x7ff6912531e5
net.(*conn).Read(0xc000168000, {0xc00002e581?, 0xc000515fa8?, 0xc000515f01?})
	C:/Program Files/Go/src/net/net.go:179 +0x45 fp=0xc000515f50 sp=0xc000515f08 pc=0x7ff691262265
net.(*TCPConn).Read(0xc00153e2a0?, {0xc00002e581?, 0xc000a03740?, 0x7ff6913a4be0?})
	<autogenerated>:1 +0x25 fp=0xc000515f80 sp=0xc000515f50 pc=0x7ff691272285
net/http.(*connReader).backgroundRead(0xc00002e570)
	C:/Program Files/Go/src/net/http/server.go:681 +0x37 fp=0xc000515fc8 sp=0xc000515f80 pc=0x7ff6913be9b7
net/http.(*connReader).startBackgroundRead.gowrap2()
	C:/Program Files/Go/src/net/http/server.go:677 +0x25 fp=0xc000515fe0 sp=0xc000515fc8 pc=0x7ff6913be8e5
runtime.goexit({})
	C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000515fe8 sp=0xc000515fe0 pc=0x7ff691142081
created by net/http.(*connReader).startBackgroundRead in goroutine 2567
	C:/Program Files/Go/src/net/http/server.go:677 +0xba
rax     0xfffffffffffffff
rbx     0x1c44e7d7bc8
rcx     0x1c44e7d7c70
rdx     0x8
rdi     0x2ae97ff800
rsi     0x1c44e7d7c70
rbp     0x1c40718d9b0
rsp     0x2ae97ff1e0
r8      0x3b
r9      0x1
r10     0x7ff874740000
r11     0x2ae97ff1f0
r12     0xd6bf94d5e57a42bd
r13     0x0
r14     0x1c44e7d7c10
r15     0x1c40718d9d0
rip     0x7ff8729a99dd
rflags  0x10202
cs      0x33
fs      0x53
gs      0x2b
wiring nvidia management library functions in c:\Windows\System32\nvml.dll
dlsym: nvmlInit_v2
dlsym: nvmlShutdown
dlsym: nvmlDeviceGetHandleByIndex
dlsym: nvmlDeviceGetMemoryInfo
dlsym: nvmlDeviceGetCount_v2
dlsym: nvmlDeviceGetCudaComputeCapability
dlsym: nvmlSystemGetDriverVersion
dlsym: nvmlDeviceGetName
dlsym: nvmlDeviceGetSerial
dlsym: nvmlDeviceGetVbiosVersion
dlsym: nvmlDeviceGetBoardPartNumber
dlsym: nvmlDeviceGetBrand
CUDA driver version: 546.01
[0] CUDA device name: NVIDIA GeForce RTX 3060
[0] CUDA part number: 
nvmlDeviceGetSerial failed: 3
[0] CUDA vbios version: 94.06.2f.00.98
[0] CUDA brand: 5
[0] CUDA totalMem 0
[0] CUDA usedMem -1022029824
[0] CUDA device name: NVIDIA GeForce RTX 3060
[0] CUDA part number: 
nvmlDeviceGetSerial failed: 3
[0] CUDA vbios version: 94.06.2f.00.98
[0] CUDA brand: 5
[0] CUDA totalMem 0
[0] CUDA usedMem -1022029824
<!-- gh-comment-id:1951452076 --> @banias commented on GitHub (Feb 18, 2024): I'm having the same issue: Windows 10, RTX 3060 12 GB ``` ggml_init_cublas: GGML_CUDA_FORCE_MMQ: no ggml_init_cublas: CUDA_USE_TENSOR_CORES: yes ggml_init_cublas: found 1 CUDA devices: Device 0: NVIDIA GeForce RTX 3060, compute capability 8.6, VMM: yes Exception 0xc000001d 0x0 0x0 0x7ff8729a99dd PC=0x7ff8729a99dd signal arrived during external code execution runtime.cgocall(0x7ff6916c53c0, 0xc00026a4f8) C:/Program Files/Go/src/runtime/cgocall.go:157 +0x3e fp=0xc00026a4d0 sp=0xc00026a498 pc=0x7ff6910d91be github.com/jmorganca/ollama/llm._Cfunc_dyn_llama_server_init({0x7ff872960000, 0x7ff8729ea1e0, 0x7ff8729eae00, 0x7ff8729eae80, 0x7ff8729e8660, 0x7ff8729e8820, 0x7ff8729e87a0, 0x7ff8729eade0, 0x7ff8729eb540, 0x7ff8729e9560, ...}, ...) _cgo_gotypes.go:282 +0x4d fp=0xc00026a4f8 sp=0xc00026a4d0 pc=0x7ff6914c8b8d github.com/jmorganca/ollama/llm.newDynExtServer.func7(0xc00027c0a0, 0xc001db6090) C:/Users/jeff/git/ollama/llm/dyn_ext_server.go:148 +0x112 fp=0xc00026a638 sp=0xc00026a4f8 pc=0x7ff6914ca2d2 github.com/jmorganca/ollama/llm.newDynExtServer({0xc000344180, 0x4d}, {0xc000612180, _}, {_, _, _}, {0x0, 0x0, 0x0}, ...) C:/Users/jeff/git/ollama/llm/dyn_ext_server.go:148 +0xac5 fp=0xc00026a880 sp=0xc00026a638 pc=0x7ff6914c9f05 github.com/jmorganca/ollama/llm.newLlmServer({{_, _, _}, {_, _}, {_, _}}, {_, _}, {0xc000612180, ...}, ...) C:/Users/jeff/git/ollama/llm/llm.go:158 +0x4c5 fp=0xc00026aa40 sp=0xc00026a880 pc=0x7ff6914c63c5 github.com/jmorganca/ollama/llm.New({0xc000334440, 0x33}, {0xc000612180, _}, {_, _, _}, {0x0, 0x0, 0x0}, ...) C:/Users/jeff/git/ollama/llm/llm.go:123 +0x78e fp=0xc00026acc0 sp=0xc00026aa40 pc=0x7ff6914c5cae github.com/jmorganca/ollama/server.load(0xc00039ae00, 0xc000002000, {{0x0, 0x800, 0x200, 0x1, 0xffffffffffffffff, 0x0, 0x0, 0x1, ...}, ...}, ...) C:/Users/jeff/git/ollama/server/routes.go:85 +0x3a9 fp=0xc00026ae30 sp=0xc00026acc0 pc=0x7ff691699c69 github.com/jmorganca/ollama/server.ChatHandler(0xc00039ae00) C:/Users/jeff/git/ollama/server/routes.go:1163 +0x60b fp=0xc00026b510 sp=0xc00026ae30 pc=0x7ff6916a4ccb github.com/gin-gonic/gin.(*Context).Next(0xc00039ae00) C:/Users/jeff/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/context.go:174 +0x2b fp=0xc00026b530 sp=0xc00026b510 pc=0x7ff69166e02b github.com/jmorganca/ollama/server.(*Server).GenerateRoutes.Middleware.func4(0xc00039ae00) C:/Users/jeff/git/ollama/openai/openai.go:320 +0x277 fp=0xc00026b770 sp=0xc00026b530 pc=0x7ff6916ab217 github.com/gin-gonic/gin.(*Context).Next(...) C:/Users/jeff/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/context.go:174 github.com/jmorganca/ollama/server.(*Server).GenerateRoutes.func1(0xc00039ae00) C:/Users/jeff/git/ollama/server/routes.go:938 +0x68 fp=0xc00026b7a8 sp=0xc00026b770 pc=0x7ff6916a38a8 github.com/gin-gonic/gin.(*Context).Next(...) C:/Users/jeff/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/context.go:174 github.com/gin-gonic/gin.CustomRecoveryWithWriter.func1(0xc00039ae00) C:/Users/jeff/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/recovery.go:102 +0x7a fp=0xc00026b7f8 sp=0xc00026b7a8 pc=0x7ff69167afda github.com/gin-gonic/gin.(*Context).Next(...) C:/Users/jeff/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/context.go:174 github.com/gin-gonic/gin.LoggerWithConfig.func1(0xc00039ae00) C:/Users/jeff/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/logger.go:240 +0xdd fp=0xc00026b9a8 sp=0xc00026b7f8 pc=0x7ff69167a11d github.com/gin-gonic/gin.(*Context).Next(...) C:/Users/jeff/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/context.go:174 github.com/gin-gonic/gin.(*Engine).handleHTTPRequest(0xc0000ae1a0, 0xc00039ae00) C:/Users/jeff/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/gin.go:620 +0x66e fp=0xc00026bb28 sp=0xc00026b9a8 pc=0x7ff69167964e github.com/gin-gonic/gin.(*Engine).ServeHTTP(0xc0000ae1a0, {0x7ff692b55f00, 0xc0000e00e0}, 0xc0000da360) C:/Users/jeff/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/gin.go:576 +0x1b2 fp=0xc00026bb60 sp=0xc00026bb28 pc=0x7ff691678e12 net/http.serverHandler.ServeHTTP({0x7ff692b541c0?}, {0x7ff692b55f00?, 0xc0000e00e0?}, 0x6?) C:/Program Files/Go/src/net/http/server.go:3137 +0x8e fp=0xc00026bb90 sp=0xc00026bb60 pc=0x7ff6913c968e net/http.(*conn).serve(0xc0003ea090, {0x7ff692b57568, 0xc00007c540}) C:/Program Files/Go/src/net/http/server.go:2039 +0x5e8 fp=0xc00026bfb8 sp=0xc00026bb90 pc=0x7ff6913c4a48 net/http.(*Server).Serve.gowrap3() C:/Program Files/Go/src/net/http/server.go:3285 +0x28 fp=0xc00026bfe0 sp=0xc00026bfb8 pc=0x7ff6913c9ea8 runtime.goexit({}) C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc00026bfe8 sp=0xc00026bfe0 pc=0x7ff691142081 created by net/http.(*Server).Serve in goroutine 1 C:/Program Files/Go/src/net/http/server.go:3285 +0x4b4 goroutine 1 gp=0xc00004e000 m=nil [IO wait]: runtime.gopark(0xc000300008?, 0x7ff691726560?, 0xa0?, 0xb6?, 0xc0002eb6d0?) C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc0002816f8 sp=0xc0002816d8 pc=0x7ff6911112ee runtime.netpollblock(0x198?, 0x910d8cc6?, 0xf6?) C:/Program Files/Go/src/runtime/netpoll.go:573 +0xf7 fp=0xc000281730 sp=0xc0002816f8 pc=0x7ff691108c37 internal/poll.runtime_pollWait(0x1c44c634e78, 0x72) C:/Program Files/Go/src/runtime/netpoll.go:345 +0x85 fp=0xc000281750 sp=0xc000281730 pc=0x7ff69113bb25 internal/poll.(*pollDesc).wait(0x7ff6910f0096?, 0x7ff692fe34a0?, 0x0) C:/Program Files/Go/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc000281778 sp=0xc000281750 pc=0x7ff6911d3bc7 internal/poll.execIO(0xc0002eb6a0, 0xc000281818) C:/Program Files/Go/src/internal/poll/fd_windows.go:175 +0xe6 fp=0xc0002817e8 sp=0xc000281778 pc=0x7ff6911d50a6 internal/poll.(*FD).acceptOne(0xc0002eb688, 0x6cc, {0xc000210000?, 0x0?, 0x100000000?}, 0xc000300008?) C:/Program Files/Go/src/internal/poll/fd_windows.go:944 +0x67 fp=0xc000281848 sp=0xc0002817e8 pc=0x7ff6911d9767 internal/poll.(*FD).Accept(0xc0002eb688, 0xc0002819f8) C:/Program Files/Go/src/internal/poll/fd_windows.go:978 +0x1bc fp=0xc000281900 sp=0xc000281848 pc=0x7ff6911d9a9c net.(*netFD).accept(0xc0002eb688) C:/Program Files/Go/src/net/fd_windows.go:178 +0x54 fp=0xc000281a18 sp=0xc000281900 pc=0x7ff6912550d4 net.(*TCPListener).accept(0xc0003d4120) C:/Program Files/Go/src/net/tcpsock_posix.go:159 +0x1e fp=0xc000281a40 sp=0xc000281a18 pc=0x7ff69126a57e net.(*TCPListener).Accept(0xc0003d4120) C:/Program Files/Go/src/net/tcpsock.go:327 +0x30 fp=0xc000281a70 sp=0xc000281a40 pc=0x7ff691269670 net/http.(*onceCloseListener).Accept(0xc0003ea090?) <autogenerated>:1 +0x24 fp=0xc000281a88 sp=0xc000281a70 pc=0x7ff6913ec064 net/http.(*Server).Serve(0xc000142000, {0x7ff692b55cf0, 0xc0003d4120}) C:/Program Files/Go/src/net/http/server.go:3255 +0x33e fp=0xc000281bb8 sp=0xc000281a88 pc=0x7ff6913c9abe github.com/jmorganca/ollama/server.Serve({0x7ff692b55cf0, 0xc0003d4120}) C:/Users/jeff/git/ollama/server/routes.go:1041 +0x46f fp=0xc000281cc0 sp=0xc000281bb8 pc=0x7ff6916a3d6f github.com/jmorganca/ollama/cmd.RunServer(0xc00039ab00?, {0x7ff692fe18a0?, 0x4?, 0x7ff691860f6b?}) C:/Users/jeff/git/ollama/cmd/cmd.go:706 +0x1a5 fp=0xc000281d58 sp=0xc000281cc0 pc=0x7ff6916bcbc5 github.com/spf13/cobra.(*Command).execute(0xc0002fe908, {0x7ff692fe18a0, 0x0, 0x0}) C:/Users/jeff/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:940 +0x882 fp=0xc000281e78 sp=0xc000281d58 pc=0x7ff691465462 github.com/spf13/cobra.(*Command).ExecuteC(0xc000349b08) C:/Users/jeff/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:1068 +0x3a5 fp=0xc000281f30 sp=0xc000281e78 pc=0x7ff691465ca5 github.com/spf13/cobra.(*Command).Execute(...) C:/Users/jeff/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:992 github.com/spf13/cobra.(*Command).ExecuteContext(...) C:/Users/jeff/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:985 main.main() C:/Users/jeff/git/ollama/main.go:11 +0x4d fp=0xc000281f50 sp=0xc000281f30 pc=0x7ff6916c512d runtime.main() C:/Program Files/Go/src/runtime/proc.go:271 +0x28b fp=0xc000281fe0 sp=0xc000281f50 pc=0x7ff691110eeb runtime.goexit({}) C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000281fe8 sp=0xc000281fe0 pc=0x7ff691142081 goroutine 2 gp=0xc00004e700 m=nil [force gc (idle), 2 minutes]: runtime.gopark(0x7a2c37a57e8?, 0x0?, 0x0?, 0x0?, 0x0?) C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc000051fa8 sp=0xc000051f88 pc=0x7ff6911112ee runtime.goparkunlock(...) C:/Program Files/Go/src/runtime/proc.go:408 runtime.forcegchelper() C:/Program Files/Go/src/runtime/proc.go:326 +0xb8 fp=0xc000051fe0 sp=0xc000051fa8 pc=0x7ff691111178 runtime.goexit({}) C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000051fe8 sp=0xc000051fe0 pc=0x7ff691142081 created by runtime.init.6 in goroutine 1 C:/Program Files/Go/src/runtime/proc.go:314 +0x1a goroutine 3 gp=0xc00004ea80 m=nil [GC sweep wait]: runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?) C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc000053f80 sp=0xc000053f60 pc=0x7ff6911112ee runtime.goparkunlock(...) C:/Program Files/Go/src/runtime/proc.go:408 runtime.bgsweep(0xc00005c000) C:/Program Files/Go/src/runtime/mgcsweep.go:318 +0xdf fp=0xc000053fc8 sp=0xc000053f80 pc=0x7ff6910fb43f runtime.gcenable.gowrap1() C:/Program Files/Go/src/runtime/mgc.go:203 +0x25 fp=0xc000053fe0 sp=0xc000053fc8 pc=0x7ff6910efce5 runtime.goexit({}) C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000053fe8 sp=0xc000053fe0 pc=0x7ff691142081 created by runtime.gcenable in goroutine 1 C:/Program Files/Go/src/runtime/mgc.go:203 +0x66 goroutine 4 gp=0xc00004ec40 m=nil [GC scavenge wait]: runtime.gopark(0x275d58?, 0x1a3a02?, 0x0?, 0x0?, 0x0?) C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc000063f78 sp=0xc000063f58 pc=0x7ff6911112ee runtime.goparkunlock(...) C:/Program Files/Go/src/runtime/proc.go:408 runtime.(*scavengerState).park(0x7ff692f5aae0) C:/Program Files/Go/src/runtime/mgcscavenge.go:425 +0x49 fp=0xc000063fa8 sp=0xc000063f78 pc=0x7ff6910f8dc9 runtime.bgscavenge(0xc00005c000) C:/Program Files/Go/src/runtime/mgcscavenge.go:658 +0x59 fp=0xc000063fc8 sp=0xc000063fa8 pc=0x7ff6910f9379 runtime.gcenable.gowrap2() C:/Program Files/Go/src/runtime/mgc.go:204 +0x25 fp=0xc000063fe0 sp=0xc000063fc8 pc=0x7ff6910efc85 runtime.goexit({}) C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000063fe8 sp=0xc000063fe0 pc=0x7ff691142081 created by runtime.gcenable in goroutine 1 C:/Program Files/Go/src/runtime/mgc.go:204 +0xa5 goroutine 5 gp=0xc00004f180 m=nil [finalizer wait, 8 minutes]: runtime.gopark(0x0?, 0xc001a9d488?, 0xa0?, 0xc0?, 0x1000000010?) C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc000055e20 sp=0xc000055e00 pc=0x7ff6911112ee runtime.runfinq() C:/Program Files/Go/src/runtime/mfinal.go:194 +0x107 fp=0xc000055fe0 sp=0xc000055e20 pc=0x7ff6910eed67 runtime.goexit({}) C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000055fe8 sp=0xc000055fe0 pc=0x7ff691142081 created by runtime.createfing in goroutine 1 C:/Program Files/Go/src/runtime/mfinal.go:164 +0x3d goroutine 18 gp=0xc000304e00 m=nil [GC worker (idle)]: runtime.gopark(0x7a475f43c08?, 0x3?, 0x4c?, 0x50?, 0x0?) C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc00005ff50 sp=0xc00005ff30 pc=0x7ff6911112ee runtime.gcBgMarkWorker() C:/Program Files/Go/src/runtime/mgc.go:1310 +0xe5 fp=0xc00005ffe0 sp=0xc00005ff50 pc=0x7ff6910f1e25 runtime.goexit({}) C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc00005ffe8 sp=0xc00005ffe0 pc=0x7ff691142081 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/Program Files/Go/src/runtime/mgc.go:1234 +0x1c goroutine 19 gp=0xc000304fc0 m=nil [GC worker (idle)]: runtime.gopark(0x7a476037f10?, 0x3?, 0x0?, 0x0?, 0x0?) C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc000061f50 sp=0xc000061f30 pc=0x7ff6911112ee runtime.gcBgMarkWorker() C:/Program Files/Go/src/runtime/mgc.go:1310 +0xe5 fp=0xc000061fe0 sp=0xc000061f50 pc=0x7ff6910f1e25 runtime.goexit({}) C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000061fe8 sp=0xc000061fe0 pc=0x7ff691142081 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/Program Files/Go/src/runtime/mgc.go:1234 +0x1c goroutine 20 gp=0xc000305180 m=nil [GC worker (idle)]: runtime.gopark(0x7a46288ccec?, 0x3?, 0x0?, 0x0?, 0x0?) C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc000419f50 sp=0xc000419f30 pc=0x7ff6911112ee runtime.gcBgMarkWorker() C:/Program Files/Go/src/runtime/mgc.go:1310 +0xe5 fp=0xc000419fe0 sp=0xc000419f50 pc=0x7ff6910f1e25 runtime.goexit({}) C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000419fe8 sp=0xc000419fe0 pc=0x7ff691142081 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/Program Files/Go/src/runtime/mgc.go:1234 +0x1c goroutine 34 gp=0xc000480000 m=nil [GC worker (idle)]: runtime.gopark(0x7a475f43c08?, 0x3?, 0xfc?, 0x3e?, 0x0?) C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc000415f50 sp=0xc000415f30 pc=0x7ff6911112ee runtime.gcBgMarkWorker() C:/Program Files/Go/src/runtime/mgc.go:1310 +0xe5 fp=0xc000415fe0 sp=0xc000415f50 pc=0x7ff6910f1e25 runtime.goexit({}) C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000415fe8 sp=0xc000415fe0 pc=0x7ff691142081 created by runtime.gcBgMarkStartWorkers in goroutine 1 C:/Program Files/Go/src/runtime/mgc.go:1234 +0x1c goroutine 50 gp=0xc0004801c0 m=7 mp=0xc0001c5008 [syscall, 26 minutes]: runtime.notetsleepg(0x7ff692fe2380, 0xffffffffffffffff) C:/Program Files/Go/src/runtime/lock_sema.go:296 +0x31 fp=0xc00041bfa0 sp=0xc00041bf68 pc=0x7ff6910e1671 os/signal.signal_recv() C:/Program Files/Go/src/runtime/sigqueue.go:152 +0x29 fp=0xc00041bfc0 sp=0xc00041bfa0 pc=0x7ff69113dd69 os/signal.loop() C:/Program Files/Go/src/os/signal/signal_unix.go:23 +0x13 fp=0xc00041bfe0 sp=0xc00041bfc0 pc=0x7ff6913ee413 runtime.goexit({}) C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc00041bfe8 sp=0xc00041bfe0 pc=0x7ff691142081 created by os/signal.Notify.func1.1 in goroutine 1 C:/Program Files/Go/src/os/signal/signal.go:151 +0x1f goroutine 51 gp=0xc000480380 m=nil [chan receive, 26 minutes]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc000065f18 sp=0xc000065ef8 pc=0x7ff6911112ee runtime.chanrecv(0xc0000f0ae0, 0x0, 0x1) C:/Program Files/Go/src/runtime/chan.go:583 +0x3cd fp=0xc000065f90 sp=0xc000065f18 pc=0x7ff6910db84d runtime.chanrecv1(0x0?, 0x0?) C:/Program Files/Go/src/runtime/chan.go:442 +0x12 fp=0xc000065fb8 sp=0xc000065f90 pc=0x7ff6910db452 github.com/jmorganca/ollama/server.Serve.func2() C:/Users/jeff/git/ollama/server/routes.go:1023 +0x25 fp=0xc000065fe0 sp=0xc000065fb8 pc=0x7ff6916a3e05 runtime.goexit({}) C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000065fe8 sp=0xc000065fe0 pc=0x7ff691142081 created by github.com/jmorganca/ollama/server.Serve in goroutine 1 C:/Users/jeff/git/ollama/server/routes.go:1022 +0x3f6 goroutine 2479 gp=0xc0004fae00 m=nil [IO wait]: runtime.gopark(0x0?, 0xc0002eb1a0?, 0x50?, 0xb2?, 0xc0002eb1d0?) C:/Program Files/Go/src/runtime/proc.go:402 +0xce fp=0xc000515d28 sp=0xc000515d08 pc=0x7ff6911112ee runtime.netpollblock(0x1a0?, 0x910d8cc6?, 0xf6?) C:/Program Files/Go/src/runtime/netpoll.go:573 +0xf7 fp=0xc000515d60 sp=0xc000515d28 pc=0x7ff691108c37 internal/poll.runtime_pollWait(0x1c44cd9a3f8, 0x72) C:/Program Files/Go/src/runtime/netpoll.go:345 +0x85 fp=0xc000515d80 sp=0xc000515d60 pc=0x7ff69113bb25 internal/poll.(*pollDesc).wait(0xc000515dc8?, 0x7ff69139e8cb?, 0x0) C:/Program Files/Go/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc000515da8 sp=0xc000515d80 pc=0x7ff6911d3bc7 internal/poll.execIO(0xc0002eb1a0, 0x7ff692a95970) C:/Program Files/Go/src/internal/poll/fd_windows.go:175 +0xe6 fp=0xc000515e18 sp=0xc000515da8 pc=0x7ff6911d50a6 internal/poll.(*FD).Read(0xc0002eb188, {0xc00002e581, 0x1, 0x1}) C:/Program Files/Go/src/internal/poll/fd_windows.go:436 +0x2b1 fp=0xc000515ec0 sp=0xc000515e18 pc=0x7ff6911d5d51 net.(*netFD).Read(0xc0002eb188, {0xc00002e581?, 0xc001926048?, 0x11?}) C:/Program Files/Go/src/net/fd_posix.go:55 +0x25 fp=0xc000515f08 sp=0xc000515ec0 pc=0x7ff6912531e5 net.(*conn).Read(0xc000168000, {0xc00002e581?, 0xc000515fa8?, 0xc000515f01?}) C:/Program Files/Go/src/net/net.go:179 +0x45 fp=0xc000515f50 sp=0xc000515f08 pc=0x7ff691262265 net.(*TCPConn).Read(0xc00153e2a0?, {0xc00002e581?, 0xc000a03740?, 0x7ff6913a4be0?}) <autogenerated>:1 +0x25 fp=0xc000515f80 sp=0xc000515f50 pc=0x7ff691272285 net/http.(*connReader).backgroundRead(0xc00002e570) C:/Program Files/Go/src/net/http/server.go:681 +0x37 fp=0xc000515fc8 sp=0xc000515f80 pc=0x7ff6913be9b7 net/http.(*connReader).startBackgroundRead.gowrap2() C:/Program Files/Go/src/net/http/server.go:677 +0x25 fp=0xc000515fe0 sp=0xc000515fc8 pc=0x7ff6913be8e5 runtime.goexit({}) C:/Program Files/Go/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000515fe8 sp=0xc000515fe0 pc=0x7ff691142081 created by net/http.(*connReader).startBackgroundRead in goroutine 2567 C:/Program Files/Go/src/net/http/server.go:677 +0xba rax 0xfffffffffffffff rbx 0x1c44e7d7bc8 rcx 0x1c44e7d7c70 rdx 0x8 rdi 0x2ae97ff800 rsi 0x1c44e7d7c70 rbp 0x1c40718d9b0 rsp 0x2ae97ff1e0 r8 0x3b r9 0x1 r10 0x7ff874740000 r11 0x2ae97ff1f0 r12 0xd6bf94d5e57a42bd r13 0x0 r14 0x1c44e7d7c10 r15 0x1c40718d9d0 rip 0x7ff8729a99dd rflags 0x10202 cs 0x33 fs 0x53 gs 0x2b wiring nvidia management library functions in c:\Windows\System32\nvml.dll dlsym: nvmlInit_v2 dlsym: nvmlShutdown dlsym: nvmlDeviceGetHandleByIndex dlsym: nvmlDeviceGetMemoryInfo dlsym: nvmlDeviceGetCount_v2 dlsym: nvmlDeviceGetCudaComputeCapability dlsym: nvmlSystemGetDriverVersion dlsym: nvmlDeviceGetName dlsym: nvmlDeviceGetSerial dlsym: nvmlDeviceGetVbiosVersion dlsym: nvmlDeviceGetBoardPartNumber dlsym: nvmlDeviceGetBrand CUDA driver version: 546.01 [0] CUDA device name: NVIDIA GeForce RTX 3060 [0] CUDA part number: nvmlDeviceGetSerial failed: 3 [0] CUDA vbios version: 94.06.2f.00.98 [0] CUDA brand: 5 [0] CUDA totalMem 0 [0] CUDA usedMem -1022029824 [0] CUDA device name: NVIDIA GeForce RTX 3060 [0] CUDA part number: nvmlDeviceGetSerial failed: 3 [0] CUDA vbios version: 94.06.2f.00.98 [0] CUDA brand: 5 [0] CUDA totalMem 0 [0] CUDA usedMem -1022029824 ```
GiteaMirror commented 2026-04-28 06:27:51 -05:00
Author
Owner
Copy Link

@dhiltgen commented on GitHub (Feb 19, 2024):

Dup of #2527 which will be fixed in the next release.

<!-- gh-comment-id:1953148241 --> @dhiltgen commented on GitHub (Feb 19, 2024): Dup of #2527 which will be fixed in the next release.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
 python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#48025
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?