github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-05-07 16:40:08 -05:00
Code Issues 14.5k Packages Projects Releases 120 Wiki Activity

[GH-ISSUE #2724] Error running GEMMA:7b on Ollama via Docker #27396

New Issue
Closed
opened 2026-04-22 04:43:15 -05:00 by GiteaMirror · 5 comments
GiteaMirror commented 2026-04-22 04:43:15 -05:00
Owner
Copy Link

Originally created by @wangshuai67 on GitHub (Feb 24, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/2724

Body:
Description:
I encountered an error while running GEMMA:7b on Ollama using Docker. Whenever I attempt to run the GEMMA:7b image, an error occurs.

Steps to Reproduce:

  1. Deploy Ollama on Docker.
  2. Run the GEMMA:7b image using the appropriate command.
  3. See the error message that is displayed.

Actual Behavior:
Running the GEMMA:7b image on Ollama via Docker results in an error.

Additional Information:

  • I have ensured that the Docker setup for Ollama is correct.
  • Other images and models run successfully on Ollama using Docker.
  • The error message received while running GEMMA:7b provides details about the issue.

image

ollama log


time=2024-02-24T08:29:43.035Z level=INFO source=gpu.go:146 msg="CUDA Compute Capability detected: 7.5"
[GIN] 2024/02/24 - 08:29:54 | 200 |    1.300495ms |      172.17.0.1 | GET      "/api/tags"
[GIN] 2024/02/24 - 08:29:54 | 200 |     105.186µs |      172.17.0.1 | GET      "/api/version"
time=2024-02-24T08:30:03.108Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2"
time=2024-02-24T08:30:03.108Z level=INFO source=gpu.go:146 msg="CUDA Compute Capability detected: 7.5"
time=2024-02-24T08:30:03.108Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2"
time=2024-02-24T08:30:03.108Z level=INFO source=gpu.go:146 msg="CUDA Compute Capability detected: 7.5"
time=2024-02-24T08:30:03.108Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2"
time=2024-02-24T08:30:03.113Z level=INFO source=dyn_ext_server.go:90 msg="Loading Dynamic llm server: /tmp/ollama2393286333/cuda_v11/libext_server.so"
time=2024-02-24T08:30:03.113Z level=INFO source=dyn_ext_server.go:145 msg="Initializing llama server"
ggml_init_cublas: GGML_CUDA_FORCE_MMQ:   yes
ggml_init_cublas: CUDA_USE_TENSOR_CORES: no
ggml_init_cublas: found 2 CUDA devices:
  Device 0: Quadro RTX 6000, compute capability 7.5, VMM: yes
  Device 1: Quadro RTX 6000, compute capability 7.5, VMM: yes
SIGSEGV: segmentation violation
PC=0x7f9a983a80bc m=22 sigcode=1
signal arrived during cgo execution

goroutine 47 [syscall]:
runtime.cgocall(0x9bc8b0, 0xc00017c6f0)
        /usr/local/go/src/runtime/cgocall.go:157 +0x4b fp=0xc00017c6c8 sp=0xc00017c690 pc=0x409b0b
github.com/jmorganca/ollama/llm._Cfunc_dyn_llama_server_init({0x7f99f4001e10, 0x7f99ece5a610, 0x7f99ece4be50, 0x7f99ece4f0d0, 0x7f99ece5dd90, 0x7f99ece57c20, 0x7f99ece4ed50, 0x7f99ece4bed0, 0x7f99ece5e7c0, 0x7f99ece5d930, ...}, ...)
        _cgo_gotypes.go:282 +0x45 fp=0xc00017c6f0 sp=0xc00017c6c8 pc=0x7c5085
github.com/jmorganca/ollama/llm.newDynExtServer.func7(0xaf2020?, 0xc?)
        /go/src/github.com/jmorganca/ollama/llm/dyn_ext_server.go:148 +0xef fp=0xc00017c7e0 sp=0xc00017c6f0 pc=0x7c65af
github.com/jmorganca/ollama/llm.newDynExtServer({0xc0007aa000, 0x2f}, {0xc0002a42a0, _}, {_, _, _}, {0x0, 0x0, 0x0}, ...)
        /go/src/github.com/jmorganca/ollama/llm/dyn_ext_server.go:148 +0xa45 fp=0xc00017ca80 sp=0xc00017c7e0 pc=0x7c6245
github.com/jmorganca/ollama/llm.newLlmServer({{_, _, _}, {_, _}, {_, _}}, {_, _}, {0xc0002a42a0, ...}, ...)
        /go/src/github.com/jmorganca/ollama/llm/llm.go:158 +0x425 fp=0xc00017cc40 sp=0xc00017ca80 pc=0x7c29c5
github.com/jmorganca/ollama/llm.New({0xc0003209a8, 0x15}, {0xc0002a42a0, _}, {_, _, _}, {0x0, 0x0, 0x0}, ...)
        /go/src/github.com/jmorganca/ollama/llm/llm.go:123 +0x713 fp=0xc00017cec0 sp=0xc00017cc40 pc=0x7c2333
github.com/jmorganca/ollama/server.load(0xc000318000?, 0xc000318000, {{0x0, 0x800, 0x200, 0x1, 0xffffffffffffffff, 0x0, 0x0, 0x1, ...}, ...}, ...)
        /go/src/github.com/jmorganca/ollama/server/routes.go:85 +0x3a5 fp=0xc00017d040 sp=0xc00017cec0 pc=0x996c05
github.com/jmorganca/ollama/server.ChatHandler(0xc0001f8100)
        /go/src/github.com/jmorganca/ollama/server/routes.go:1163 +0x60b fp=0xc00017d748 sp=0xc00017d040 pc=0x9a1c8b
github.com/gin-gonic/gin.(*Context).Next(...)
        /root/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/context.go:174
github.com/jmorganca/ollama/server.(*Server).GenerateRoutes.func1(0xc0001f8100)
        /go/src/github.com/jmorganca/ollama/server/routes.go:938 +0x68 fp=0xc00017d780 sp=0xc00017d748 pc=0x9a08c8
github.com/gin-gonic/gin.(*Context).Next(...)
        /root/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/context.go:174
github.com/gin-gonic/gin.CustomRecoveryWithWriter.func1(0xc0001f8100)
        /root/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/recovery.go:102 +0x7a fp=0xc00017d7d0 sp=0xc00017d780 pc=0x977c1a
github.com/gin-gonic/gin.(*Context).Next(...)
        /root/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/context.go:174
github.com/gin-gonic/gin.LoggerWithConfig.func1(0xc0001f8100)
        /root/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/logger.go:240 +0xde fp=0xc00017d980 sp=0xc00017d7d0 pc=0x976dbe
github.com/gin-gonic/gin.(*Context).Next(...)
        /root/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/context.go:174
github.com/gin-gonic/gin.(*Engine).handleHTTPRequest(0xc0000eba00, 0xc0001f8100)
        /root/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/gin.go:620 +0x65b fp=0xc00017db08 sp=0xc00017d980 pc=0x975e7b
github.com/gin-gonic/gin.(*Engine).ServeHTTP(0xc0000eba00, {0x1126bac0?, 0xc0001981c0}, 0xc0001f8200)
        /root/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/gin.go:576 +0x1dd fp=0xc00017db48 sp=0xc00017db08 pc=0x97563d
net/http.serverHandler.ServeHTTP({0x11269de0?}, {0x1126bac0?, 0xc0001981c0?}, 0x6?)
        /usr/local/go/src/net/http/server.go:2938 +0x8e fp=0xc00017db78 sp=0xc00017db48 pc=0x6cee2e
net/http.(*conn).serve(0xc0002861b0, {0x1126d128, 0xc0004a6930})
        /usr/local/go/src/net/http/server.go:2009 +0x5f4 fp=0xc00017dfb8 sp=0xc00017db78 pc=0x6cad14
net/http.(*Server).Serve.func3()
        /usr/local/go/src/net/http/server.go:3086 +0x28 fp=0xc00017dfe0 sp=0xc00017dfb8 pc=0x6cf648
runtime.goexit()
        /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc00017dfe8 sp=0xc00017dfe0 pc=0x46e2c1
created by net/http.(*Server).Serve in goroutine 1
        /usr/local/go/src/net/http/server.go:3086 +0x5cb

goroutine 1 [IO wait]:
runtime.gopark(0x480f10?, 0xc0005bb850?, 0xa0?, 0xb8?, 0x4f711d?)
        /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0005bb830 sp=0xc0005bb810 pc=0x43e7ee
runtime.netpollblock(0x46c332?, 0x4092a6?, 0x0?)
        /usr/local/go/src/runtime/netpoll.go:564 +0xf7 fp=0xc0005bb868 sp=0xc0005bb830 pc=0x437277
internal/poll.runtime_pollWait(0x7f9a505bfe80, 0x72)
        /usr/local/go/src/runtime/netpoll.go:343 +0x85 fp=0xc0005bb888 sp=0xc0005bb868 pc=0x468a05
internal/poll.(*pollDesc).wait(0xc000482000?, 0x4?, 0x0)
        /usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc0005bb8b0 sp=0xc0005bb888 pc=0x4efd67
internal/poll.(*pollDesc).waitRead(...)
        /usr/local/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc000482000)
        /usr/local/go/src/internal/poll/fd_unix.go:611 +0x2ac fp=0xc0005bb958 sp=0xc0005bb8b0 pc=0x4f524c
net.(*netFD).accept(0xc000482000)
        /usr/local/go/src/net/fd_unix.go:172 +0x29 fp=0xc0005bba10 sp=0xc0005bb958 pc=0x56be29
net.(*TCPListener).accept(0xc00045b580)
        /usr/local/go/src/net/tcpsock_posix.go:152 +0x1e fp=0xc0005bba38 sp=0xc0005bba10 pc=0x580c3e
net.(*TCPListener).Accept(0xc00045b580)
        /usr/local/go/src/net/tcpsock.go:315 +0x30 fp=0xc0005bba68 sp=0xc0005bba38 pc=0x57fdf0
net/http.(*onceCloseListener).Accept(0xc0002861b0?)
        <autogenerated>:1 +0x24 fp=0xc0005bba80 sp=0xc0005bba68 pc=0x6f1bc4
net/http.(*Server).Serve(0xc000386ff0, {0x1126b8b0, 0xc00045b580})
        /usr/local/go/src/net/http/server.go:3056 +0x364 fp=0xc0005bbbb0 sp=0xc0005bba80 pc=0x6cf284
github.com/jmorganca/ollama/server.Serve({0x1126b8b0, 0xc00045b580})
        /go/src/github.com/jmorganca/ollama/server/routes.go:1041 +0x454 fp=0xc0005bbc98 sp=0xc0005bbbb0 pc=0x9a0d74
github.com/jmorganca/ollama/cmd.RunServer(0xc000480300?, {0x116b3820?, 0x4?, 0xad9d08?})
        /go/src/github.com/jmorganca/ollama/cmd/cmd.go:705 +0x199 fp=0xc0005bbd30 sp=0xc0005bbc98 pc=0x9b3a19
github.com/spf13/cobra.(*Command).execute(0xc000421800, {0x116b3820, 0x0, 0x0})
        /root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:940 +0x87c fp=0xc0005bbe68 sp=0xc0005bbd30 pc=0x7649fc
github.com/spf13/cobra.(*Command).ExecuteC(0xc000420c00)
        /root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:1068 +0x3a5 fp=0xc0005bbf20 sp=0xc0005bbe68 pc=0x765225
github.com/spf13/cobra.(*Command).Execute(...)
        /root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:992
github.com/spf13/cobra.(*Command).ExecuteContext(...)
        /root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:985
main.main()
        /go/src/github.com/jmorganca/ollama/main.go:11 +0x4d fp=0xc0005bbf40 sp=0xc0005bbf20 pc=0x9bb9cd
runtime.main()
        /usr/local/go/src/runtime/proc.go:267 +0x2bb fp=0xc0005bbfe0 sp=0xc0005bbf40 pc=0x43e39b
runtime.goexit()
        /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005bbfe8 sp=0xc0005bbfe0 pc=0x46e2c1

goroutine 2 [force gc (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
        /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000072fa8 sp=0xc000072f88 pc=0x43e7ee
runtime.goparkunlock(...)
        /usr/local/go/src/runtime/proc.go:404
runtime.forcegchelper()
        /usr/local/go/src/runtime/proc.go:322 +0xb3 fp=0xc000072fe0 sp=0xc000072fa8 pc=0x43e673
runtime.goexit()
        /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000072fe8 sp=0xc000072fe0 pc=0x46e2c1
created by runtime.init.6 in goroutine 1
        /usr/local/go/src/runtime/proc.go:310 +0x1a

goroutine 3 [GC sweep wait]:
runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?)
        /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000073778 sp=0xc000073758 pc=0x43e7ee
runtime.goparkunlock(...)
        /usr/local/go/src/runtime/proc.go:404
runtime.bgsweep(0x0?)
        /usr/local/go/src/runtime/mgcsweep.go:321 +0xdf fp=0xc0000737c8 sp=0xc000073778 pc=0x42a73f
runtime.gcenable.func1()
        /usr/local/go/src/runtime/mgc.go:200 +0x25 fp=0xc0000737e0 sp=0xc0000737c8 pc=0x41f865
runtime.goexit()
        /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000737e8 sp=0xc0000737e0 pc=0x46e2c1
created by runtime.gcenable in goroutine 1
        /usr/local/go/src/runtime/mgc.go:200 +0x66

goroutine 4 [GC scavenge wait]:
runtime.gopark(0x6ce62b?, 0x61f5f2?, 0x0?, 0x0?, 0x0?)
        /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000073f70 sp=0xc000073f50 pc=0x43e7ee
runtime.goparkunlock(...)
        /usr/local/go/src/runtime/proc.go:404
runtime.(*scavengerState).park(0x11683ba0)
        /usr/local/go/src/runtime/mgcscavenge.go:425 +0x49 fp=0xc000073fa0 sp=0xc000073f70 pc=0x427f69
runtime.bgscavenge(0x0?)
        /usr/local/go/src/runtime/mgcscavenge.go:658 +0x59 fp=0xc000073fc8 sp=0xc000073fa0 pc=0x428519
runtime.gcenable.func2()
        /usr/local/go/src/runtime/mgc.go:201 +0x25 fp=0xc000073fe0 sp=0xc000073fc8 pc=0x41f805
runtime.goexit()
        /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000073fe8 sp=0xc000073fe0 pc=0x46e2c1
created by runtime.gcenable in goroutine 1
        /usr/local/go/src/runtime/mgc.go:201 +0xa5

goroutine 5 [finalizer wait]:
runtime.gopark(0xad2cc0?, 0x10043f901?, 0x0?, 0x0?, 0x4469a5?)
        /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000072628 sp=0xc000072608 pc=0x43e7ee
runtime.runfinq()
        /usr/local/go/src/runtime/mfinal.go:193 +0x107 fp=0xc0000727e0 sp=0xc000072628 pc=0x41e8e7
runtime.goexit()
        /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000727e8 sp=0xc0000727e0 pc=0x46e2c1
created by runtime.createfing in goroutine 1
        /usr/local/go/src/runtime/mfinal.go:163 +0x3d

goroutine 6 [select, locked to thread]:
runtime.gopark(0xc0000747a8?, 0x2?, 0x89?, 0xea?, 0xc0000747a4?)
        /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000074638 sp=0xc000074618 pc=0x43e7ee
runtime.selectgo(0xc0000747a8, 0xc0000747a0, 0x0?, 0x0, 0x0?, 0x1)
        /usr/local/go/src/runtime/select.go:327 +0x725 fp=0xc000074758 sp=0xc000074638 pc=0x44e325
runtime.ensureSigM.func1()
        /usr/local/go/src/runtime/signal_unix.go:1014 +0x19f fp=0xc0000747e0 sp=0xc000074758 pc=0x46535f
runtime.goexit()
        /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000747e8 sp=0xc0000747e0 pc=0x46e2c1
created by runtime.ensureSigM in goroutine 1
        /usr/local/go/src/runtime/signal_unix.go:997 +0xc8

goroutine 18 [syscall]:
runtime.notetsleepg(0x0?, 0x0?)
        /usr/local/go/src/runtime/lock_futex.go:236 +0x29 fp=0xc00006e7a0 sp=0xc00006e768 pc=0x411349
os/signal.signal_recv()
        /usr/local/go/src/runtime/sigqueue.go:152 +0x29 fp=0xc00006e7c0 sp=0xc00006e7a0 pc=0x46ac89
os/signal.loop()
        /usr/local/go/src/os/signal/signal_unix.go:23 +0x13 fp=0xc00006e7e0 sp=0xc00006e7c0 pc=0x6f45f3
runtime.goexit()
        /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc00006e7e8 sp=0xc00006e7e0 pc=0x46e2c1
created by os/signal.Notify.func1.1 in goroutine 1
        /usr/local/go/src/os/signal/signal.go:151 +0x1f

goroutine 34 [chan receive]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
        /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000514718 sp=0xc0005146f8 pc=0x43e7ee
runtime.chanrecv(0xc0001a9860, 0x0, 0x1)
        /usr/local/go/src/runtime/chan.go:583 +0x3cd fp=0xc000514790 sp=0xc000514718 pc=0x40beed
runtime.chanrecv1(0x0?, 0x0?)
        /usr/local/go/src/runtime/chan.go:442 +0x12 fp=0xc0005147b8 sp=0xc000514790 pc=0x40baf2
github.com/jmorganca/ollama/server.Serve.func2()
        /go/src/github.com/jmorganca/ollama/server/routes.go:1023 +0x25 fp=0xc0005147e0 sp=0xc0005147b8 pc=0x9a0e05
runtime.goexit()
        /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005147e8 sp=0xc0005147e0 pc=0x46e2c1
created by github.com/jmorganca/ollama/server.Serve in goroutine 1
        /go/src/github.com/jmorganca/ollama/server/routes.go:1022 +0x3c7

goroutine 35 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
        /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000514f50 sp=0xc000514f30 pc=0x43e7ee
runtime.gcBgMarkWorker()
        /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000514fe0 sp=0xc000514f50 pc=0x4213e5
runtime.goexit()
        /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000514fe8 sp=0xc000514fe0 pc=0x46e2c1
created by runtime.gcBgMarkStartWorkers in goroutine 1
        /usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 19 [GC worker (idle)]:
runtime.gopark(0x131e8a75048ea8?, 0x3?, 0xfd?, 0x5d?, 0x0?)
        /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc00006ef50 sp=0xc00006ef30 pc=0x43e7ee
runtime.gcBgMarkWorker()
        /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc00006efe0 sp=0xc00006ef50 pc=0x4213e5
runtime.goexit()
        /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc00006efe8 sp=0xc00006efe0 pc=0x46e2c1
created by runtime.gcBgMarkStartWorkers in goroutine 1
        /usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 36 [GC worker (idle)]:
runtime.gopark(0x131e8a7504bbe6?, 0x1?, 0x3?, 0x5d?, 0x0?)
        /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000515750 sp=0xc000515730 pc=0x43e7ee
runtime.gcBgMarkWorker()
        /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005157e0 sp=0xc000515750 pc=0x4213e5
runtime.goexit()
        /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005157e8 sp=0xc0005157e0 pc=0x46e2c1
created by runtime.gcBgMarkStartWorkers in goroutine 1
        /usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 37 [GC worker (idle)]:
runtime.gopark(0x116b5540?, 0x3?, 0x34?, 0xc?, 0x0?)
        /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000515f50 sp=0xc000515f30 pc=0x43e7ee
runtime.gcBgMarkWorker()
        /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000515fe0 sp=0xc000515f50 pc=0x4213e5
runtime.goexit()
        /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000515fe8 sp=0xc000515fe0 pc=0x46e2c1
created by runtime.gcBgMarkStartWorkers in goroutine 1
        /usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 38 [GC worker (idle)]:
runtime.gopark(0x131e8a7504a72a?, 0x3?, 0xf0?, 0x7f?, 0x0?)
        /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000516750 sp=0xc000516730 pc=0x43e7ee
runtime.gcBgMarkWorker()
        /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005167e0 sp=0xc000516750 pc=0x4213e5
runtime.goexit()
        /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005167e8 sp=0xc0005167e0 pc=0x46e2c1
created by runtime.gcBgMarkStartWorkers in goroutine 1
        /usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 39 [GC worker (idle)]:
runtime.gopark(0x131e8a7504e443?, 0x1?, 0xa6?, 0x62?, 0x0?)
        /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000516f50 sp=0xc000516f30 pc=0x43e7ee
runtime.gcBgMarkWorker()
        /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000516fe0 sp=0xc000516f50 pc=0x4213e5
runtime.goexit()
        /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000516fe8 sp=0xc000516fe0 pc=0x46e2c1
created by runtime.gcBgMarkStartWorkers in goroutine 1
        /usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 40 [GC worker (idle)]:
runtime.gopark(0x131e8a750496c8?, 0x1?, 0x6a?, 0x5?, 0x0?)
        /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000517750 sp=0xc000517730 pc=0x43e7ee
runtime.gcBgMarkWorker()
        /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005177e0 sp=0xc000517750 pc=0x4213e5
runtime.goexit()
        /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005177e8 sp=0xc0005177e0 pc=0x46e2c1
created by runtime.gcBgMarkStartWorkers in goroutine 1
        /usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 41 [GC worker (idle)]:
runtime.gopark(0x131e8a7504e2e8?, 0x3?, 0x25?, 0x28?, 0x0?)
        /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000517f50 sp=0xc000517f30 pc=0x43e7ee
runtime.gcBgMarkWorker()
        /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000517fe0 sp=0xc000517f50 pc=0x4213e5
runtime.goexit()
        /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000517fe8 sp=0xc000517fe0 pc=0x46e2c1
created by runtime.gcBgMarkStartWorkers in goroutine 1
        /usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 7 [GC worker (idle)]:
runtime.gopark(0x131e8a75049497?, 0x3?, 0xca?, 0x3e?, 0x0?)
        /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000074f50 sp=0xc000074f30 pc=0x43e7ee
runtime.gcBgMarkWorker()
        /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000074fe0 sp=0xc000074f50 pc=0x4213e5
runtime.goexit()
        /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000074fe8 sp=0xc000074fe0 pc=0x46e2c1
created by runtime.gcBgMarkStartWorkers in goroutine 1
        /usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 50 [GC worker (idle)]:
runtime.gopark(0x131e8a7504bafc?, 0x3?, 0x3d?, 0xd4?, 0x0?)
        /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000510750 sp=0xc000510730 pc=0x43e7ee
runtime.gcBgMarkWorker()
        /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005107e0 sp=0xc000510750 pc=0x4213e5
runtime.goexit()
        /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005107e8 sp=0xc0005107e0 pc=0x46e2c1
created by runtime.gcBgMarkStartWorkers in goroutine 1
        /usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 42 [GC worker (idle)]:
runtime.gopark(0x131e8a7504e40b?, 0x1?, 0x9f?, 0x6d?, 0x0?)
        /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000528750 sp=0xc000528730 pc=0x43e7ee
runtime.gcBgMarkWorker()
        /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005287e0 sp=0xc000528750 pc=0x4213e5
runtime.goexit()
        /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005287e8 sp=0xc0005287e0 pc=0x46e2c1
created by runtime.gcBgMarkStartWorkers in goroutine 1
        /usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 51 [GC worker (idle)]:
runtime.gopark(0x131e8a750510da?, 0x3?, 0xf?, 0xf0?, 0x0?)
        /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000510f50 sp=0xc000510f30 pc=0x43e7ee
runtime.gcBgMarkWorker()
        /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000510fe0 sp=0xc000510f50 pc=0x4213e5
runtime.goexit()
        /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000510fe8 sp=0xc000510fe0 pc=0x46e2c1
created by runtime.gcBgMarkStartWorkers in goroutine 1
        /usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 8 [GC worker (idle)]:
runtime.gopark(0x131e8a75050f1a?, 0x3?, 0x91?, 0x60?, 0x0?)
        /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000075750 sp=0xc000075730 pc=0x43e7ee
runtime.gcBgMarkWorker()
        /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000757e0 sp=0xc000075750 pc=0x4213e5
runtime.goexit()
        /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000757e8 sp=0xc0000757e0 pc=0x46e2c1
created by runtime.gcBgMarkStartWorkers in goroutine 1
        /usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 9 [GC worker (idle)]:
runtime.gopark(0x131e8a75847d46?, 0x1?, 0xdd?, 0x25?, 0x0?)
        /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000075f50 sp=0xc000075f30 pc=0x43e7ee
runtime.gcBgMarkWorker()
        /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000075fe0 sp=0xc000075f50 pc=0x4213e5
runtime.goexit()
        /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000075fe8 sp=0xc000075fe0 pc=0x46e2c1
created by runtime.gcBgMarkStartWorkers in goroutine 1
        /usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 43 [GC worker (idle)]:
runtime.gopark(0x131e8a75050e92?, 0x1?, 0xd9?, 0x54?, 0x0?)
        /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000528f50 sp=0xc000528f30 pc=0x43e7ee
runtime.gcBgMarkWorker()
        /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000528fe0 sp=0xc000528f50 pc=0x4213e5
runtime.goexit()
        /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000528fe8 sp=0xc000528fe0 pc=0x46e2c1
created by runtime.gcBgMarkStartWorkers in goroutine 1
        /usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 52 [GC worker (idle)]:
runtime.gopark(0xc000039728?, 0x1?, 0x81?, 0xc6?, 0x0?)
        /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000511750 sp=0xc000511730 pc=0x43e7ee
runtime.gcBgMarkWorker()
        /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005117e0 sp=0xc000511750 pc=0x4213e5
runtime.goexit()
        /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005117e8 sp=0xc0005117e0 pc=0x46e2c1
created by runtime.gcBgMarkStartWorkers in goroutine 1
        /usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 10 [GC worker (idle)]:
runtime.gopark(0x131e8a7504becd?, 0x1?, 0x45?, 0x82?, 0x0?)
        /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000524750 sp=0xc000524730 pc=0x43e7ee
runtime.gcBgMarkWorker()
        /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005247e0 sp=0xc000524750 pc=0x4213e5
runtime.goexit()
        /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005247e8 sp=0xc0005247e0 pc=0x46e2c1
created by runtime.gcBgMarkStartWorkers in goroutine 1
        /usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 44 [GC worker (idle)]:
runtime.gopark(0x131e8a7504c4e5?, 0x1?, 0x60?, 0x3c?, 0x0?)
        /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000529750 sp=0xc000529730 pc=0x43e7ee
runtime.gcBgMarkWorker()
        /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005297e0 sp=0xc000529750 pc=0x4213e5
runtime.goexit()
        /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005297e8 sp=0xc0005297e0 pc=0x46e2c1
created by runtime.gcBgMarkStartWorkers in goroutine 1
        /usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 53 [GC worker (idle)]:
runtime.gopark(0x116b5540?, 0x1?, 0x5f?, 0x3c?, 0x0?)
        /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000511f50 sp=0xc000511f30 pc=0x43e7ee
runtime.gcBgMarkWorker()
        /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000511fe0 sp=0xc000511f50 pc=0x4213e5
runtime.goexit()
        /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000511fe8 sp=0xc000511fe0 pc=0x46e2c1
created by runtime.gcBgMarkStartWorkers in goroutine 1
        /usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 11 [GC worker (idle)]:
runtime.gopark(0x131e8a7504c1dd?, 0x3?, 0x28?, 0x63?, 0x0?)
        /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000524f50 sp=0xc000524f30 pc=0x43e7ee
runtime.gcBgMarkWorker()
        /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000524fe0 sp=0xc000524f50 pc=0x4213e5
runtime.goexit()
        /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000524fe8 sp=0xc000524fe0 pc=0x46e2c1
created by runtime.gcBgMarkStartWorkers in goroutine 1
        /usr/local/go/src/runtime/mgc.go:1217 +0x1c

goroutine 48 [IO wait]:
runtime.gopark(0x0?, 0xb?, 0x0?, 0x0?, 0xe?)
        /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc00052a5a0 sp=0xc00052a580 pc=0x43e7ee
runtime.netpollblock(0x47f078?, 0x4092a6?, 0x0?)
        /usr/local/go/src/runtime/netpoll.go:564 +0xf7 fp=0xc00052a5d8 sp=0xc00052a5a0 pc=0x437277
internal/poll.runtime_pollWait(0x7f9a505bfc90, 0x72)
        /usr/local/go/src/runtime/netpoll.go:343 +0x85 fp=0xc00052a5f8 sp=0xc00052a5d8 pc=0x468a05
internal/poll.(*pollDesc).wait(0xc0001a2280?, 0xc0000b5781?, 0x0)
        /usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc00052a620 sp=0xc00052a5f8 pc=0x4efd67
internal/poll.(*pollDesc).waitRead(...)
        /usr/local/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc0001a2280, {0xc0000b5781, 0x1, 0x1})
        /usr/local/go/src/internal/poll/fd_unix.go:164 +0x27a fp=0xc00052a6b8 sp=0xc00052a620 pc=0x4f105a
net.(*netFD).Read(0xc0001a2280, {0xc0000b5781?, 0x0?, 0x0?})
        /usr/local/go/src/net/fd_posix.go:55 +0x25 fp=0xc00052a700 sp=0xc00052a6b8 pc=0x569e05
net.(*conn).Read(0xc0007ae030, {0xc0000b5781?, 0x0?, 0x0?})
        /usr/local/go/src/net/net.go:179 +0x45 fp=0xc00052a748 sp=0xc00052a700 pc=0x5780a5
net.(*TCPConn).Read(0x0?, {0xc0000b5781?, 0x0?, 0x0?})
        <autogenerated>:1 +0x25 fp=0xc00052a778 sp=0xc00052a748 pc=0x589fa5
net/http.(*connReader).backgroundRead(0xc0000b5770)
        /usr/local/go/src/net/http/server.go:683 +0x37 fp=0xc00052a7c8 sp=0xc00052a778 pc=0x6c4b97
net/http.(*connReader).startBackgroundRead.func2()
        /usr/local/go/src/net/http/server.go:679 +0x25 fp=0xc00052a7e0 sp=0xc00052a7c8 pc=0x6c4ac5
runtime.goexit()
        /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc00052a7e8 sp=0xc00052a7e0 pc=0x46e2c1
created by net/http.(*connReader).startBackgroundRead in goroutine 47
        /usr/local/go/src/net/http/server.go:679 +0xba

rax    0x0
rbx    0x7f9a057fd430
rcx    0x6d
rdx    0x7f99f4200490
rdi    0x0
rsi    0x0
rbp    0x7f9a057fd3f0
rsp    0x7f9a057fd258
r8     0x7f993c8ebeb0
r9     0x7f993c8ebed8
r10    0x7f9a98205b40
r11    0x7f9a983a4800
r12    0x0
r13    0x7f99f41fe748
r14    0x7f99f4200490
r15    0x0
rip    0x7f9a983a80bc
rflags 0x10283
cs     0x33
fs     0x0
gs     0x0
Originally created by @wangshuai67 on GitHub (Feb 24, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/2724 Body: **Description:** I encountered an error while running GEMMA:7b on Ollama using Docker. Whenever I attempt to run the GEMMA:7b image, an error occurs. **Steps to Reproduce:** 1. Deploy Ollama on Docker. 2. Run the GEMMA:7b image using the appropriate command. 3. See the error message that is displayed. **Actual Behavior:** Running the GEMMA:7b image on Ollama via Docker results in an error. **Additional Information:** - I have ensured that the Docker setup for Ollama is correct. - Other images and models run successfully on Ollama using Docker. - The error message received while running GEMMA:7b provides details about the issue. ![image](https://github.com/ollama/ollama/assets/13214849/3ca77ff5-7465-445c-b1ad-397493b93702) ollama log ``` time=2024-02-24T08:29:43.035Z level=INFO source=gpu.go:146 msg="CUDA Compute Capability detected: 7.5" [GIN] 2024/02/24 - 08:29:54 | 200 | 1.300495ms | 172.17.0.1 | GET "/api/tags" [GIN] 2024/02/24 - 08:29:54 | 200 | 105.186µs | 172.17.0.1 | GET "/api/version" time=2024-02-24T08:30:03.108Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2" time=2024-02-24T08:30:03.108Z level=INFO source=gpu.go:146 msg="CUDA Compute Capability detected: 7.5" time=2024-02-24T08:30:03.108Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2" time=2024-02-24T08:30:03.108Z level=INFO source=gpu.go:146 msg="CUDA Compute Capability detected: 7.5" time=2024-02-24T08:30:03.108Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2" time=2024-02-24T08:30:03.113Z level=INFO source=dyn_ext_server.go:90 msg="Loading Dynamic llm server: /tmp/ollama2393286333/cuda_v11/libext_server.so" time=2024-02-24T08:30:03.113Z level=INFO source=dyn_ext_server.go:145 msg="Initializing llama server" ggml_init_cublas: GGML_CUDA_FORCE_MMQ: yes ggml_init_cublas: CUDA_USE_TENSOR_CORES: no ggml_init_cublas: found 2 CUDA devices: Device 0: Quadro RTX 6000, compute capability 7.5, VMM: yes Device 1: Quadro RTX 6000, compute capability 7.5, VMM: yes SIGSEGV: segmentation violation PC=0x7f9a983a80bc m=22 sigcode=1 signal arrived during cgo execution goroutine 47 [syscall]: runtime.cgocall(0x9bc8b0, 0xc00017c6f0) /usr/local/go/src/runtime/cgocall.go:157 +0x4b fp=0xc00017c6c8 sp=0xc00017c690 pc=0x409b0b github.com/jmorganca/ollama/llm._Cfunc_dyn_llama_server_init({0x7f99f4001e10, 0x7f99ece5a610, 0x7f99ece4be50, 0x7f99ece4f0d0, 0x7f99ece5dd90, 0x7f99ece57c20, 0x7f99ece4ed50, 0x7f99ece4bed0, 0x7f99ece5e7c0, 0x7f99ece5d930, ...}, ...) _cgo_gotypes.go:282 +0x45 fp=0xc00017c6f0 sp=0xc00017c6c8 pc=0x7c5085 github.com/jmorganca/ollama/llm.newDynExtServer.func7(0xaf2020?, 0xc?) /go/src/github.com/jmorganca/ollama/llm/dyn_ext_server.go:148 +0xef fp=0xc00017c7e0 sp=0xc00017c6f0 pc=0x7c65af github.com/jmorganca/ollama/llm.newDynExtServer({0xc0007aa000, 0x2f}, {0xc0002a42a0, _}, {_, _, _}, {0x0, 0x0, 0x0}, ...) /go/src/github.com/jmorganca/ollama/llm/dyn_ext_server.go:148 +0xa45 fp=0xc00017ca80 sp=0xc00017c7e0 pc=0x7c6245 github.com/jmorganca/ollama/llm.newLlmServer({{_, _, _}, {_, _}, {_, _}}, {_, _}, {0xc0002a42a0, ...}, ...) /go/src/github.com/jmorganca/ollama/llm/llm.go:158 +0x425 fp=0xc00017cc40 sp=0xc00017ca80 pc=0x7c29c5 github.com/jmorganca/ollama/llm.New({0xc0003209a8, 0x15}, {0xc0002a42a0, _}, {_, _, _}, {0x0, 0x0, 0x0}, ...) /go/src/github.com/jmorganca/ollama/llm/llm.go:123 +0x713 fp=0xc00017cec0 sp=0xc00017cc40 pc=0x7c2333 github.com/jmorganca/ollama/server.load(0xc000318000?, 0xc000318000, {{0x0, 0x800, 0x200, 0x1, 0xffffffffffffffff, 0x0, 0x0, 0x1, ...}, ...}, ...) /go/src/github.com/jmorganca/ollama/server/routes.go:85 +0x3a5 fp=0xc00017d040 sp=0xc00017cec0 pc=0x996c05 github.com/jmorganca/ollama/server.ChatHandler(0xc0001f8100) /go/src/github.com/jmorganca/ollama/server/routes.go:1163 +0x60b fp=0xc00017d748 sp=0xc00017d040 pc=0x9a1c8b github.com/gin-gonic/gin.(*Context).Next(...) /root/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/context.go:174 github.com/jmorganca/ollama/server.(*Server).GenerateRoutes.func1(0xc0001f8100) /go/src/github.com/jmorganca/ollama/server/routes.go:938 +0x68 fp=0xc00017d780 sp=0xc00017d748 pc=0x9a08c8 github.com/gin-gonic/gin.(*Context).Next(...) /root/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/context.go:174 github.com/gin-gonic/gin.CustomRecoveryWithWriter.func1(0xc0001f8100) /root/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/recovery.go:102 +0x7a fp=0xc00017d7d0 sp=0xc00017d780 pc=0x977c1a github.com/gin-gonic/gin.(*Context).Next(...) /root/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/context.go:174 github.com/gin-gonic/gin.LoggerWithConfig.func1(0xc0001f8100) /root/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/logger.go:240 +0xde fp=0xc00017d980 sp=0xc00017d7d0 pc=0x976dbe github.com/gin-gonic/gin.(*Context).Next(...) /root/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/context.go:174 github.com/gin-gonic/gin.(*Engine).handleHTTPRequest(0xc0000eba00, 0xc0001f8100) /root/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/gin.go:620 +0x65b fp=0xc00017db08 sp=0xc00017d980 pc=0x975e7b github.com/gin-gonic/gin.(*Engine).ServeHTTP(0xc0000eba00, {0x1126bac0?, 0xc0001981c0}, 0xc0001f8200) /root/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/gin.go:576 +0x1dd fp=0xc00017db48 sp=0xc00017db08 pc=0x97563d net/http.serverHandler.ServeHTTP({0x11269de0?}, {0x1126bac0?, 0xc0001981c0?}, 0x6?) /usr/local/go/src/net/http/server.go:2938 +0x8e fp=0xc00017db78 sp=0xc00017db48 pc=0x6cee2e net/http.(*conn).serve(0xc0002861b0, {0x1126d128, 0xc0004a6930}) /usr/local/go/src/net/http/server.go:2009 +0x5f4 fp=0xc00017dfb8 sp=0xc00017db78 pc=0x6cad14 net/http.(*Server).Serve.func3() /usr/local/go/src/net/http/server.go:3086 +0x28 fp=0xc00017dfe0 sp=0xc00017dfb8 pc=0x6cf648 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc00017dfe8 sp=0xc00017dfe0 pc=0x46e2c1 created by net/http.(*Server).Serve in goroutine 1 /usr/local/go/src/net/http/server.go:3086 +0x5cb goroutine 1 [IO wait]: runtime.gopark(0x480f10?, 0xc0005bb850?, 0xa0?, 0xb8?, 0x4f711d?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc0005bb830 sp=0xc0005bb810 pc=0x43e7ee runtime.netpollblock(0x46c332?, 0x4092a6?, 0x0?) /usr/local/go/src/runtime/netpoll.go:564 +0xf7 fp=0xc0005bb868 sp=0xc0005bb830 pc=0x437277 internal/poll.runtime_pollWait(0x7f9a505bfe80, 0x72) /usr/local/go/src/runtime/netpoll.go:343 +0x85 fp=0xc0005bb888 sp=0xc0005bb868 pc=0x468a05 internal/poll.(*pollDesc).wait(0xc000482000?, 0x4?, 0x0) /usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc0005bb8b0 sp=0xc0005bb888 pc=0x4efd67 internal/poll.(*pollDesc).waitRead(...) /usr/local/go/src/internal/poll/fd_poll_runtime.go:89 internal/poll.(*FD).Accept(0xc000482000) /usr/local/go/src/internal/poll/fd_unix.go:611 +0x2ac fp=0xc0005bb958 sp=0xc0005bb8b0 pc=0x4f524c net.(*netFD).accept(0xc000482000) /usr/local/go/src/net/fd_unix.go:172 +0x29 fp=0xc0005bba10 sp=0xc0005bb958 pc=0x56be29 net.(*TCPListener).accept(0xc00045b580) /usr/local/go/src/net/tcpsock_posix.go:152 +0x1e fp=0xc0005bba38 sp=0xc0005bba10 pc=0x580c3e net.(*TCPListener).Accept(0xc00045b580) /usr/local/go/src/net/tcpsock.go:315 +0x30 fp=0xc0005bba68 sp=0xc0005bba38 pc=0x57fdf0 net/http.(*onceCloseListener).Accept(0xc0002861b0?) <autogenerated>:1 +0x24 fp=0xc0005bba80 sp=0xc0005bba68 pc=0x6f1bc4 net/http.(*Server).Serve(0xc000386ff0, {0x1126b8b0, 0xc00045b580}) /usr/local/go/src/net/http/server.go:3056 +0x364 fp=0xc0005bbbb0 sp=0xc0005bba80 pc=0x6cf284 github.com/jmorganca/ollama/server.Serve({0x1126b8b0, 0xc00045b580}) /go/src/github.com/jmorganca/ollama/server/routes.go:1041 +0x454 fp=0xc0005bbc98 sp=0xc0005bbbb0 pc=0x9a0d74 github.com/jmorganca/ollama/cmd.RunServer(0xc000480300?, {0x116b3820?, 0x4?, 0xad9d08?}) /go/src/github.com/jmorganca/ollama/cmd/cmd.go:705 +0x199 fp=0xc0005bbd30 sp=0xc0005bbc98 pc=0x9b3a19 github.com/spf13/cobra.(*Command).execute(0xc000421800, {0x116b3820, 0x0, 0x0}) /root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:940 +0x87c fp=0xc0005bbe68 sp=0xc0005bbd30 pc=0x7649fc github.com/spf13/cobra.(*Command).ExecuteC(0xc000420c00) /root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:1068 +0x3a5 fp=0xc0005bbf20 sp=0xc0005bbe68 pc=0x765225 github.com/spf13/cobra.(*Command).Execute(...) /root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:992 github.com/spf13/cobra.(*Command).ExecuteContext(...) /root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:985 main.main() /go/src/github.com/jmorganca/ollama/main.go:11 +0x4d fp=0xc0005bbf40 sp=0xc0005bbf20 pc=0x9bb9cd runtime.main() /usr/local/go/src/runtime/proc.go:267 +0x2bb fp=0xc0005bbfe0 sp=0xc0005bbf40 pc=0x43e39b runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005bbfe8 sp=0xc0005bbfe0 pc=0x46e2c1 goroutine 2 [force gc (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000072fa8 sp=0xc000072f88 pc=0x43e7ee runtime.goparkunlock(...) /usr/local/go/src/runtime/proc.go:404 runtime.forcegchelper() /usr/local/go/src/runtime/proc.go:322 +0xb3 fp=0xc000072fe0 sp=0xc000072fa8 pc=0x43e673 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000072fe8 sp=0xc000072fe0 pc=0x46e2c1 created by runtime.init.6 in goroutine 1 /usr/local/go/src/runtime/proc.go:310 +0x1a goroutine 3 [GC sweep wait]: runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000073778 sp=0xc000073758 pc=0x43e7ee runtime.goparkunlock(...) /usr/local/go/src/runtime/proc.go:404 runtime.bgsweep(0x0?) /usr/local/go/src/runtime/mgcsweep.go:321 +0xdf fp=0xc0000737c8 sp=0xc000073778 pc=0x42a73f runtime.gcenable.func1() /usr/local/go/src/runtime/mgc.go:200 +0x25 fp=0xc0000737e0 sp=0xc0000737c8 pc=0x41f865 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000737e8 sp=0xc0000737e0 pc=0x46e2c1 created by runtime.gcenable in goroutine 1 /usr/local/go/src/runtime/mgc.go:200 +0x66 goroutine 4 [GC scavenge wait]: runtime.gopark(0x6ce62b?, 0x61f5f2?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000073f70 sp=0xc000073f50 pc=0x43e7ee runtime.goparkunlock(...) /usr/local/go/src/runtime/proc.go:404 runtime.(*scavengerState).park(0x11683ba0) /usr/local/go/src/runtime/mgcscavenge.go:425 +0x49 fp=0xc000073fa0 sp=0xc000073f70 pc=0x427f69 runtime.bgscavenge(0x0?) /usr/local/go/src/runtime/mgcscavenge.go:658 +0x59 fp=0xc000073fc8 sp=0xc000073fa0 pc=0x428519 runtime.gcenable.func2() /usr/local/go/src/runtime/mgc.go:201 +0x25 fp=0xc000073fe0 sp=0xc000073fc8 pc=0x41f805 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000073fe8 sp=0xc000073fe0 pc=0x46e2c1 created by runtime.gcenable in goroutine 1 /usr/local/go/src/runtime/mgc.go:201 +0xa5 goroutine 5 [finalizer wait]: runtime.gopark(0xad2cc0?, 0x10043f901?, 0x0?, 0x0?, 0x4469a5?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000072628 sp=0xc000072608 pc=0x43e7ee runtime.runfinq() /usr/local/go/src/runtime/mfinal.go:193 +0x107 fp=0xc0000727e0 sp=0xc000072628 pc=0x41e8e7 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000727e8 sp=0xc0000727e0 pc=0x46e2c1 created by runtime.createfing in goroutine 1 /usr/local/go/src/runtime/mfinal.go:163 +0x3d goroutine 6 [select, locked to thread]: runtime.gopark(0xc0000747a8?, 0x2?, 0x89?, 0xea?, 0xc0000747a4?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000074638 sp=0xc000074618 pc=0x43e7ee runtime.selectgo(0xc0000747a8, 0xc0000747a0, 0x0?, 0x0, 0x0?, 0x1) /usr/local/go/src/runtime/select.go:327 +0x725 fp=0xc000074758 sp=0xc000074638 pc=0x44e325 runtime.ensureSigM.func1() /usr/local/go/src/runtime/signal_unix.go:1014 +0x19f fp=0xc0000747e0 sp=0xc000074758 pc=0x46535f runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000747e8 sp=0xc0000747e0 pc=0x46e2c1 created by runtime.ensureSigM in goroutine 1 /usr/local/go/src/runtime/signal_unix.go:997 +0xc8 goroutine 18 [syscall]: runtime.notetsleepg(0x0?, 0x0?) /usr/local/go/src/runtime/lock_futex.go:236 +0x29 fp=0xc00006e7a0 sp=0xc00006e768 pc=0x411349 os/signal.signal_recv() /usr/local/go/src/runtime/sigqueue.go:152 +0x29 fp=0xc00006e7c0 sp=0xc00006e7a0 pc=0x46ac89 os/signal.loop() /usr/local/go/src/os/signal/signal_unix.go:23 +0x13 fp=0xc00006e7e0 sp=0xc00006e7c0 pc=0x6f45f3 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc00006e7e8 sp=0xc00006e7e0 pc=0x46e2c1 created by os/signal.Notify.func1.1 in goroutine 1 /usr/local/go/src/os/signal/signal.go:151 +0x1f goroutine 34 [chan receive]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000514718 sp=0xc0005146f8 pc=0x43e7ee runtime.chanrecv(0xc0001a9860, 0x0, 0x1) /usr/local/go/src/runtime/chan.go:583 +0x3cd fp=0xc000514790 sp=0xc000514718 pc=0x40beed runtime.chanrecv1(0x0?, 0x0?) /usr/local/go/src/runtime/chan.go:442 +0x12 fp=0xc0005147b8 sp=0xc000514790 pc=0x40baf2 github.com/jmorganca/ollama/server.Serve.func2() /go/src/github.com/jmorganca/ollama/server/routes.go:1023 +0x25 fp=0xc0005147e0 sp=0xc0005147b8 pc=0x9a0e05 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005147e8 sp=0xc0005147e0 pc=0x46e2c1 created by github.com/jmorganca/ollama/server.Serve in goroutine 1 /go/src/github.com/jmorganca/ollama/server/routes.go:1022 +0x3c7 goroutine 35 [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000514f50 sp=0xc000514f30 pc=0x43e7ee runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000514fe0 sp=0xc000514f50 pc=0x4213e5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000514fe8 sp=0xc000514fe0 pc=0x46e2c1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 19 [GC worker (idle)]: runtime.gopark(0x131e8a75048ea8?, 0x3?, 0xfd?, 0x5d?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc00006ef50 sp=0xc00006ef30 pc=0x43e7ee runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc00006efe0 sp=0xc00006ef50 pc=0x4213e5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc00006efe8 sp=0xc00006efe0 pc=0x46e2c1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 36 [GC worker (idle)]: runtime.gopark(0x131e8a7504bbe6?, 0x1?, 0x3?, 0x5d?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000515750 sp=0xc000515730 pc=0x43e7ee runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005157e0 sp=0xc000515750 pc=0x4213e5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005157e8 sp=0xc0005157e0 pc=0x46e2c1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 37 [GC worker (idle)]: runtime.gopark(0x116b5540?, 0x3?, 0x34?, 0xc?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000515f50 sp=0xc000515f30 pc=0x43e7ee runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000515fe0 sp=0xc000515f50 pc=0x4213e5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000515fe8 sp=0xc000515fe0 pc=0x46e2c1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 38 [GC worker (idle)]: runtime.gopark(0x131e8a7504a72a?, 0x3?, 0xf0?, 0x7f?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000516750 sp=0xc000516730 pc=0x43e7ee runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005167e0 sp=0xc000516750 pc=0x4213e5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005167e8 sp=0xc0005167e0 pc=0x46e2c1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 39 [GC worker (idle)]: runtime.gopark(0x131e8a7504e443?, 0x1?, 0xa6?, 0x62?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000516f50 sp=0xc000516f30 pc=0x43e7ee runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000516fe0 sp=0xc000516f50 pc=0x4213e5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000516fe8 sp=0xc000516fe0 pc=0x46e2c1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 40 [GC worker (idle)]: runtime.gopark(0x131e8a750496c8?, 0x1?, 0x6a?, 0x5?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000517750 sp=0xc000517730 pc=0x43e7ee runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005177e0 sp=0xc000517750 pc=0x4213e5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005177e8 sp=0xc0005177e0 pc=0x46e2c1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 41 [GC worker (idle)]: runtime.gopark(0x131e8a7504e2e8?, 0x3?, 0x25?, 0x28?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000517f50 sp=0xc000517f30 pc=0x43e7ee runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000517fe0 sp=0xc000517f50 pc=0x4213e5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000517fe8 sp=0xc000517fe0 pc=0x46e2c1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 7 [GC worker (idle)]: runtime.gopark(0x131e8a75049497?, 0x3?, 0xca?, 0x3e?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000074f50 sp=0xc000074f30 pc=0x43e7ee runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000074fe0 sp=0xc000074f50 pc=0x4213e5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000074fe8 sp=0xc000074fe0 pc=0x46e2c1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 50 [GC worker (idle)]: runtime.gopark(0x131e8a7504bafc?, 0x3?, 0x3d?, 0xd4?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000510750 sp=0xc000510730 pc=0x43e7ee runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005107e0 sp=0xc000510750 pc=0x4213e5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005107e8 sp=0xc0005107e0 pc=0x46e2c1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 42 [GC worker (idle)]: runtime.gopark(0x131e8a7504e40b?, 0x1?, 0x9f?, 0x6d?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000528750 sp=0xc000528730 pc=0x43e7ee runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005287e0 sp=0xc000528750 pc=0x4213e5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005287e8 sp=0xc0005287e0 pc=0x46e2c1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 51 [GC worker (idle)]: runtime.gopark(0x131e8a750510da?, 0x3?, 0xf?, 0xf0?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000510f50 sp=0xc000510f30 pc=0x43e7ee runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000510fe0 sp=0xc000510f50 pc=0x4213e5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000510fe8 sp=0xc000510fe0 pc=0x46e2c1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 8 [GC worker (idle)]: runtime.gopark(0x131e8a75050f1a?, 0x3?, 0x91?, 0x60?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000075750 sp=0xc000075730 pc=0x43e7ee runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0000757e0 sp=0xc000075750 pc=0x4213e5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0000757e8 sp=0xc0000757e0 pc=0x46e2c1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 9 [GC worker (idle)]: runtime.gopark(0x131e8a75847d46?, 0x1?, 0xdd?, 0x25?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000075f50 sp=0xc000075f30 pc=0x43e7ee runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000075fe0 sp=0xc000075f50 pc=0x4213e5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000075fe8 sp=0xc000075fe0 pc=0x46e2c1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 43 [GC worker (idle)]: runtime.gopark(0x131e8a75050e92?, 0x1?, 0xd9?, 0x54?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000528f50 sp=0xc000528f30 pc=0x43e7ee runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000528fe0 sp=0xc000528f50 pc=0x4213e5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000528fe8 sp=0xc000528fe0 pc=0x46e2c1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 52 [GC worker (idle)]: runtime.gopark(0xc000039728?, 0x1?, 0x81?, 0xc6?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000511750 sp=0xc000511730 pc=0x43e7ee runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005117e0 sp=0xc000511750 pc=0x4213e5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005117e8 sp=0xc0005117e0 pc=0x46e2c1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 10 [GC worker (idle)]: runtime.gopark(0x131e8a7504becd?, 0x1?, 0x45?, 0x82?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000524750 sp=0xc000524730 pc=0x43e7ee runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005247e0 sp=0xc000524750 pc=0x4213e5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005247e8 sp=0xc0005247e0 pc=0x46e2c1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 44 [GC worker (idle)]: runtime.gopark(0x131e8a7504c4e5?, 0x1?, 0x60?, 0x3c?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000529750 sp=0xc000529730 pc=0x43e7ee runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc0005297e0 sp=0xc000529750 pc=0x4213e5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc0005297e8 sp=0xc0005297e0 pc=0x46e2c1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 53 [GC worker (idle)]: runtime.gopark(0x116b5540?, 0x1?, 0x5f?, 0x3c?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000511f50 sp=0xc000511f30 pc=0x43e7ee runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000511fe0 sp=0xc000511f50 pc=0x4213e5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000511fe8 sp=0xc000511fe0 pc=0x46e2c1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 11 [GC worker (idle)]: runtime.gopark(0x131e8a7504c1dd?, 0x3?, 0x28?, 0x63?, 0x0?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc000524f50 sp=0xc000524f30 pc=0x43e7ee runtime.gcBgMarkWorker() /usr/local/go/src/runtime/mgc.go:1293 +0xe5 fp=0xc000524fe0 sp=0xc000524f50 pc=0x4213e5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc000524fe8 sp=0xc000524fe0 pc=0x46e2c1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /usr/local/go/src/runtime/mgc.go:1217 +0x1c goroutine 48 [IO wait]: runtime.gopark(0x0?, 0xb?, 0x0?, 0x0?, 0xe?) /usr/local/go/src/runtime/proc.go:398 +0xce fp=0xc00052a5a0 sp=0xc00052a580 pc=0x43e7ee runtime.netpollblock(0x47f078?, 0x4092a6?, 0x0?) /usr/local/go/src/runtime/netpoll.go:564 +0xf7 fp=0xc00052a5d8 sp=0xc00052a5a0 pc=0x437277 internal/poll.runtime_pollWait(0x7f9a505bfc90, 0x72) /usr/local/go/src/runtime/netpoll.go:343 +0x85 fp=0xc00052a5f8 sp=0xc00052a5d8 pc=0x468a05 internal/poll.(*pollDesc).wait(0xc0001a2280?, 0xc0000b5781?, 0x0) /usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc00052a620 sp=0xc00052a5f8 pc=0x4efd67 internal/poll.(*pollDesc).waitRead(...) /usr/local/go/src/internal/poll/fd_poll_runtime.go:89 internal/poll.(*FD).Read(0xc0001a2280, {0xc0000b5781, 0x1, 0x1}) /usr/local/go/src/internal/poll/fd_unix.go:164 +0x27a fp=0xc00052a6b8 sp=0xc00052a620 pc=0x4f105a net.(*netFD).Read(0xc0001a2280, {0xc0000b5781?, 0x0?, 0x0?}) /usr/local/go/src/net/fd_posix.go:55 +0x25 fp=0xc00052a700 sp=0xc00052a6b8 pc=0x569e05 net.(*conn).Read(0xc0007ae030, {0xc0000b5781?, 0x0?, 0x0?}) /usr/local/go/src/net/net.go:179 +0x45 fp=0xc00052a748 sp=0xc00052a700 pc=0x5780a5 net.(*TCPConn).Read(0x0?, {0xc0000b5781?, 0x0?, 0x0?}) <autogenerated>:1 +0x25 fp=0xc00052a778 sp=0xc00052a748 pc=0x589fa5 net/http.(*connReader).backgroundRead(0xc0000b5770) /usr/local/go/src/net/http/server.go:683 +0x37 fp=0xc00052a7c8 sp=0xc00052a778 pc=0x6c4b97 net/http.(*connReader).startBackgroundRead.func2() /usr/local/go/src/net/http/server.go:679 +0x25 fp=0xc00052a7e0 sp=0xc00052a7c8 pc=0x6c4ac5 runtime.goexit() /usr/local/go/src/runtime/asm_amd64.s:1650 +0x1 fp=0xc00052a7e8 sp=0xc00052a7e0 pc=0x46e2c1 created by net/http.(*connReader).startBackgroundRead in goroutine 47 /usr/local/go/src/net/http/server.go:679 +0xba rax 0x0 rbx 0x7f9a057fd430 rcx 0x6d rdx 0x7f99f4200490 rdi 0x0 rsi 0x0 rbp 0x7f9a057fd3f0 rsp 0x7f9a057fd258 r8 0x7f993c8ebeb0 r9 0x7f993c8ebed8 r10 0x7f9a98205b40 r11 0x7f9a983a4800 r12 0x0 r13 0x7f99f41fe748 r14 0x7f99f4200490 r15 0x0 rip 0x7f9a983a80bc rflags 0x10283 cs 0x33 fs 0x0 gs 0x0 ```
GiteaMirror commented 2026-04-22 04:43:16 -05:00
Author
Owner
Copy Link

@MaledictYtb commented on GitHub (Feb 24, 2024):

Do you have Ollama 0.1.26 or later ?
"Note: this model requires Ollama 0.1.26 or later."

<!-- gh-comment-id:1962304218 --> @MaledictYtb commented on GitHub (Feb 24, 2024): Do you have Ollama 0.1.26 or later ? "Note: this model requires Ollama 0.1.26 or later."
GiteaMirror commented 2026-04-22 04:43:17 -05:00
Author
Owner
Copy Link

@will-wright-eng commented on GitHub (Feb 24, 2024):

Same results for me -- I'm pulling the latest image in my docker-compose.yml which should be 0.1.27

  ollama:
    image: ollama/ollama:latest
    volumes:
      - ./ollama-data:/root/.ollama
    ports:
      - "11434:11434"
    restart: unless-stopped
    deploy:
      resources:
        limits:
          memory: 4G
<!-- gh-comment-id:1962308535 --> @will-wright-eng commented on GitHub (Feb 24, 2024): Same results for me -- I'm pulling the latest image in my docker-compose.yml which [should be 0.1.27](https://hub.docker.com/r/ollama/ollama/tags) ``` ollama: image: ollama/ollama:latest volumes: - ./ollama-data:/root/.ollama ports: - "11434:11434" restart: unless-stopped deploy: resources: limits: memory: 4G ```
GiteaMirror commented 2026-04-22 04:43:17 -05:00
Author
Owner
Copy Link

@wangshuai67 commented on GitHub (Feb 24, 2024):

Do you have Ollama 0.1.26 or later ? "Note: this model requires Ollama 0.1.26 or later."

Thanks I will upgrade to latest
latest

<!-- gh-comment-id:1962310640 --> @wangshuai67 commented on GitHub (Feb 24, 2024): > Do you have Ollama 0.1.26 or later ? "Note: this model requires Ollama 0.1.26 or later." Thanks I will upgrade to latest [latest](https://hub.docker.com/layers/ollama/ollama/latest/images/sha256-04d6cc972388b6c014105fbca10f0c25a17e8c12bd7f528ef0db7f8d114d585a?context=explore)
GiteaMirror commented 2026-04-22 04:43:18 -05:00
Author
Owner
Copy Link

@wangshuai67 commented on GitHub (Feb 24, 2024):

Same results for me -- I'm pulling the latest image in my docker-compose.yml which should be 0.1.27

  ollama:
    image: ollama/ollama:latest
    volumes:
      - ./ollama-data:/root/.ollama
    ports:
      - "11434:11434"
    restart: unless-stopped
    deploy:
      resources:
        limits:
          memory: 4G

should be 0.1.27
thanks . Finally, it can run properly now.

<!-- gh-comment-id:1962314297 --> @wangshuai67 commented on GitHub (Feb 24, 2024): > Same results for me -- I'm pulling the latest image in my docker-compose.yml which [should be 0.1.27](https://hub.docker.com/r/ollama/ollama/tags) > > ``` > ollama: > image: ollama/ollama:latest > volumes: > - ./ollama-data:/root/.ollama > ports: > - "11434:11434" > restart: unless-stopped > deploy: > resources: > limits: > memory: 4G > ``` [should be 0.1.27](https://hub.docker.com/r/ollama/ollama/tags) thanks . Finally, it can run properly now.
GiteaMirror commented 2026-04-22 04:43:19 -05:00
Author
Owner
Copy Link

@will-wright-eng commented on GitHub (Feb 25, 2024):

Ah, I had to delete the image and re-pull it to get the latest version. I thought docker-compose up --build would pull the latest image for some reason

<!-- gh-comment-id:1962802156 --> @will-wright-eng commented on GitHub (Feb 25, 2024): Ah, I had to delete the image and re-pull it to get the latest version. I thought `docker-compose up --build` would pull the latest image for some reason
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
 python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#27396
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?