github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-05-07 00:22:43 -05:00
Code Issues 14.5k Packages Projects Releases 120 Wiki Activity

[GH-ISSUE #14518] error:CHECK_TRY_ERROR((*stream).memcpy((char *) tensor->data + offset, host_buf, size).wait()) #9420

New Issue
Open
opened 2026-04-12 22:20:46 -05:00 by GiteaMirror · 2 comments
GiteaMirror commented 2026-04-12 22:20:46 -05:00
Owner
Copy Link

Originally created by @eppesuig on GitHub (Feb 28, 2026).
Original GitHub issue: https://github.com/ollama/ollama/issues/14518

What is the issue?

hello,
I've just installed llama.cpp using this yaml file:

# cat docker-compose.yml 
services:
  intel-llm:
    image: docker.io/intelanalytics/ipex-llm-inference-cpp-xpu:latest
    container_name: intel-llm
    restart: always
    networks: [ ml_shared ]
    devices:
      - /dev/dri:/dev/dri
    environment:
      OLLAMA_HOST: "0.0.0.0"
      DEVICE: "Arc"
      OLLAMA_NUM_GPU: "999"
      ZES_ENABLE_SYSMAN: "1"
    volumes:
      - /srv/nfs/docker/modelli_ollama:/root/.ollama/models
      - /srv/nfs/docker/modelli_ollama:/models
    command: >
      sh -c 'mkdir -p /llm/ollama && cd /llm/ollama && init-ollama && exec ./ollama serve'

  openwebui:
    image: ghcr.io/open-webui/open-webui:main
    container_name: openwebui
    restart: always
    networks: [ ml_shared ]
    ports:
      - "3000:8080"
    environment:
      OLLAMA_BASE_URL: "http://intel-llm:11434"

networks:
  ml_shared:

volumes:
  ollama_models:

then I loaded a single model and tried it. Any prompt I made, I always get this error message inside the Open WebUI interface:

500: llama runner process has terminated: error:CHECK_TRY_ERROR((*stream).memcpy((char *) tensor->data + offset, host_buf, size).wait()): Exception caught in this line of code.
  in function ggml_backend_sycl_buffer_set_tensor at /home/runner/_work/llm.cpp/llm.cpp/ollama-llama-cpp/ggml/src/ggml-sycl/ggml-sycl.cpp:429

my graphics board is an Intel Arc B580, and, from the boot log, I see these firmwares:
feb 28 21:11:10 mantide kernel: xe 0000:0a:00.0: [drm] Finished loading DMC firmware i915/bmg_dmc.bin (v2.6)
feb 28 21:11:10 mantide kernel: xe 0000:0a:00.0: [drm] Tile0: GT0: Using GuC firmware from xe/bmg_guc_70.bin version 70.55.3

The model I loaded is deepseek-31:32b

Relevant log output

load_tensors: loading model tensors, this can take a while... (mmap = false)
get_memory_info: [warning] ext_intel_free_memory is not supported (export/set ZES_ENABLE_SYSMAN=1 to support), use total memory as free memory
get_memory_info: [warning] ext_intel_free_memory is not supported (export/set ZES_ENABLE_SYSMAN=1 to support), use total memory as free memory
load_tensors: offloading 64 repeating layers to GPU
load_tensors: offloading output layer to GPU
load_tensors: offloaded 65/65 layers to GPU
load_tensors:          CPU model buffer size =   417.66 MiB
load_tensors:        SYCL0 model buffer size = 18508.35 MiB
Native API failed. Native API returns: 20 (UR_RESULT_ERROR_DEVICE_LOST)
Exception caught at file:/home/runner/_work/llm.cpp/llm.cpp/ollama-llama-cpp/ggml/src/ggml-sycl/ggml-sycl.cpp, line:429, func:operator()
SYCL error: CHECK_TRY_ERROR((*stream).memcpy((char *) tensor->data + offset, host_buf, size).wait()): Exception caught in this line of code.
  in function ggml_backend_sycl_buffer_set_tensor at /home/runner/_work/llm.cpp/llm.cpp/ollama-llama-cpp/ggml/src/ggml-sycl/ggml-sycl.cpp:429
/home/runner/_work/llm.cpp/llm.cpp/ollama-llama-cpp/ggml/src/ggml-sycl/../ggml-sycl/common.hpp:115: SYCL error
/usr/local/lib/python3.11/dist-packages/bigdl/cpp/libs/ollama/ollama-lib[0x117b058]
/usr/local/lib/python3.11/dist-packages/bigdl/cpp/libs/ollama/ollama-lib(ggml_abort+0x136)[0x117b3c6]
/usr/local/lib/python3.11/dist-packages/bigdl/cpp/libs/ollama/libggml-sycl.so(+0x86a88)[0x7f04e2886a88]
/usr/local/lib/python3.11/dist-packages/bigdl/cpp/libs/ollama/libggml-sycl.so(+0x8a7e7)[0x7f04e288a7e7]
/usr/local/lib/python3.11/dist-packages/bigdl/cpp/libs/ollama/libllama.so(_ZN18llama_model_loader13load_all_dataEP12ggml_contextRSt13unordered_mapIjP19ggml_backend_bufferSt4hashIjESt8equal_toIjESaISt4pairIKjS4_EEEPSt6vectorISt10unique_ptrI11llama_mlockSt14default_deleteISH_EESaISK_EEPFbfPvESO_+0x12b5)[0x7f04e20be0c5]
/usr/local/lib/python3.11/dist-packages/bigdl/cpp/libs/ollama/libllama.so(_ZN11llama_model12load_tensorsER18llama_model_loader+0x1f670)[0x7f04e20eacd0]
/usr/local/lib/python3.11/dist-packages/bigdl/cpp/libs/ollama/libllama.so(+0x64164)[0x7f04e2064164]
/usr/local/lib/python3.11/dist-packages/bigdl/cpp/libs/ollama/libllama.so(llama_model_load_from_file+0xec)[0x7f04e206377c]
/usr/local/lib/python3.11/dist-packages/bigdl/cpp/libs/ollama/ollama-lib(_cgo_89fafab9cb6c_Cfunc_llama_model_load_from_file+0x4b)[0x1159acb]
/usr/local/lib/python3.11/dist-packages/bigdl/cpp/libs/ollama/ollama-lib[0x4a1f64]
SIGABRT: abort
PC=0x7f04e126d9fc m=8 sigcode=18446744073709551610
signal arrived during cgo execution

goroutine 50 gp=0xc000484700 m=8 mp=0xc000600008 [syscall]:
runtime.cgocall(0x1159a80, 0xc000239890)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/cgocall.go:167 +0x4b fp=0xc000239868 sp=0xc000239830 pc=0x49780b
github.com/ollama/ollama/llama._Cfunc_llama_model_load_from_file(0x7f0464000b70, {0x0, 0x0, 0x3e7, 0x1, 0x0, 0x0, 0x1159230, 0xc0001d5720, 0x0, ...})
	_cgo_gotypes.go:876 +0x47 fp=0xc000239890 sp=0xc000239868 pc=0x846047
github.com/ollama/ollama/llama.LoadModelFromFile.func4(...)
	/home/runner/_work/llm.cpp/llm.cpp/ollama-internal/llama/llama.go:296
github.com/ollama/ollama/llama.LoadModelFromFile({0x7ffcee385b8d, 0x62}, {0x3e7, 0x0, 0x0, {0x0, 0x0, 0x0}, 0xc00012a650, 0x0, ...})
	/home/runner/_work/llm.cpp/llm.cpp/ollama-internal/llama/llama.go:296 +0x4d7 fp=0xc000239d80 sp=0xc000239890 pc=0x848277
github.com/ollama/ollama/runner/llamarunner.(*Server).loadModel(0xc000314000, {0x3e7, 0x0, 0x0, {0x0, 0x0, 0x0}, 0xc00012a650, 0x0, {0x0, ...}}, ...)
	/home/runner/_work/llm.cpp/llm.cpp/ollama-internal/runner/llamarunner/runner.go:749 +0x9e fp=0xc000239ee8 sp=0xc000239d80 pc=0x90503e
github.com/ollama/ollama/runner/llamarunner.Execute.gowrap1()
	/home/runner/_work/llm.cpp/llm.cpp/ollama-internal/runner/llamarunner/runner.go:885 +0x115 fp=0xc000239fe0 sp=0xc000239ee8 pc=0x906b15
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000239fe8 sp=0xc000239fe0 pc=0x4a22e1
created by github.com/ollama/ollama/runner/llamarunner.Execute in goroutine 1
	/home/runner/_work/llm.cpp/llm.cpp/ollama-internal/runner/llamarunner/runner.go:885 +0xd2a

goroutine 1 gp=0xc000002380 m=nil [IO wait]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc0005875b8 sp=0xc000587598 pc=0x49ac8e
runtime.netpollblock(0xc000587638?, 0x433da6?, 0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/netpoll.go:575 +0xf7 fp=0xc0005875f0 sp=0xc0005875b8 pc=0x45f957
internal/poll.runtime_pollWait(0x7f04e2403de0, 0x72)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/netpoll.go:351 +0x85 fp=0xc000587610 sp=0xc0005875f0 pc=0x499ea5
internal/poll.(*pollDesc).wait(0xc000312100?, 0x442746?, 0x0)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc000587638 sp=0xc000587610 pc=0x5211c7
internal/poll.(*pollDesc).waitRead(...)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc000312100)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/internal/poll/fd_unix.go:620 +0x295 fp=0xc0005876e0 sp=0xc000587638 pc=0x526595
net.(*netFD).accept(0xc000312100)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/net/fd_unix.go:172 +0x29 fp=0xc000587798 sp=0xc0005876e0 pc=0x598aa9
net.(*TCPListener).accept(0xc00012f940)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/net/tcpsock_posix.go:159 +0x1b fp=0xc0005877e8 sp=0xc000587798 pc=0x5ae41b
net.(*TCPListener).Accept(0xc00012f940)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/net/tcpsock.go:380 +0x30 fp=0xc000587818 sp=0xc0005877e8 pc=0x5ad2d0
net/http.(*onceCloseListener).Accept(0xc0003ca000?)
	<autogenerated>:1 +0x24 fp=0xc000587830 sp=0xc000587818 pc=0x7c4964
net/http.(*Server).Serve(0xc000490100, {0x15f1be8, 0xc00012f940})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/net/http/server.go:3424 +0x30c fp=0xc000587960 sp=0xc000587830 pc=0x79c22c
github.com/ollama/ollama/runner/llamarunner.Execute({0xc000132020, 0xf, 0x10})
	/home/runner/_work/llm.cpp/llm.cpp/ollama-internal/runner/llamarunner/runner.go:912 +0x11e9 fp=0xc000587d08 sp=0xc000587960 pc=0x906709
github.com/ollama/ollama/runner.Execute({0xc000132010?, 0x0?, 0x0?})
	/home/runner/_work/llm.cpp/llm.cpp/ollama-internal/runner/runner.go:22 +0xd4 fp=0xc000587d30 sp=0xc000587d08 pc=0x98b474
github.com/ollama/ollama/cmd.NewCLI.func2(0xc0001f9400?, {0x141a6a2?, 0x4?, 0x141a6a6?})
	/home/runner/_work/llm.cpp/llm.cpp/ollama-internal/cmd/cmd.go:1529 +0x45 fp=0xc000587d58 sp=0xc000587d30 pc=0x10e7c05
github.com/spf13/cobra.(*Command).execute(0xc00001cf08, {0xc000424f00, 0xf, 0xf})
	/root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:940 +0x85c fp=0xc000587e78 sp=0xc000587d58 pc=0x6120bc
github.com/spf13/cobra.(*Command).ExecuteC(0xc0000dc908)
	/root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:1068 +0x3a5 fp=0xc000587f30 sp=0xc000587e78 pc=0x612905
github.com/spf13/cobra.(*Command).Execute(...)
	/root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:992
github.com/spf13/cobra.(*Command).ExecuteContext(...)
	/root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:985
main.main()
	/home/runner/_work/llm.cpp/llm.cpp/ollama-internal/main.go:12 +0x4d fp=0xc000587f50 sp=0xc000587f30 pc=0x10e868d
runtime.main()
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:283 +0x28b fp=0xc000587fe0 sp=0xc000587f50 pc=0x466f6b
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000587fe8 sp=0xc000587fe0 pc=0x4a22e1

goroutine 2 gp=0xc000002e00 m=nil [force gc (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000084fa8 sp=0xc000084f88 pc=0x49ac8e
runtime.goparkunlock(...)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:441
runtime.forcegchelper()
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:348 +0xb3 fp=0xc000084fe0 sp=0xc000084fa8 pc=0x4672b3
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000084fe8 sp=0xc000084fe0 pc=0x4a22e1
created by runtime.init.7 in goroutine 1
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:336 +0x1a

goroutine 3 gp=0xc000003340 m=nil [GC sweep wait]:
runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000085780 sp=0xc000085760 pc=0x49ac8e
runtime.goparkunlock(...)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:441
runtime.bgsweep(0xc0000b0000)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgcsweep.go:316 +0xdf fp=0xc0000857c8 sp=0xc000085780 pc=0x451adf
runtime.gcenable.gowrap1()
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:204 +0x25 fp=0xc0000857e0 sp=0xc0000857c8 pc=0x445f45
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000857e8 sp=0xc0000857e0 pc=0x4a22e1
created by runtime.gcenable in goroutine 1
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:204 +0x66

goroutine 4 gp=0xc000003500 m=nil [GC scavenge wait]:
runtime.gopark(0x10000?, 0x15df218?, 0x0?, 0x0?, 0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000085f78 sp=0xc000085f58 pc=0x49ac8e
runtime.goparkunlock(...)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:441
runtime.(*scavengerState).park(0x20e2940)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgcscavenge.go:425 +0x49 fp=0xc000085fa8 sp=0xc000085f78 pc=0x44f529
runtime.bgscavenge(0xc0000b0000)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgcscavenge.go:658 +0x59 fp=0xc000085fc8 sp=0xc000085fa8 pc=0x44fab9
runtime.gcenable.gowrap2()
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:205 +0x25 fp=0xc000085fe0 sp=0xc000085fc8 pc=0x445ee5
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000085fe8 sp=0xc000085fe0 pc=0x4a22e1
created by runtime.gcenable in goroutine 1
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:205 +0xa5

goroutine 18 gp=0xc000102700 m=nil [finalizer wait]:
runtime.gopark(0x1b8?, 0xc000002380?, 0x1?, 0x23?, 0xc000084688?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000084630 sp=0xc000084610 pc=0x49ac8e
runtime.runfinq()
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mfinal.go:196 +0x107 fp=0xc0000847e0 sp=0xc000084630 pc=0x444f07
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000847e8 sp=0xc0000847e0 pc=0x4a22e1
created by runtime.createfing in goroutine 1
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mfinal.go:166 +0x3d

goroutine 19 gp=0xc000103180 m=nil [chan receive]:
runtime.gopark(0xc00017b9a0?, 0xc000492018?, 0x60?, 0x7?, 0x57f7e8?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000080718 sp=0xc0000806f8 pc=0x49ac8e
runtime.chanrecv(0xc000110310, 0x0, 0x1)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/chan.go:664 +0x445 fp=0xc000080790 sp=0xc000080718 pc=0x436925
runtime.chanrecv1(0x0?, 0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/chan.go:506 +0x12 fp=0xc0000807b8 sp=0xc000080790 pc=0x4364b2
runtime.unique_runtime_registerUniqueMapCleanup.func2(...)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1796
runtime.unique_runtime_registerUniqueMapCleanup.gowrap1()
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1799 +0x2f fp=0xc0000807e0 sp=0xc0000807b8 pc=0x44908f
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000807e8 sp=0xc0000807e0 pc=0x4a22e1
created by unique.runtime_registerUniqueMapCleanup in goroutine 1
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1794 +0x79

goroutine 20 gp=0xc000103500 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000080f38 sp=0xc000080f18 pc=0x49ac8e
runtime.gcBgMarkWorker(0xc000111730)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000080fc8 sp=0xc000080f38 pc=0x4483a9
runtime.gcBgMarkStartWorkers.gowrap1()
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x25 fp=0xc000080fe0 sp=0xc000080fc8 pc=0x448285
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000080fe8 sp=0xc000080fe0 pc=0x4a22e1
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x105

goroutine 34 gp=0xc000484000 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc00048a738 sp=0xc00048a718 pc=0x49ac8e
runtime.gcBgMarkWorker(0xc000111730)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1423 +0xe9 fp=0xc00048a7c8 sp=0xc00048a738 pc=0x4483a9
runtime.gcBgMarkStartWorkers.gowrap1()
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x25 fp=0xc00048a7e0 sp=0xc00048a7c8 pc=0x448285
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00048a7e8 sp=0xc00048a7e0 pc=0x4a22e1
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x105

goroutine 5 gp=0xc000003a40 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000086738 sp=0xc000086718 pc=0x49ac8e
runtime.gcBgMarkWorker(0xc000111730)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1423 +0xe9 fp=0xc0000867c8 sp=0xc000086738 pc=0x4483a9
runtime.gcBgMarkStartWorkers.gowrap1()
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x25 fp=0xc0000867e0 sp=0xc0000867c8 pc=0x448285
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000867e8 sp=0xc0000867e0 pc=0x4a22e1
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x105

goroutine 21 gp=0xc0001036c0 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000081738 sp=0xc000081718 pc=0x49ac8e
runtime.gcBgMarkWorker(0xc000111730)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1423 +0xe9 fp=0xc0000817c8 sp=0xc000081738 pc=0x4483a9
runtime.gcBgMarkStartWorkers.gowrap1()
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x25 fp=0xc0000817e0 sp=0xc0000817c8 pc=0x448285
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000817e8 sp=0xc0000817e0 pc=0x4a22e1
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x105


goroutine 35 gp=0xc0004841c0 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc00048af38 sp=0xc00048af18 pc=0x49ac8e
runtime.gcBgMarkWorker(0xc000111730)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1423 +0xe9 fp=0xc00048afc8 sp=0xc00048af38 pc=0x4483a9
runtime.gcBgMarkStartWorkers.gowrap1()
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x25 fp=0xc00048afe0 sp=0xc00048afc8 pc=0x448285
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00048afe8 sp=0xc00048afe0 pc=0x4a22e1
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x105

goroutine 6 gp=0xc000003c00 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000086f38 sp=0xc000086f18 pc=0x49ac8e
runtime.gcBgMarkWorker(0xc000111730)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000086fc8 sp=0xc000086f38 pc=0x4483a9
runtime.gcBgMarkStartWorkers.gowrap1()
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x25 fp=0xc000086fe0 sp=0xc000086fc8 pc=0x448285
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000086fe8 sp=0xc000086fe0 pc=0x4a22e1
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x105

goroutine 22 gp=0xc000103880 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000081f38 sp=0xc000081f18 pc=0x49ac8e
runtime.gcBgMarkWorker(0xc000111730)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000081fc8 sp=0xc000081f38 pc=0x4483a9
runtime.gcBgMarkStartWorkers.gowrap1()
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x25 fp=0xc000081fe0 sp=0xc000081fc8 pc=0x448285
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000081fe8 sp=0xc000081fe0 pc=0x4a22e1
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x105

goroutine 36 gp=0xc000484380 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc00048b738 sp=0xc00048b718 pc=0x49ac8e
runtime.gcBgMarkWorker(0xc000111730)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1423 +0xe9 fp=0xc00048b7c8 sp=0xc00048b738 pc=0x4483a9
runtime.gcBgMarkStartWorkers.gowrap1()
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x25 fp=0xc00048b7e0 sp=0xc00048b7c8 pc=0x448285
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00048b7e8 sp=0xc00048b7e0 pc=0x4a22e1
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x105

goroutine 7 gp=0xc000003dc0 m=nil [GC worker (idle)]:
runtime.gopark(0x2190920?, 0x3?, 0x3e?, 0x9f?, 0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000087738 sp=0xc000087718 pc=0x49ac8e
runtime.gcBgMarkWorker(0xc000111730)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1423 +0xe9 fp=0xc0000877c8 sp=0xc000087738 pc=0x4483a9
runtime.gcBgMarkStartWorkers.gowrap1()
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x25 fp=0xc0000877e0 sp=0xc0000877c8 pc=0x448285
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000877e8 sp=0xc0000877e0 pc=0x4a22e1
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x105

goroutine 37 gp=0xc000484540 m=nil [GC worker (idle)]:
runtime.gopark(0x3b4b1b3f17?, 0x0?, 0x0?, 0x0?, 0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc00048bf38 sp=0xc00048bf18 pc=0x49ac8e
runtime.gcBgMarkWorker(0xc000111730)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1423 +0xe9 fp=0xc00048bfc8 sp=0xc00048bf38 pc=0x4483a9
runtime.gcBgMarkStartWorkers.gowrap1()
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x25 fp=0xc00048bfe0 sp=0xc00048bfc8 pc=0x448285
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00048bfe8 sp=0xc00048bfe0 pc=0x4a22e1
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x105

goroutine 23 gp=0xc000103dc0 m=nil [GC worker (idle)]:
runtime.gopark(0x3b4b1b351d?, 0x0?, 0x0?, 0x0?, 0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000082738 sp=0xc000082718 pc=0x49ac8e
runtime.gcBgMarkWorker(0xc000111730)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1423 +0xe9 fp=0xc0000827c8 sp=0xc000082738 pc=0x4483a9
runtime.gcBgMarkStartWorkers.gowrap1()
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x25 fp=0xc0000827e0 sp=0xc0000827c8 pc=0x448285
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000827e8 sp=0xc0000827e0 pc=0x4a22e1
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x105

goroutine 24 gp=0xc00047e000 m=nil [GC worker (idle)]:
runtime.gopark(0x3b4b1b7f0a?, 0x1?, 0xd4?, 0xc5?, 0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000082f38 sp=0xc000082f18 pc=0x49ac8e
runtime.gcBgMarkWorker(0xc000111730)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000082fc8 sp=0xc000082f38 pc=0x4483a9
runtime.gcBgMarkStartWorkers.gowrap1()
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x25 fp=0xc000082fe0 sp=0xc000082fc8 pc=0x448285
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000082fe8 sp=0xc000082fe0 pc=0x4a22e1
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x105

goroutine 51 gp=0xc0004848c0 m=nil [sync.WaitGroup.Wait]:
runtime.gopark(0x0?, 0x0?, 0x60?, 0x0?, 0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc00048c620 sp=0xc00048c600 pc=0x49ac8e
runtime.goparkunlock(...)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:441
runtime.semacquire1(0xc000314008, 0x0, 0x1, 0x0, 0x18)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/sema.go:188 +0x21d fp=0xc00048c688 sp=0xc00048c620 pc=0x47a47d
sync.runtime_SemacquireWaitGroup(0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/sema.go:110 +0x25 fp=0xc00048c6c0 sp=0xc00048c688 pc=0x49c685
sync.(*WaitGroup).Wait(0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/sync/waitgroup.go:118 +0x48 fp=0xc00048c6e8 sp=0xc00048c6c0 pc=0x4adc28
github.com/ollama/ollama/runner/llamarunner.(*Server).run(0xc000314000, {0x15f4210, 0xc000176eb0})
	/home/runner/_work/llm.cpp/llm.cpp/ollama-internal/runner/llamarunner/runner.go:314 +0x47 fp=0xc00048c7b8 sp=0xc00048c6e8 pc=0x901d67
github.com/ollama/ollama/runner/llamarunner.Execute.gowrap2()
	/home/runner/_work/llm.cpp/llm.cpp/ollama-internal/runner/llamarunner/runner.go:892 +0x28 fp=0xc00048c7e0 sp=0xc00048c7b8 pc=0x9069c8
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00048c7e8 sp=0xc00048c7e0 pc=0x4a22e1
created by github.com/ollama/ollama/runner/llamarunner.Execute in goroutine 1
	/home/runner/_work/llm.cpp/llm.cpp/ollama-internal/runner/llamarunner/runner.go:892 +0xe05

goroutine 38 gp=0xc000602380 m=nil [IO wait]:
runtime.gopark(0x5247c5?, 0xc0003a4000?, 0x40?, 0x5a?, 0xb?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000235948 sp=0xc000235928 pc=0x49ac8e
runtime.netpollblock(0x4bdef8?, 0x433da6?, 0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/netpoll.go:575 +0xf7 fp=0xc000235980 sp=0xc000235948 pc=0x45f957
internal/poll.runtime_pollWait(0x7f04e2403cc8, 0x72)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/netpoll.go:351 +0x85 fp=0xc0002359a0 sp=0xc000235980 pc=0x499ea5
internal/poll.(*pollDesc).wait(0xc0003a4000?, 0xc0003d2000?, 0x0)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc0002359c8 sp=0xc0002359a0 pc=0x5211c7
internal/poll.(*pollDesc).waitRead(...)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Read(0xc0003a4000, {0xc0003d2000, 0x1000, 0x1000})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/internal/poll/fd_unix.go:165 +0x27a fp=0xc000235a60 sp=0xc0002359c8 pc=0x5224ba
net.(*netFD).Read(0xc0003a4000, {0xc0003d2000?, 0xc000235ad0?, 0x521685?})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/net/fd_posix.go:55 +0x25 fp=0xc000235aa8 sp=0xc000235a60 pc=0x596b05
net.(*conn).Read(0xc0003c8000, {0xc0003d2000?, 0x0?, 0x0?})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/net/net.go:194 +0x45 fp=0xc000235af0 sp=0xc000235aa8 pc=0x5a4ea5
net/http.(*connReader).Read(0xc0003ae0c0, {0xc0003d2000, 0x1000, 0x1000})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/net/http/server.go:798 +0x159 fp=0xc000235b40 sp=0xc000235af0 pc=0x7910d9
bufio.(*Reader).fill(0xc0006100c0)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/bufio/bufio.go:113 +0x103 fp=0xc000235b78 sp=0xc000235b40 pc=0x5bc623
bufio.(*Reader).Peek(0xc0006100c0, 0x4)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/bufio/bufio.go:152 +0x53 fp=0xc000235b98 sp=0xc000235b78 pc=0x5bc753
net/http.(*conn).serve(0xc0003ca000, {0x15f41d8, 0xc0002ee420})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/net/http/server.go:2137 +0x785 fp=0xc000235fb8 sp=0xc000235b98 pc=0x796ec5
net/http.(*Server).Serve.gowrap3()
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/net/http/server.go:3454 +0x28 fp=0xc000235fe0 sp=0xc000235fb8 pc=0x79c628
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000235fe8 sp=0xc000235fe0 pc=0x4a22e1
created by net/http.(*Server).Serve in goroutine 1
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/net/http/server.go:3454 +0x485

rax    0x0
rbx    0x7f047d7fa640
rcx    0x7f04e126d9fc
rdx    0x6
rdi    0x2b
rsi    0x33
rbp    0x33
rsp    0x7f047d7f8540
r8     0x7f047d7f8610
r9     0x1
r10    0x8
r11    0x246
r12    0x6
r13    0x16
r14    0x7f04e2a68474
r15    0x7f04e2a6971d
rip    0x7f04e126d9fc
rflags 0x246
cs     0x33
fs     0x0
gs     0x0
time=2026-03-01T04:15:28.389+08:00 level=ERROR source=server.go:484 msg="llama runner terminated" error="exit status 2"
time=2026-03-01T04:15:28.448+08:00 level=ERROR source=sched.go:489 msg="error loading llama server" error="llama runner process has terminated: error:CHECK_TRY_ERROR((*stream).memcpy((char *) tensor->data + offset, host_buf, size).wait()): Exception caught in this line of code.\n  in function ggml_backend_sycl_buffer_set_tensor at /home/runner/_work/llm.cpp/llm.cpp/ollama-llama-cpp/ggml/src/ggml-sycl/ggml-sycl.cpp:429"

OS

Docker

GPU

Intel

CPU

AMD

Ollama version

0.9.3

Originally created by @eppesuig on GitHub (Feb 28, 2026). Original GitHub issue: https://github.com/ollama/ollama/issues/14518 ### What is the issue? hello, I've just installed llama.cpp using this yaml file: ``` # cat docker-compose.yml services: intel-llm: image: docker.io/intelanalytics/ipex-llm-inference-cpp-xpu:latest container_name: intel-llm restart: always networks: [ ml_shared ] devices: - /dev/dri:/dev/dri environment: OLLAMA_HOST: "0.0.0.0" DEVICE: "Arc" OLLAMA_NUM_GPU: "999" ZES_ENABLE_SYSMAN: "1" volumes: - /srv/nfs/docker/modelli_ollama:/root/.ollama/models - /srv/nfs/docker/modelli_ollama:/models command: > sh -c 'mkdir -p /llm/ollama && cd /llm/ollama && init-ollama && exec ./ollama serve' openwebui: image: ghcr.io/open-webui/open-webui:main container_name: openwebui restart: always networks: [ ml_shared ] ports: - "3000:8080" environment: OLLAMA_BASE_URL: "http://intel-llm:11434" networks: ml_shared: volumes: ollama_models: ``` then I loaded a single model and tried it. Any prompt I made, I always get this error message inside the Open WebUI interface: ``` 500: llama runner process has terminated: error:CHECK_TRY_ERROR((*stream).memcpy((char *) tensor->data + offset, host_buf, size).wait()): Exception caught in this line of code. in function ggml_backend_sycl_buffer_set_tensor at /home/runner/_work/llm.cpp/llm.cpp/ollama-llama-cpp/ggml/src/ggml-sycl/ggml-sycl.cpp:429 ``` my graphics board is an Intel Arc B580, and, from the boot log, I see these firmwares: feb 28 21:11:10 mantide kernel: xe 0000:0a:00.0: [drm] Finished loading DMC firmware i915/bmg_dmc.bin (v2.6) feb 28 21:11:10 mantide kernel: xe 0000:0a:00.0: [drm] Tile0: GT0: Using GuC firmware from xe/bmg_guc_70.bin version 70.55.3 The model I loaded is deepseek-31:32b ### Relevant log output ```shell load_tensors: loading model tensors, this can take a while... (mmap = false) get_memory_info: [warning] ext_intel_free_memory is not supported (export/set ZES_ENABLE_SYSMAN=1 to support), use total memory as free memory get_memory_info: [warning] ext_intel_free_memory is not supported (export/set ZES_ENABLE_SYSMAN=1 to support), use total memory as free memory load_tensors: offloading 64 repeating layers to GPU load_tensors: offloading output layer to GPU load_tensors: offloaded 65/65 layers to GPU load_tensors: CPU model buffer size = 417.66 MiB load_tensors: SYCL0 model buffer size = 18508.35 MiB Native API failed. Native API returns: 20 (UR_RESULT_ERROR_DEVICE_LOST) Exception caught at file:/home/runner/_work/llm.cpp/llm.cpp/ollama-llama-cpp/ggml/src/ggml-sycl/ggml-sycl.cpp, line:429, func:operator() SYCL error: CHECK_TRY_ERROR((*stream).memcpy((char *) tensor->data + offset, host_buf, size).wait()): Exception caught in this line of code. in function ggml_backend_sycl_buffer_set_tensor at /home/runner/_work/llm.cpp/llm.cpp/ollama-llama-cpp/ggml/src/ggml-sycl/ggml-sycl.cpp:429 /home/runner/_work/llm.cpp/llm.cpp/ollama-llama-cpp/ggml/src/ggml-sycl/../ggml-sycl/common.hpp:115: SYCL error /usr/local/lib/python3.11/dist-packages/bigdl/cpp/libs/ollama/ollama-lib[0x117b058] /usr/local/lib/python3.11/dist-packages/bigdl/cpp/libs/ollama/ollama-lib(ggml_abort+0x136)[0x117b3c6] /usr/local/lib/python3.11/dist-packages/bigdl/cpp/libs/ollama/libggml-sycl.so(+0x86a88)[0x7f04e2886a88] /usr/local/lib/python3.11/dist-packages/bigdl/cpp/libs/ollama/libggml-sycl.so(+0x8a7e7)[0x7f04e288a7e7] /usr/local/lib/python3.11/dist-packages/bigdl/cpp/libs/ollama/libllama.so(_ZN18llama_model_loader13load_all_dataEP12ggml_contextRSt13unordered_mapIjP19ggml_backend_bufferSt4hashIjESt8equal_toIjESaISt4pairIKjS4_EEEPSt6vectorISt10unique_ptrI11llama_mlockSt14default_deleteISH_EESaISK_EEPFbfPvESO_+0x12b5)[0x7f04e20be0c5] /usr/local/lib/python3.11/dist-packages/bigdl/cpp/libs/ollama/libllama.so(_ZN11llama_model12load_tensorsER18llama_model_loader+0x1f670)[0x7f04e20eacd0] /usr/local/lib/python3.11/dist-packages/bigdl/cpp/libs/ollama/libllama.so(+0x64164)[0x7f04e2064164] /usr/local/lib/python3.11/dist-packages/bigdl/cpp/libs/ollama/libllama.so(llama_model_load_from_file+0xec)[0x7f04e206377c] /usr/local/lib/python3.11/dist-packages/bigdl/cpp/libs/ollama/ollama-lib(_cgo_89fafab9cb6c_Cfunc_llama_model_load_from_file+0x4b)[0x1159acb] /usr/local/lib/python3.11/dist-packages/bigdl/cpp/libs/ollama/ollama-lib[0x4a1f64] SIGABRT: abort PC=0x7f04e126d9fc m=8 sigcode=18446744073709551610 signal arrived during cgo execution goroutine 50 gp=0xc000484700 m=8 mp=0xc000600008 [syscall]: runtime.cgocall(0x1159a80, 0xc000239890) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/cgocall.go:167 +0x4b fp=0xc000239868 sp=0xc000239830 pc=0x49780b github.com/ollama/ollama/llama._Cfunc_llama_model_load_from_file(0x7f0464000b70, {0x0, 0x0, 0x3e7, 0x1, 0x0, 0x0, 0x1159230, 0xc0001d5720, 0x0, ...}) _cgo_gotypes.go:876 +0x47 fp=0xc000239890 sp=0xc000239868 pc=0x846047 github.com/ollama/ollama/llama.LoadModelFromFile.func4(...) /home/runner/_work/llm.cpp/llm.cpp/ollama-internal/llama/llama.go:296 github.com/ollama/ollama/llama.LoadModelFromFile({0x7ffcee385b8d, 0x62}, {0x3e7, 0x0, 0x0, {0x0, 0x0, 0x0}, 0xc00012a650, 0x0, ...}) /home/runner/_work/llm.cpp/llm.cpp/ollama-internal/llama/llama.go:296 +0x4d7 fp=0xc000239d80 sp=0xc000239890 pc=0x848277 github.com/ollama/ollama/runner/llamarunner.(*Server).loadModel(0xc000314000, {0x3e7, 0x0, 0x0, {0x0, 0x0, 0x0}, 0xc00012a650, 0x0, {0x0, ...}}, ...) /home/runner/_work/llm.cpp/llm.cpp/ollama-internal/runner/llamarunner/runner.go:749 +0x9e fp=0xc000239ee8 sp=0xc000239d80 pc=0x90503e github.com/ollama/ollama/runner/llamarunner.Execute.gowrap1() /home/runner/_work/llm.cpp/llm.cpp/ollama-internal/runner/llamarunner/runner.go:885 +0x115 fp=0xc000239fe0 sp=0xc000239ee8 pc=0x906b15 runtime.goexit({}) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000239fe8 sp=0xc000239fe0 pc=0x4a22e1 created by github.com/ollama/ollama/runner/llamarunner.Execute in goroutine 1 /home/runner/_work/llm.cpp/llm.cpp/ollama-internal/runner/llamarunner/runner.go:885 +0xd2a goroutine 1 gp=0xc000002380 m=nil [IO wait]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc0005875b8 sp=0xc000587598 pc=0x49ac8e runtime.netpollblock(0xc000587638?, 0x433da6?, 0x0?) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/netpoll.go:575 +0xf7 fp=0xc0005875f0 sp=0xc0005875b8 pc=0x45f957 internal/poll.runtime_pollWait(0x7f04e2403de0, 0x72) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/netpoll.go:351 +0x85 fp=0xc000587610 sp=0xc0005875f0 pc=0x499ea5 internal/poll.(*pollDesc).wait(0xc000312100?, 0x442746?, 0x0) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc000587638 sp=0xc000587610 pc=0x5211c7 internal/poll.(*pollDesc).waitRead(...) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/internal/poll/fd_poll_runtime.go:89 internal/poll.(*FD).Accept(0xc000312100) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/internal/poll/fd_unix.go:620 +0x295 fp=0xc0005876e0 sp=0xc000587638 pc=0x526595 net.(*netFD).accept(0xc000312100) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/net/fd_unix.go:172 +0x29 fp=0xc000587798 sp=0xc0005876e0 pc=0x598aa9 net.(*TCPListener).accept(0xc00012f940) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/net/tcpsock_posix.go:159 +0x1b fp=0xc0005877e8 sp=0xc000587798 pc=0x5ae41b net.(*TCPListener).Accept(0xc00012f940) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/net/tcpsock.go:380 +0x30 fp=0xc000587818 sp=0xc0005877e8 pc=0x5ad2d0 net/http.(*onceCloseListener).Accept(0xc0003ca000?) <autogenerated>:1 +0x24 fp=0xc000587830 sp=0xc000587818 pc=0x7c4964 net/http.(*Server).Serve(0xc000490100, {0x15f1be8, 0xc00012f940}) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/net/http/server.go:3424 +0x30c fp=0xc000587960 sp=0xc000587830 pc=0x79c22c github.com/ollama/ollama/runner/llamarunner.Execute({0xc000132020, 0xf, 0x10}) /home/runner/_work/llm.cpp/llm.cpp/ollama-internal/runner/llamarunner/runner.go:912 +0x11e9 fp=0xc000587d08 sp=0xc000587960 pc=0x906709 github.com/ollama/ollama/runner.Execute({0xc000132010?, 0x0?, 0x0?}) /home/runner/_work/llm.cpp/llm.cpp/ollama-internal/runner/runner.go:22 +0xd4 fp=0xc000587d30 sp=0xc000587d08 pc=0x98b474 github.com/ollama/ollama/cmd.NewCLI.func2(0xc0001f9400?, {0x141a6a2?, 0x4?, 0x141a6a6?}) /home/runner/_work/llm.cpp/llm.cpp/ollama-internal/cmd/cmd.go:1529 +0x45 fp=0xc000587d58 sp=0xc000587d30 pc=0x10e7c05 github.com/spf13/cobra.(*Command).execute(0xc00001cf08, {0xc000424f00, 0xf, 0xf}) /root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:940 +0x85c fp=0xc000587e78 sp=0xc000587d58 pc=0x6120bc github.com/spf13/cobra.(*Command).ExecuteC(0xc0000dc908) /root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:1068 +0x3a5 fp=0xc000587f30 sp=0xc000587e78 pc=0x612905 github.com/spf13/cobra.(*Command).Execute(...) /root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:992 github.com/spf13/cobra.(*Command).ExecuteContext(...) /root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:985 main.main() /home/runner/_work/llm.cpp/llm.cpp/ollama-internal/main.go:12 +0x4d fp=0xc000587f50 sp=0xc000587f30 pc=0x10e868d runtime.main() /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:283 +0x28b fp=0xc000587fe0 sp=0xc000587f50 pc=0x466f6b runtime.goexit({}) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000587fe8 sp=0xc000587fe0 pc=0x4a22e1 goroutine 2 gp=0xc000002e00 m=nil [force gc (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000084fa8 sp=0xc000084f88 pc=0x49ac8e runtime.goparkunlock(...) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:441 runtime.forcegchelper() /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:348 +0xb3 fp=0xc000084fe0 sp=0xc000084fa8 pc=0x4672b3 runtime.goexit({}) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000084fe8 sp=0xc000084fe0 pc=0x4a22e1 created by runtime.init.7 in goroutine 1 /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:336 +0x1a goroutine 3 gp=0xc000003340 m=nil [GC sweep wait]: runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000085780 sp=0xc000085760 pc=0x49ac8e runtime.goparkunlock(...) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:441 runtime.bgsweep(0xc0000b0000) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgcsweep.go:316 +0xdf fp=0xc0000857c8 sp=0xc000085780 pc=0x451adf runtime.gcenable.gowrap1() /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:204 +0x25 fp=0xc0000857e0 sp=0xc0000857c8 pc=0x445f45 runtime.goexit({}) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000857e8 sp=0xc0000857e0 pc=0x4a22e1 created by runtime.gcenable in goroutine 1 /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:204 +0x66 goroutine 4 gp=0xc000003500 m=nil [GC scavenge wait]: runtime.gopark(0x10000?, 0x15df218?, 0x0?, 0x0?, 0x0?) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000085f78 sp=0xc000085f58 pc=0x49ac8e runtime.goparkunlock(...) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:441 runtime.(*scavengerState).park(0x20e2940) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgcscavenge.go:425 +0x49 fp=0xc000085fa8 sp=0xc000085f78 pc=0x44f529 runtime.bgscavenge(0xc0000b0000) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgcscavenge.go:658 +0x59 fp=0xc000085fc8 sp=0xc000085fa8 pc=0x44fab9 runtime.gcenable.gowrap2() /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:205 +0x25 fp=0xc000085fe0 sp=0xc000085fc8 pc=0x445ee5 runtime.goexit({}) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000085fe8 sp=0xc000085fe0 pc=0x4a22e1 created by runtime.gcenable in goroutine 1 /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:205 +0xa5 goroutine 18 gp=0xc000102700 m=nil [finalizer wait]: runtime.gopark(0x1b8?, 0xc000002380?, 0x1?, 0x23?, 0xc000084688?) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000084630 sp=0xc000084610 pc=0x49ac8e runtime.runfinq() /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mfinal.go:196 +0x107 fp=0xc0000847e0 sp=0xc000084630 pc=0x444f07 runtime.goexit({}) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000847e8 sp=0xc0000847e0 pc=0x4a22e1 created by runtime.createfing in goroutine 1 /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mfinal.go:166 +0x3d goroutine 19 gp=0xc000103180 m=nil [chan receive]: runtime.gopark(0xc00017b9a0?, 0xc000492018?, 0x60?, 0x7?, 0x57f7e8?) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000080718 sp=0xc0000806f8 pc=0x49ac8e runtime.chanrecv(0xc000110310, 0x0, 0x1) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/chan.go:664 +0x445 fp=0xc000080790 sp=0xc000080718 pc=0x436925 runtime.chanrecv1(0x0?, 0x0?) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/chan.go:506 +0x12 fp=0xc0000807b8 sp=0xc000080790 pc=0x4364b2 runtime.unique_runtime_registerUniqueMapCleanup.func2(...) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1796 runtime.unique_runtime_registerUniqueMapCleanup.gowrap1() /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1799 +0x2f fp=0xc0000807e0 sp=0xc0000807b8 pc=0x44908f runtime.goexit({}) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000807e8 sp=0xc0000807e0 pc=0x4a22e1 created by unique.runtime_registerUniqueMapCleanup in goroutine 1 /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1794 +0x79 goroutine 20 gp=0xc000103500 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000080f38 sp=0xc000080f18 pc=0x49ac8e runtime.gcBgMarkWorker(0xc000111730) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000080fc8 sp=0xc000080f38 pc=0x4483a9 runtime.gcBgMarkStartWorkers.gowrap1() /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x25 fp=0xc000080fe0 sp=0xc000080fc8 pc=0x448285 runtime.goexit({}) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000080fe8 sp=0xc000080fe0 pc=0x4a22e1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x105 goroutine 34 gp=0xc000484000 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc00048a738 sp=0xc00048a718 pc=0x49ac8e runtime.gcBgMarkWorker(0xc000111730) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1423 +0xe9 fp=0xc00048a7c8 sp=0xc00048a738 pc=0x4483a9 runtime.gcBgMarkStartWorkers.gowrap1() /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x25 fp=0xc00048a7e0 sp=0xc00048a7c8 pc=0x448285 runtime.goexit({}) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00048a7e8 sp=0xc00048a7e0 pc=0x4a22e1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x105 goroutine 5 gp=0xc000003a40 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000086738 sp=0xc000086718 pc=0x49ac8e runtime.gcBgMarkWorker(0xc000111730) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1423 +0xe9 fp=0xc0000867c8 sp=0xc000086738 pc=0x4483a9 runtime.gcBgMarkStartWorkers.gowrap1() /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x25 fp=0xc0000867e0 sp=0xc0000867c8 pc=0x448285 runtime.goexit({}) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000867e8 sp=0xc0000867e0 pc=0x4a22e1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x105 goroutine 21 gp=0xc0001036c0 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000081738 sp=0xc000081718 pc=0x49ac8e runtime.gcBgMarkWorker(0xc000111730) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1423 +0xe9 fp=0xc0000817c8 sp=0xc000081738 pc=0x4483a9 runtime.gcBgMarkStartWorkers.gowrap1() /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x25 fp=0xc0000817e0 sp=0xc0000817c8 pc=0x448285 runtime.goexit({}) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000817e8 sp=0xc0000817e0 pc=0x4a22e1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x105 goroutine 35 gp=0xc0004841c0 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc00048af38 sp=0xc00048af18 pc=0x49ac8e runtime.gcBgMarkWorker(0xc000111730) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1423 +0xe9 fp=0xc00048afc8 sp=0xc00048af38 pc=0x4483a9 runtime.gcBgMarkStartWorkers.gowrap1() /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x25 fp=0xc00048afe0 sp=0xc00048afc8 pc=0x448285 runtime.goexit({}) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00048afe8 sp=0xc00048afe0 pc=0x4a22e1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x105 goroutine 6 gp=0xc000003c00 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000086f38 sp=0xc000086f18 pc=0x49ac8e runtime.gcBgMarkWorker(0xc000111730) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000086fc8 sp=0xc000086f38 pc=0x4483a9 runtime.gcBgMarkStartWorkers.gowrap1() /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x25 fp=0xc000086fe0 sp=0xc000086fc8 pc=0x448285 runtime.goexit({}) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000086fe8 sp=0xc000086fe0 pc=0x4a22e1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x105 goroutine 22 gp=0xc000103880 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000081f38 sp=0xc000081f18 pc=0x49ac8e runtime.gcBgMarkWorker(0xc000111730) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000081fc8 sp=0xc000081f38 pc=0x4483a9 runtime.gcBgMarkStartWorkers.gowrap1() /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x25 fp=0xc000081fe0 sp=0xc000081fc8 pc=0x448285 runtime.goexit({}) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000081fe8 sp=0xc000081fe0 pc=0x4a22e1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x105 goroutine 36 gp=0xc000484380 m=nil [GC worker (idle)]: runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc00048b738 sp=0xc00048b718 pc=0x49ac8e runtime.gcBgMarkWorker(0xc000111730) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1423 +0xe9 fp=0xc00048b7c8 sp=0xc00048b738 pc=0x4483a9 runtime.gcBgMarkStartWorkers.gowrap1() /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x25 fp=0xc00048b7e0 sp=0xc00048b7c8 pc=0x448285 runtime.goexit({}) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00048b7e8 sp=0xc00048b7e0 pc=0x4a22e1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x105 goroutine 7 gp=0xc000003dc0 m=nil [GC worker (idle)]: runtime.gopark(0x2190920?, 0x3?, 0x3e?, 0x9f?, 0x0?) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000087738 sp=0xc000087718 pc=0x49ac8e runtime.gcBgMarkWorker(0xc000111730) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1423 +0xe9 fp=0xc0000877c8 sp=0xc000087738 pc=0x4483a9 runtime.gcBgMarkStartWorkers.gowrap1() /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x25 fp=0xc0000877e0 sp=0xc0000877c8 pc=0x448285 runtime.goexit({}) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000877e8 sp=0xc0000877e0 pc=0x4a22e1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x105 goroutine 37 gp=0xc000484540 m=nil [GC worker (idle)]: runtime.gopark(0x3b4b1b3f17?, 0x0?, 0x0?, 0x0?, 0x0?) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc00048bf38 sp=0xc00048bf18 pc=0x49ac8e runtime.gcBgMarkWorker(0xc000111730) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1423 +0xe9 fp=0xc00048bfc8 sp=0xc00048bf38 pc=0x4483a9 runtime.gcBgMarkStartWorkers.gowrap1() /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x25 fp=0xc00048bfe0 sp=0xc00048bfc8 pc=0x448285 runtime.goexit({}) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00048bfe8 sp=0xc00048bfe0 pc=0x4a22e1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x105 goroutine 23 gp=0xc000103dc0 m=nil [GC worker (idle)]: runtime.gopark(0x3b4b1b351d?, 0x0?, 0x0?, 0x0?, 0x0?) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000082738 sp=0xc000082718 pc=0x49ac8e runtime.gcBgMarkWorker(0xc000111730) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1423 +0xe9 fp=0xc0000827c8 sp=0xc000082738 pc=0x4483a9 runtime.gcBgMarkStartWorkers.gowrap1() /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x25 fp=0xc0000827e0 sp=0xc0000827c8 pc=0x448285 runtime.goexit({}) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000827e8 sp=0xc0000827e0 pc=0x4a22e1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x105 goroutine 24 gp=0xc00047e000 m=nil [GC worker (idle)]: runtime.gopark(0x3b4b1b7f0a?, 0x1?, 0xd4?, 0xc5?, 0x0?) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000082f38 sp=0xc000082f18 pc=0x49ac8e runtime.gcBgMarkWorker(0xc000111730) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000082fc8 sp=0xc000082f38 pc=0x4483a9 runtime.gcBgMarkStartWorkers.gowrap1() /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x25 fp=0xc000082fe0 sp=0xc000082fc8 pc=0x448285 runtime.goexit({}) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000082fe8 sp=0xc000082fe0 pc=0x4a22e1 created by runtime.gcBgMarkStartWorkers in goroutine 1 /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x105 goroutine 51 gp=0xc0004848c0 m=nil [sync.WaitGroup.Wait]: runtime.gopark(0x0?, 0x0?, 0x60?, 0x0?, 0x0?) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc00048c620 sp=0xc00048c600 pc=0x49ac8e runtime.goparkunlock(...) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:441 runtime.semacquire1(0xc000314008, 0x0, 0x1, 0x0, 0x18) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/sema.go:188 +0x21d fp=0xc00048c688 sp=0xc00048c620 pc=0x47a47d sync.runtime_SemacquireWaitGroup(0x0?) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/sema.go:110 +0x25 fp=0xc00048c6c0 sp=0xc00048c688 pc=0x49c685 sync.(*WaitGroup).Wait(0x0?) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/sync/waitgroup.go:118 +0x48 fp=0xc00048c6e8 sp=0xc00048c6c0 pc=0x4adc28 github.com/ollama/ollama/runner/llamarunner.(*Server).run(0xc000314000, {0x15f4210, 0xc000176eb0}) /home/runner/_work/llm.cpp/llm.cpp/ollama-internal/runner/llamarunner/runner.go:314 +0x47 fp=0xc00048c7b8 sp=0xc00048c6e8 pc=0x901d67 github.com/ollama/ollama/runner/llamarunner.Execute.gowrap2() /home/runner/_work/llm.cpp/llm.cpp/ollama-internal/runner/llamarunner/runner.go:892 +0x28 fp=0xc00048c7e0 sp=0xc00048c7b8 pc=0x9069c8 runtime.goexit({}) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00048c7e8 sp=0xc00048c7e0 pc=0x4a22e1 created by github.com/ollama/ollama/runner/llamarunner.Execute in goroutine 1 /home/runner/_work/llm.cpp/llm.cpp/ollama-internal/runner/llamarunner/runner.go:892 +0xe05 goroutine 38 gp=0xc000602380 m=nil [IO wait]: runtime.gopark(0x5247c5?, 0xc0003a4000?, 0x40?, 0x5a?, 0xb?) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000235948 sp=0xc000235928 pc=0x49ac8e runtime.netpollblock(0x4bdef8?, 0x433da6?, 0x0?) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/netpoll.go:575 +0xf7 fp=0xc000235980 sp=0xc000235948 pc=0x45f957 internal/poll.runtime_pollWait(0x7f04e2403cc8, 0x72) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/netpoll.go:351 +0x85 fp=0xc0002359a0 sp=0xc000235980 pc=0x499ea5 internal/poll.(*pollDesc).wait(0xc0003a4000?, 0xc0003d2000?, 0x0) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc0002359c8 sp=0xc0002359a0 pc=0x5211c7 internal/poll.(*pollDesc).waitRead(...) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/internal/poll/fd_poll_runtime.go:89 internal/poll.(*FD).Read(0xc0003a4000, {0xc0003d2000, 0x1000, 0x1000}) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/internal/poll/fd_unix.go:165 +0x27a fp=0xc000235a60 sp=0xc0002359c8 pc=0x5224ba net.(*netFD).Read(0xc0003a4000, {0xc0003d2000?, 0xc000235ad0?, 0x521685?}) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/net/fd_posix.go:55 +0x25 fp=0xc000235aa8 sp=0xc000235a60 pc=0x596b05 net.(*conn).Read(0xc0003c8000, {0xc0003d2000?, 0x0?, 0x0?}) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/net/net.go:194 +0x45 fp=0xc000235af0 sp=0xc000235aa8 pc=0x5a4ea5 net/http.(*connReader).Read(0xc0003ae0c0, {0xc0003d2000, 0x1000, 0x1000}) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/net/http/server.go:798 +0x159 fp=0xc000235b40 sp=0xc000235af0 pc=0x7910d9 bufio.(*Reader).fill(0xc0006100c0) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/bufio/bufio.go:113 +0x103 fp=0xc000235b78 sp=0xc000235b40 pc=0x5bc623 bufio.(*Reader).Peek(0xc0006100c0, 0x4) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/bufio/bufio.go:152 +0x53 fp=0xc000235b98 sp=0xc000235b78 pc=0x5bc753 net/http.(*conn).serve(0xc0003ca000, {0x15f41d8, 0xc0002ee420}) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/net/http/server.go:2137 +0x785 fp=0xc000235fb8 sp=0xc000235b98 pc=0x796ec5 net/http.(*Server).Serve.gowrap3() /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/net/http/server.go:3454 +0x28 fp=0xc000235fe0 sp=0xc000235fb8 pc=0x79c628 runtime.goexit({}) /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000235fe8 sp=0xc000235fe0 pc=0x4a22e1 created by net/http.(*Server).Serve in goroutine 1 /root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/net/http/server.go:3454 +0x485 rax 0x0 rbx 0x7f047d7fa640 rcx 0x7f04e126d9fc rdx 0x6 rdi 0x2b rsi 0x33 rbp 0x33 rsp 0x7f047d7f8540 r8 0x7f047d7f8610 r9 0x1 r10 0x8 r11 0x246 r12 0x6 r13 0x16 r14 0x7f04e2a68474 r15 0x7f04e2a6971d rip 0x7f04e126d9fc rflags 0x246 cs 0x33 fs 0x0 gs 0x0 time=2026-03-01T04:15:28.389+08:00 level=ERROR source=server.go:484 msg="llama runner terminated" error="exit status 2" time=2026-03-01T04:15:28.448+08:00 level=ERROR source=sched.go:489 msg="error loading llama server" error="llama runner process has terminated: error:CHECK_TRY_ERROR((*stream).memcpy((char *) tensor->data + offset, host_buf, size).wait()): Exception caught in this line of code.\n in function ggml_backend_sycl_buffer_set_tensor at /home/runner/_work/llm.cpp/llm.cpp/ollama-llama-cpp/ggml/src/ggml-sycl/ggml-sycl.cpp:429" ``` ### OS Docker ### GPU Intel ### CPU AMD ### Ollama version 0.9.3
GiteaMirror added the bug label 2026-04-12 22:20:46 -05:00
GiteaMirror commented 2026-04-12 22:20:47 -05:00
Author
Owner
Copy Link

@rick-github commented on GitHub (Mar 1, 2026):

The ipex-llm issue tracker is here. If you would like to try using Arc B580 with ollama, try using the Vulkan backend.

<!-- gh-comment-id:3978673845 --> @rick-github commented on GitHub (Mar 1, 2026): The ipex-llm issue tracker is [here](https://github.com/intel/ipex-llm/issues). If you would like to try using Arc B580 with ollama, try using the [Vulkan backend](https://docs.ollama.com/gpu#vulkan-gpu-support).
GiteaMirror commented 2026-04-12 22:20:49 -05:00
Author
Owner
Copy Link

@eppesuig commented on GitHub (Mar 1, 2026):

Thank you very much: it is quite difficult to start understanding all the components required for using an AI. I noticed that ipex-llm project has been closed, so I will try find information on the usage of the vulkan backed.

<!-- gh-comment-id:3980020324 --> @eppesuig commented on GitHub (Mar 1, 2026): Thank you very much: it is quite difficult to start understanding all the components required for using an AI. I noticed that ipex-llm project has been closed, so I will try find information on the usage of the vulkan backed.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
 python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
No Label bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#9420
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?