[GH-ISSUE #8033] nvcc compilation problem -- error: user-defined literal operator not found #5138

New Issue

GiteaMirror · 2026-04-12T16:14:26-05:00

GiteaMirror commented

2026-04-12 16:14:26 -05:00

Originally created by @envolution on GitHub (Dec 10, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/8033

Originally assigned to: @dhiltgen on GitHub.

What is the issue?

Compilation fails during 'make cuda_v12'

Environment

$ /opt/cuda/bin/nvcc  --version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2024 NVIDIA Corporation
Built on Tue_Oct_29_23:50:19_PDT_2024
Cuda compilation tools, release 12.6, V12.6.85
Build cuda_12.6.r12.6/compiler.35059454_0

$ gcc --version
gcc (GCC) 14.2.1 20240910

+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 565.77                 Driver Version: 565.77         CUDA Version: 12.7     |
|-----------------------------------------+------------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
|                                         |                        |               MIG M. |
|=========================================+========================+======================|
|   0  NVIDIA GeForce GTX 980         Off |   00000000:01:00.0 Off |                  N/A |
| 29%   31C    P8             13W /  180W |       2MiB /   4096MiB |      0%      Default |
|                                         |                        |                  N/A |
+-----------------------------------------+------------------------+----------------------+
                                                                                         
+-----------------------------------------------------------------------------------------+
| Processes:                                                                              |
|  GPU   GI   CI        PID   Type   Process name                              GPU Memory |
|        ID   ID                                                               Usage      |
|=========================================================================================|
|  No running processes found                                                             |
+-----------------------------------------------------------------------------------------+

Log

$ make cuda_v12 CUDA_12_PATH=/opt/cuda

/usr/bin/ccache /opt/cuda/bin/nvcc -c -Xcompiler -fPIC -D_GNU_SOURCE -fPIC -Wno-unused-function -std=c++11 -Xcompiler "-mavx" -t2 -DGGML_CUDA_DMMV_X=32 -DGGML_CUDA_MMV_Y=1 -DGGML_CUDA_PEER_MAX_BATCH_SIZE=128 -DGGML_USE_CUDA=1 -DGGML_SHARED=1 -DGGML_BUILD=1 -DGGML_USE_LLAMAFILE -DK_QUANTS_PER_ITERATION=2 -DNDEBUG -D_GNU_SOURCE -D_XOPEN_SOURCE=600 -Wno-deprecated-gpu-targets --forward-unknown-to-host-compiler -use_fast_math -I./llama/ -O3 --generate-code=arch=compute_60,code=[compute_60,sm_60] --generate-code=arch=compute_61,code=[compute_61,sm_61] --generate-code=arch=compute_62,code=[compute_62,sm_62] --generate-code=arch=compute_70,code=[compute_70,sm_70] --generate-code=arch=compute_72,code=[compute_72,sm_72] --generate-code=arch=compute_75,code=[compute_75,sm_75] --generate-code=arch=compute_80,code=[compute_80,sm_80] --generate-code=arch=compute_86,code=[compute_86,sm_86] --generate-code=arch=compute_87,code=[compute_87,sm_87] --generate-code=arch=compute_89,code=[compute_89,sm_89] --generate-code=arch=compute_90,code=[compute_90,sm_90] --generate-code=arch=compute_90a,code=[compute_90a,sm_90a] -DGGML_CUDA_USE_GRAPHS=1 -o llama/build/linux-amd64/llama/ggml-cuda.cuda_v12.o llama/ggml-cuda.cu
/usr/include/c++/14.2.1/x86_64-pc-linux-gnu/bits/c++config.h(827): error: user-defined literal operator not found
typedef __decltype(0.0bf16) __bfloat16_t;
^

/usr/include/c++/14.2.1/type_traits(529): error: type name is not allowed
: public __bool_constant<__is_array(_Tp)>
^

/usr/include/c++/14.2.1/type_traits(529): error: identifier "__is_array" is undefined
: public __bool_constant<__is_array(_Tp)>
^

/usr/include/c++/14.2.1/type_traits(581): error: type name is not allowed
: public __bool_constant<__is_member_object_pointer(_Tp)>
^

/usr/include/c++/14.2.1/type_traits(581): error: identifier "__is_member_object_pointer" is undefined
: public __bool_constant<__is_member_object_pointer(_Tp)>
^

/usr/include/c++/14.2.1/type_traits(603): error: type name is not allowed
: public __bool_constant<__is_member_function_pointer(_Tp)>
^

/usr/include/c++/14.2.1/type_traits(603): error: identifier "__is_member_function_pointer" is undefined
: public __bool_constant<__is_member_function_pointer(_Tp)>
^

/usr/include/c++/14.2.1/type_traits(695): error: type name is not allowed
: public __bool_constant<__is_reference(_Tp)>
^

/usr/include/c++/14.2.1/type_traits(695): error: identifier "__is_reference" is undefined
: public __bool_constant<__is_reference(_Tp)>
^

/usr/include/c++/14.2.1/type_traits(731): error: type name is not allowed
: public __bool_constant<__is_object(_Tp)>
^

/usr/include/c++/14.2.1/type_traits(731): error: identifier "__is_object" is undefined
: public __bool_constant<__is_object(_Tp)>
^

/usr/include/c++/14.2.1/type_traits(760): error: type name is not allowed
: public __bool_constant<__is_member_pointer(_Tp)>
^

/usr/include/c++/14.2.1/type_traits(760): error: identifier "__is_member_pointer" is undefined
: public __bool_constant<__is_member_pointer(_Tp)>
^

/usr/include/c++/14.2.1/bits/utility.h(237): error: __type_pack_element is not a template
{ using type = __type_pack_element<_Np, _Types...>; };
^

/usr/include/c++/14.2.1/type_traits(138): error: class "std::enable_if<, void>" has no member "type"
using __enable_if_t = typename enable_if<_Cond, _Tp>::type;
^
detected during:
instantiation of type "std::__enable_if_t<, void>" at line 176
instantiation of "std::__detail::__or_fn" based on template arguments <std::is_reference<std::allocator>, std::is_function<std::allocator>, std::is_void<std::allocator>, std::__is_array_unknown_bounds<std::allocator>> at line 194
instantiation of class "std::_or<_Bn...> [with _Bn=<std::is_reference<std::allocator>, std::is_function<std::allocator>, std::is_void<std::allocator>, std::__is_array_unknown_bounds<std::allocator>>]" at line 1195
instantiation of class "std::is_nothrow_default_constructible<_Tp> [with _Tp=std::allocator]" at line 528 of /usr/include/c++/14.2.1/bits/basic_string.h
instantiation of "std::__cxx11::basic_string<_CharT, _Traits, _Alloc>::basic_string() [with _CharT=char, _Traits=std::char_traits, _Alloc=std::allocator]" at line 4248 of /usr/include/c++/14.2.1/bits/basic_string.h

15 errors detected in the compilation of "llama/ggml-cuda.cu".
make[1]: *** [make/gpu.make:54: llama/build/linux-amd64/llama/ggml-cuda.cuda_v12.o] Error 255
make: *** [Makefile:50: cuda_v12] Error 2

OS

Linux

GPU

Nvidia

CPU

Intel

Ollama version

git clone

Originally created by @envolution on GitHub (Dec 10, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/8033 Originally assigned to: @dhiltgen on GitHub. ### What is the issue? Compilation fails during 'make cuda_v12' ### Environment ``` $ /opt/cuda/bin/nvcc --version nvcc: NVIDIA (R) Cuda compiler driver Copyright (c) 2005-2024 NVIDIA Corporation Built on Tue_Oct_29_23:50:19_PDT_2024 Cuda compilation tools, release 12.6, V12.6.85 Build cuda_12.6.r12.6/compiler.35059454_0 $ gcc --version gcc (GCC) 14.2.1 20240910 +-----------------------------------------------------------------------------------------+ | NVIDIA-SMI 565.77 Driver Version: 565.77 CUDA Version: 12.7 | |-----------------------------------------+------------------------+----------------------+ | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | | | | MIG M. | |=========================================+========================+======================| | 0 NVIDIA GeForce GTX 980 Off | 00000000:01:00.0 Off | N/A | | 29% 31C P8 13W / 180W | 2MiB / 4096MiB | 0% Default | | | | N/A | +-----------------------------------------+------------------------+----------------------+ +-----------------------------------------------------------------------------------------+ | Processes: | | GPU GI CI PID Type Process name GPU Memory | | ID ID Usage | |=========================================================================================| | No running processes found | +-----------------------------------------------------------------------------------------+ ``` # Log $ make cuda_v12 CUDA_12_PATH=/opt/cuda /usr/bin/ccache /opt/cuda/bin/nvcc -c -Xcompiler -fPIC -D_GNU_SOURCE -fPIC -Wno-unused-function -std=c++11 -Xcompiler "-mavx" -t2 -DGGML_CUDA_DMMV_X=32 -DGGML_CUDA_MMV_Y=1 -DGGML_CUDA_PEER_MAX_BATCH_SIZE=128 -DGGML_USE_CUDA=1 -DGGML_SHARED=1 -DGGML_BUILD=1 -DGGML_USE_LLAMAFILE -DK_QUANTS_PER_ITERATION=2 -DNDEBUG -D_GNU_SOURCE -D_XOPEN_SOURCE=600 -Wno-deprecated-gpu-targets --forward-unknown-to-host-compiler -use_fast_math -I./llama/ -O3 --generate-code=arch=compute_60,code=[compute_60,sm_60] --generate-code=arch=compute_61,code=[compute_61,sm_61] --generate-code=arch=compute_62,code=[compute_62,sm_62] --generate-code=arch=compute_70,code=[compute_70,sm_70] --generate-code=arch=compute_72,code=[compute_72,sm_72] --generate-code=arch=compute_75,code=[compute_75,sm_75] --generate-code=arch=compute_80,code=[compute_80,sm_80] --generate-code=arch=compute_86,code=[compute_86,sm_86] --generate-code=arch=compute_87,code=[compute_87,sm_87] --generate-code=arch=compute_89,code=[compute_89,sm_89] --generate-code=arch=compute_90,code=[compute_90,sm_90] --generate-code=arch=compute_90a,code=[compute_90a,sm_90a] -DGGML_CUDA_USE_GRAPHS=1 -o llama/build/linux-amd64/llama/ggml-cuda.cuda_v12.o llama/ggml-cuda.cu /usr/include/c++/14.2.1/x86_64-pc-linux-gnu/bits/c++config.h(827): error: user-defined literal operator not found typedef __decltype(0.0bf16) __bfloat16_t; ^ /usr/include/c++/14.2.1/type_traits(529): error: type name is not allowed : public __bool_constant<__is_array(_Tp)> ^ /usr/include/c++/14.2.1/type_traits(529): error: identifier "__is_array" is undefined : public __bool_constant<__is_array(_Tp)> ^ /usr/include/c++/14.2.1/type_traits(581): error: type name is not allowed : public __bool_constant<__is_member_object_pointer(_Tp)> ^ /usr/include/c++/14.2.1/type_traits(581): error: identifier "__is_member_object_pointer" is undefined : public __bool_constant<__is_member_object_pointer(_Tp)> ^ /usr/include/c++/14.2.1/type_traits(603): error: type name is not allowed : public __bool_constant<__is_member_function_pointer(_Tp)> ^ /usr/include/c++/14.2.1/type_traits(603): error: identifier "__is_member_function_pointer" is undefined : public __bool_constant<__is_member_function_pointer(_Tp)> ^ /usr/include/c++/14.2.1/type_traits(695): error: type name is not allowed : public __bool_constant<__is_reference(_Tp)> ^ /usr/include/c++/14.2.1/type_traits(695): error: identifier "__is_reference" is undefined : public __bool_constant<__is_reference(_Tp)> ^ /usr/include/c++/14.2.1/type_traits(731): error: type name is not allowed : public __bool_constant<__is_object(_Tp)> ^ /usr/include/c++/14.2.1/type_traits(731): error: identifier "__is_object" is undefined : public __bool_constant<__is_object(_Tp)> ^ /usr/include/c++/14.2.1/type_traits(760): error: type name is not allowed : public __bool_constant<__is_member_pointer(_Tp)> ^ /usr/include/c++/14.2.1/type_traits(760): error: identifier "__is_member_pointer" is undefined : public __bool_constant<__is_member_pointer(_Tp)> ^ /usr/include/c++/14.2.1/bits/utility.h(237): error: __type_pack_element is not a template { using type = __type_pack_element<_Np, _Types...>; }; ^ /usr/include/c++/14.2.1/type_traits(138): error: class "std::enable_if<<error-constant>, void>" has no member "type" using __enable_if_t = typename enable_if<_Cond, _Tp>::type; ^ detected during: instantiation of type "std::__enable_if_t<<error-constant>, void>" at line 176 instantiation of "std::__detail::__or_fn" based on template arguments <std::is_reference<std::allocator<char>>, std::is_function<std::allocator<char>>, std::is_void<std::allocator<char>>, std::__is_array_unknown_bounds<std::allocator<char>>> at line 194 instantiation of class "std::__or_<_Bn...> [with _Bn=<std::is_reference<std::allocator<char>>, std::is_function<std::allocator<char>>, std::is_void<std::allocator<char>>, std::__is_array_unknown_bounds<std::allocator<char>>>]" at line 1195 instantiation of class "std::is_nothrow_default_constructible<_Tp> [with _Tp=std::allocator<char>]" at line 528 of /usr/include/c++/14.2.1/bits/basic_string.h instantiation of "std::__cxx11::basic_string<_CharT, _Traits, _Alloc>::basic_string() [with _CharT=char, _Traits=std::char_traits<char>, _Alloc=std::allocator<char>]" at line 4248 of /usr/include/c++/14.2.1/bits/basic_string.h 15 errors detected in the compilation of "llama/ggml-cuda.cu". make[1]: *** [make/gpu.make:54: llama/build/linux-amd64/llama/ggml-cuda.cuda_v12.o] Error 255 make: *** [Makefile:50: cuda_v12] Error 2 ### OS Linux ### GPU Nvidia ### CPU Intel ### Ollama version git clone

GiteaMirror added the build bug labels 2026-04-12 16:14:26 -05:00

GiteaMirror closed this issue

2026-04-12 16:14:27 -05:00

GiteaMirror commented

2026-04-12 16:14:28 -05:00

@dhiltgen commented on GitHub (Dec 11, 2024):

My suspicion is the -std=c++11 on this line is probably the root cause. The pending llama.cpp bump moves things around a bit, so if that doesn't resolve the glitch, I'll follow up with another PR to tidy this up.

@dhiltgen commented on GitHub (Dec 11, 2024): My suspicion is the `-std=c++11` on [this line](https://github.com/ollama/ollama/blob/main/make/cuda.make#L26) is probably the root cause. The pending [llama.cpp bump](https://github.com/ollama/ollama/pull/7875) moves things around a bit, so if that doesn't resolve the glitch, I'll follow up with another PR to tidy this up.

GiteaMirror commented

2026-04-12 16:14:29 -05:00

@envolution commented on GitHub (Dec 11, 2024):

I tried without (shown below) -std=c++11 and with 14,17,20,23 alternatively without luck passing the "error: user-defined literal operator not found"

$ make cuda_v12 CUDA_12_PATH=/opt/cuda
/usr/bin/ccache /opt/cuda/bin/nvcc -c  -Xcompiler -fPIC -D_GNU_SOURCE -fPIC -Wno-unused-function -Xcompiler "-mavx" -t2 -DGGML_CUDA_DMMV_X=32 -DGGML_CUDA_MMV_Y=1 -DGGML_CUDA_PEER_MAX_BATCH_SIZE=128 -DGGML_USE_CUDA=1 -DGGML_SHARED=1 -DGGML_BUILD=1 -DGGML_USE_LLAMAFILE -DK_QUANTS_PER_ITERATION=2 -DNDEBUG -D_GNU_SOURCE -D_XOPEN_SOURCE=600 -Wno-deprecated-gpu-targets --forward-unknown-to-host-compiler -use_fast_math -I./llama/ -O3 --generate-code=arch=compute_60,code=[compute_60,sm_60] --generate-code=arch=compute_61,code=[compute_61,sm_61] --generate-code=arch=compute_62,code=[compute_62,sm_62] --generate-code=arch=compute_70,code=[compute_70,sm_70] --generate-code=arch=compute_72,code=[compute_72,sm_72] --generate-code=arch=compute_75,code=[compute_75,sm_75] --generate-code=arch=compute_80,code=[compute_80,sm_80] --generate-code=arch=compute_86,code=[compute_86,sm_86] --generate-code=arch=compute_87,code=[compute_87,sm_87] --generate-code=arch=compute_89,code=[compute_89,sm_89] --generate-code=arch=compute_90,code=[compute_90,sm_90] --generate-code=arch=compute_90a,code=[compute_90a,sm_90a] -DGGML_CUDA_USE_GRAPHS=1 -o llama/build/linux-amd64/llama/ggml-cuda.cuda_v12.o llama/ggml-cuda.cu
/usr/include/c++/14.2.1/x86_64-pc-linux-gnu/bits/c++config.h(827): error: user-defined literal operator not found
    typedef __decltype(0.0bf16) __bfloat16_t;
                       ^
...

@envolution commented on GitHub (Dec 11, 2024): I tried without (shown below) -std=c++11 and with 14,17,20,23 alternatively without luck passing the "error: user-defined literal operator not found" ``` $ make cuda_v12 CUDA_12_PATH=/opt/cuda /usr/bin/ccache /opt/cuda/bin/nvcc -c -Xcompiler -fPIC -D_GNU_SOURCE -fPIC -Wno-unused-function -Xcompiler "-mavx" -t2 -DGGML_CUDA_DMMV_X=32 -DGGML_CUDA_MMV_Y=1 -DGGML_CUDA_PEER_MAX_BATCH_SIZE=128 -DGGML_USE_CUDA=1 -DGGML_SHARED=1 -DGGML_BUILD=1 -DGGML_USE_LLAMAFILE -DK_QUANTS_PER_ITERATION=2 -DNDEBUG -D_GNU_SOURCE -D_XOPEN_SOURCE=600 -Wno-deprecated-gpu-targets --forward-unknown-to-host-compiler -use_fast_math -I./llama/ -O3 --generate-code=arch=compute_60,code=[compute_60,sm_60] --generate-code=arch=compute_61,code=[compute_61,sm_61] --generate-code=arch=compute_62,code=[compute_62,sm_62] --generate-code=arch=compute_70,code=[compute_70,sm_70] --generate-code=arch=compute_72,code=[compute_72,sm_72] --generate-code=arch=compute_75,code=[compute_75,sm_75] --generate-code=arch=compute_80,code=[compute_80,sm_80] --generate-code=arch=compute_86,code=[compute_86,sm_86] --generate-code=arch=compute_87,code=[compute_87,sm_87] --generate-code=arch=compute_89,code=[compute_89,sm_89] --generate-code=arch=compute_90,code=[compute_90,sm_90] --generate-code=arch=compute_90a,code=[compute_90a,sm_90a] -DGGML_CUDA_USE_GRAPHS=1 -o llama/build/linux-amd64/llama/ggml-cuda.cuda_v12.o llama/ggml-cuda.cu /usr/include/c++/14.2.1/x86_64-pc-linux-gnu/bits/c++config.h(827): error: user-defined literal operator not found typedef __decltype(0.0bf16) __bfloat16_t; ^ ... ```

GiteaMirror commented

2026-04-12 16:14:29 -05:00

@dhiltgen commented on GitHub (Dec 11, 2024):

@envolution can you confirm you've pulled the latest commit after the llama.cpp bump?

@dhiltgen commented on GitHub (Dec 11, 2024): @envolution can you confirm you've pulled the latest commit after the llama.cpp bump?

GiteaMirror commented

2026-04-12 16:14:30 -05:00

@envolution commented on GitHub (Dec 11, 2024):

I can confirm that my posts are always within a few minutes of a fresh clone:

sh-5.2$ date
Wed 11 Dec 2024 11:49:51 AM EST
sh-5.2$ git clone https://github.com/ollama/ollama.git
Cloning into 'ollama'...
remote: Enumerating objects: 27841, done.
remote: Counting objects: 100% (157/157), done.
remote: Compressing objects: 100% (126/126), done.
remote: Total 27841 (delta 54), reused 98 (delta 29), pack-reused 27684 (from 1)
Receiving objects: 100% (27841/27841), 27.37 MiB | 30.90 MiB/s, done.
Resolving deltas: 100% (17948/17948), done.
sh-5.2$ cd ollama/
sh-5.2$ make cuda_v12 CUDA_12_PATH=/opt/cuda
/usr/bin/ccache /opt/cuda/bin/nvcc -c  -Xcompiler -fPIC -D_GNU_SOURCE -fPIC -Wno-unused-function -std=c++11 -Xcompiler "-mavx" -t2 -DGGML_CUDA_DMMV_X=32 -DGGML_CUDA_MMV_Y=1 -DGGML_CUDA_PEER_MAX_BATCH_SIZE=128 -DGGML_USE_CUDA=1 -DGGML_SHARED=1 -DGGML_BACKEND_SHARED=1 -DGGML_BUILD=1 -DGGML_BACKEND_BUILD=1 -DGGML_USE_LLAMAFILE -DK_QUANTS_PER_ITERATION=2 -DNDEBUG -D_GNU_SOURCE -D_XOPEN_SOURCE=600 -Wno-deprecated-gpu-targets --forward-unknown-to-host-compiler -use_fast_math -I./llama/ -O3 --generate-code=arch=compute_60,code=[compute_60,sm_60] --generate-code=arch=compute_61,code=[compute_61,sm_61] --generate-code=arch=compute_62,code=[compute_62,sm_62] --generate-code=arch=compute_70,code=[compute_70,sm_70] --generate-code=arch=compute_72,code=[compute_72,sm_72] --generate-code=arch=compute_75,code=[compute_75,sm_75] --generate-code=arch=compute_80,code=[compute_80,sm_80] --generate-code=arch=compute_86,code=[compute_86,sm_86] --generate-code=arch=compute_87,code=[compute_87,sm_87] --generate-code=arch=compute_89,code=[compute_89,sm_89] --generate-code=arch=compute_90,code=[compute_90,sm_90] --generate-code=arch=compute_90a,code=[compute_90a,sm_90a] -DGGML_CUDA_USE_GRAPHS=1 -o llama/build/linux-amd64/llama/ggml-cuda/acc.cuda_v12.o llama/ggml-cuda/acc.cu
/usr/include/c++/14.2.1/x86_64-pc-linux-gnu/bits/c++config.h(827): error: user-defined literal operator not found
    typedef __decltype(0.0bf16) __bfloat16_t;
                       ^

/usr/include/c++/14.2.1/type_traits(529): error: type name is not allowed
      : public __bool_constant<__is_array(_Tp)>
                                          ^

/usr/include/c++/14.2.1/type_traits(529): error: identifier "__is_array" is undefined
      : public __bool_constant<__is_array(_Tp)>
                               ^

/usr/include/c++/14.2.1/type_traits(581): error: type name is not allowed
      : public __bool_constant<__is_member_object_pointer(_Tp)>
                                                          ^

/usr/include/c++/14.2.1/type_traits(581): error: identifier "__is_member_object_pointer" is undefined
      : public __bool_constant<__is_member_object_pointer(_Tp)>
                               ^

/usr/include/c++/14.2.1/type_traits(603): error: type name is not allowed
      : public __bool_constant<__is_member_function_pointer(_Tp)>
                                                            ^

/usr/include/c++/14.2.1/type_traits(603): error: identifier "__is_member_function_pointer" is undefined
      : public __bool_constant<__is_member_function_pointer(_Tp)>
                               ^

/usr/include/c++/14.2.1/type_traits(695): error: type name is not allowed
      : public __bool_constant<__is_reference(_Tp)>
                                              ^

/usr/include/c++/14.2.1/type_traits(695): error: identifier "__is_reference" is undefined
      : public __bool_constant<__is_reference(_Tp)>
                               ^

/usr/include/c++/14.2.1/type_traits(731): error: type name is not allowed
      : public __bool_constant<__is_object(_Tp)>
                                           ^

/usr/include/c++/14.2.1/type_traits(731): error: identifier "__is_object" is undefined
      : public __bool_constant<__is_object(_Tp)>
                               ^

/usr/include/c++/14.2.1/type_traits(760): error: type name is not allowed
      : public __bool_constant<__is_member_pointer(_Tp)>
                                                   ^

/usr/include/c++/14.2.1/type_traits(760): error: identifier "__is_member_pointer" is undefined
      : public __bool_constant<__is_member_pointer(_Tp)>
                               ^

/usr/include/c++/14.2.1/bits/utility.h(237): error: __type_pack_element is not a template
      { using type = __type_pack_element<_Np, _Types...>; };
                     ^

/usr/include/c++/14.2.1/type_traits(138): error: class "std::enable_if<<error-constant>, void>" has no member "type"
      using __enable_if_t = typename enable_if<_Cond, _Tp>::type;
                                                            ^
          detected during:
            instantiation of type "std::__enable_if_t<<error-constant>, void>" at line 176
            instantiation of "std::__detail::__or_fn" based on template arguments <std::is_reference<std::allocator<char>>, std::is_function<std::allocator<char>>, std::is_void<std::allocator<char>>, std::__is_array_unknown_bounds<std::allocator<char>>> at line 194
            instantiation of class "std::__or_<_Bn...> [with _Bn=<std::is_reference<std::allocator<char>>, std::is_function<std::allocator<char>>, std::is_void<std::allocator<char>>, std::__is_array_unknown_bounds<std::allocator<char>>>]" at line 1195
            instantiation of class "std::is_nothrow_default_constructible<_Tp> [with _Tp=std::allocator<char>]" at line 528 of /usr/include/c++/14.2.1/bits/basic_string.h
            instantiation of "std::__cxx11::basic_string<_CharT, _Traits, _Alloc>::basic_string() [with _CharT=char, _Traits=std::char_traits<char>, _Alloc=std::allocator<char>]" at line 4248 of /usr/include/c++/14.2.1/bits/basic_string.h

15 errors detected in the compilation of "llama/ggml-cuda/acc.cu".
make[1]: *** [make/gpu.make:53: llama/build/linux-amd64/llama/ggml-cuda/acc.cuda_v12.o] Error 255
make: *** [Makefile:50: cuda_v12] Error 2
sh-5.2$

@envolution commented on GitHub (Dec 11, 2024): I can confirm that my posts are always within a few minutes of a fresh clone: ``` sh-5.2$ date Wed 11 Dec 2024 11:49:51 AM EST sh-5.2$ git clone https://github.com/ollama/ollama.git Cloning into 'ollama'... remote: Enumerating objects: 27841, done. remote: Counting objects: 100% (157/157), done. remote: Compressing objects: 100% (126/126), done. remote: Total 27841 (delta 54), reused 98 (delta 29), pack-reused 27684 (from 1) Receiving objects: 100% (27841/27841), 27.37 MiB | 30.90 MiB/s, done. Resolving deltas: 100% (17948/17948), done. sh-5.2$ cd ollama/ sh-5.2$ make cuda_v12 CUDA_12_PATH=/opt/cuda /usr/bin/ccache /opt/cuda/bin/nvcc -c -Xcompiler -fPIC -D_GNU_SOURCE -fPIC -Wno-unused-function -std=c++11 -Xcompiler "-mavx" -t2 -DGGML_CUDA_DMMV_X=32 -DGGML_CUDA_MMV_Y=1 -DGGML_CUDA_PEER_MAX_BATCH_SIZE=128 -DGGML_USE_CUDA=1 -DGGML_SHARED=1 -DGGML_BACKEND_SHARED=1 -DGGML_BUILD=1 -DGGML_BACKEND_BUILD=1 -DGGML_USE_LLAMAFILE -DK_QUANTS_PER_ITERATION=2 -DNDEBUG -D_GNU_SOURCE -D_XOPEN_SOURCE=600 -Wno-deprecated-gpu-targets --forward-unknown-to-host-compiler -use_fast_math -I./llama/ -O3 --generate-code=arch=compute_60,code=[compute_60,sm_60] --generate-code=arch=compute_61,code=[compute_61,sm_61] --generate-code=arch=compute_62,code=[compute_62,sm_62] --generate-code=arch=compute_70,code=[compute_70,sm_70] --generate-code=arch=compute_72,code=[compute_72,sm_72] --generate-code=arch=compute_75,code=[compute_75,sm_75] --generate-code=arch=compute_80,code=[compute_80,sm_80] --generate-code=arch=compute_86,code=[compute_86,sm_86] --generate-code=arch=compute_87,code=[compute_87,sm_87] --generate-code=arch=compute_89,code=[compute_89,sm_89] --generate-code=arch=compute_90,code=[compute_90,sm_90] --generate-code=arch=compute_90a,code=[compute_90a,sm_90a] -DGGML_CUDA_USE_GRAPHS=1 -o llama/build/linux-amd64/llama/ggml-cuda/acc.cuda_v12.o llama/ggml-cuda/acc.cu /usr/include/c++/14.2.1/x86_64-pc-linux-gnu/bits/c++config.h(827): error: user-defined literal operator not found typedef __decltype(0.0bf16) __bfloat16_t; ^ /usr/include/c++/14.2.1/type_traits(529): error: type name is not allowed : public __bool_constant<__is_array(_Tp)> ^ /usr/include/c++/14.2.1/type_traits(529): error: identifier "__is_array" is undefined : public __bool_constant<__is_array(_Tp)> ^ /usr/include/c++/14.2.1/type_traits(581): error: type name is not allowed : public __bool_constant<__is_member_object_pointer(_Tp)> ^ /usr/include/c++/14.2.1/type_traits(581): error: identifier "__is_member_object_pointer" is undefined : public __bool_constant<__is_member_object_pointer(_Tp)> ^ /usr/include/c++/14.2.1/type_traits(603): error: type name is not allowed : public __bool_constant<__is_member_function_pointer(_Tp)> ^ /usr/include/c++/14.2.1/type_traits(603): error: identifier "__is_member_function_pointer" is undefined : public __bool_constant<__is_member_function_pointer(_Tp)> ^ /usr/include/c++/14.2.1/type_traits(695): error: type name is not allowed : public __bool_constant<__is_reference(_Tp)> ^ /usr/include/c++/14.2.1/type_traits(695): error: identifier "__is_reference" is undefined : public __bool_constant<__is_reference(_Tp)> ^ /usr/include/c++/14.2.1/type_traits(731): error: type name is not allowed : public __bool_constant<__is_object(_Tp)> ^ /usr/include/c++/14.2.1/type_traits(731): error: identifier "__is_object" is undefined : public __bool_constant<__is_object(_Tp)> ^ /usr/include/c++/14.2.1/type_traits(760): error: type name is not allowed : public __bool_constant<__is_member_pointer(_Tp)> ^ /usr/include/c++/14.2.1/type_traits(760): error: identifier "__is_member_pointer" is undefined : public __bool_constant<__is_member_pointer(_Tp)> ^ /usr/include/c++/14.2.1/bits/utility.h(237): error: __type_pack_element is not a template { using type = __type_pack_element<_Np, _Types...>; }; ^ /usr/include/c++/14.2.1/type_traits(138): error: class "std::enable_if<<error-constant>, void>" has no member "type" using __enable_if_t = typename enable_if<_Cond, _Tp>::type; ^ detected during: instantiation of type "std::__enable_if_t<<error-constant>, void>" at line 176 instantiation of "std::__detail::__or_fn" based on template arguments <std::is_reference<std::allocator<char>>, std::is_function<std::allocator<char>>, std::is_void<std::allocator<char>>, std::__is_array_unknown_bounds<std::allocator<char>>> at line 194 instantiation of class "std::__or_<_Bn...> [with _Bn=<std::is_reference<std::allocator<char>>, std::is_function<std::allocator<char>>, std::is_void<std::allocator<char>>, std::__is_array_unknown_bounds<std::allocator<char>>>]" at line 1195 instantiation of class "std::is_nothrow_default_constructible<_Tp> [with _Tp=std::allocator<char>]" at line 528 of /usr/include/c++/14.2.1/bits/basic_string.h instantiation of "std::__cxx11::basic_string<_CharT, _Traits, _Alloc>::basic_string() [with _CharT=char, _Traits=std::char_traits<char>, _Alloc=std::allocator<char>]" at line 4248 of /usr/include/c++/14.2.1/bits/basic_string.h 15 errors detected in the compilation of "llama/ggml-cuda/acc.cu". make[1]: *** [make/gpu.make:53: llama/build/linux-amd64/llama/ggml-cuda/acc.cuda_v12.o] Error 255 make: *** [Makefile:50: cuda_v12] Error 2 sh-5.2$ ```

GiteaMirror commented

2026-04-12 16:14:32 -05:00

@envolution commented on GitHub (Dec 16, 2024):

it's possible llama does not support my architecture as it's pretty dated. I came across an old report I had on llama.cpp and noticed you had commented as well. https://github.com/ggerganov/llama.cpp/issues/4395 - I don't think it ever gained any interest in being resolved and I had forgotten about it until now.

If architecture 52 is below the intended support level please feel free to close

@envolution commented on GitHub (Dec 16, 2024): it's possible llama does not support my architecture as it's pretty dated. I came across an old report I had on llama.cpp and noticed you had commented as well. https://github.com/ggerganov/llama.cpp/issues/4395 - I don't think it ever gained any interest in being resolved and I had forgotten about it until now. If architecture 52 is below the intended support level please feel free to close

GiteaMirror commented

2026-04-12 16:14:33 -05:00

@envolution commented on GitHub (Dec 16, 2024):

here's a llama.cpp compilation log showing the same error - this issue isn't rooted in ollama

$ CUDAToolkit_ROOT=/opt/cuda CUDACXX=/opt/cuda/bin/nvcc cmake -B build -DGGML_CUDA=ON
-- ccache found, compilation results will be cached. Disable with GGML_CCACHE=OFF.
-- CMAKE_SYSTEM_PROCESSOR: x86_64
-- Including CPU backend
-- Adding CPU backend variant ggml-cpu: -march=native 
-- CUDA Toolkit found
-- Using CUDA architectures: native
CMake Error at /usr/share/cmake/Modules/CMakeDetermineCompilerId.cmake:865 (message):
  Compiling the CUDA compiler identification source file
  "CMakeCUDACompilerId.cu" failed.

  Compiler: /opt/cuda/bin/nvcc

  Build flags:

  Id flags: --keep;--keep-dir;tmp -v



  The output was:

  2

  #$ _NVVM_BRANCH_=nvvm

  #$ _SPACE_=

  #$ _CUDART_=cudart

  #$ _HERE_=/opt/cuda/bin

  #$ _THERE_=/opt/cuda/bin

  #$ _TARGET_SIZE_=

  #$ _TARGET_DIR_=

  #$ _TARGET_DIR_=targets/x86_64-linux

  #$ TOP=/opt/cuda/bin/..

  #$ CICC_PATH=/opt/cuda/bin/../nvvm/bin

  #$ NVVMIR_LIBRARY_DIR=/opt/cuda/bin/../nvvm/libdevice

  #$ LD_LIBRARY_PATH=/opt/cuda/bin/../lib:

  #$
  PATH=/opt/cuda/bin/../nvvm/bin:/opt/cuda/bin:/home/evo/.bun/bin:/home/evo/.nvm/versions/node/v20.18.0/bin:/home/evo/.local/share/pnpm:/usr/local/bin:/usr/bin:/home/evo/.cache/lm-studio/bin:/home/evo/scripts


  #$ INCLUDES="-I/opt/cuda/bin/../targets/x86_64-linux/include"

  #$ LIBRARIES= "-L/opt/cuda/bin/../targets/x86_64-linux/lib/stubs"
  "-L/opt/cuda/bin/../targets/x86_64-linux/lib"

  #$ CUDAFE_FLAGS=

  #$ PTXAS_FLAGS=

  #$ rm tmp/a_dlink.reg.c

  #$ gcc -D__CUDA_ARCH_LIST__=520 -D__NV_LEGACY_LAUNCH -E -x c++ -D__CUDACC__
  -D__NVCC__ "-I/opt/cuda/bin/../targets/x86_64-linux/include"
  -D__CUDACC_VER_MAJOR__=12 -D__CUDACC_VER_MINOR__=6
  -D__CUDACC_VER_BUILD__=85 -D__CUDA_API_VER_MAJOR__=12
  -D__CUDA_API_VER_MINOR__=6 -D__NVCC_DIAG_PRAGMA_SUPPORT__=1 -include
  "cuda_runtime.h" -m64 "CMakeCUDACompilerId.cu" -o
  "tmp/CMakeCUDACompilerId.cpp4.ii"

  #$ cudafe++ --c++17 --gnu_version=140201 --display_error_number
  --orig_src_file_name "CMakeCUDACompilerId.cu" --orig_src_path_name
  "/tmp/llama.cpp/build/CMakeFiles/3.31.2/CompilerIdCUDA/CMakeCUDACompilerId.cu"
  --allow_managed --m64 --parse_templates --gen_c_file_name
  "tmp/CMakeCUDACompilerId.cudafe1.cpp" --stub_file_name
  "CMakeCUDACompilerId.cudafe1.stub.c" --gen_module_id_file
  --module_id_file_name "tmp/CMakeCUDACompilerId.module_id"
  "tmp/CMakeCUDACompilerId.cpp4.ii"

  /usr/include/c++/14.2.1/x86_64-pc-linux-gnu/bits/c++config.h(827): error:
  user-defined literal operator not found

      typedef __decltype(0.0bf16) __bfloat16_t;
                         ^

  

  /usr/include/c++/14.2.1/type_traits(529): error: type name is not allowed

        : public __bool_constant<__is_array(_Tp)>
                                            ^

  

  /usr/include/c++/14.2.1/type_traits(529): error: identifier "__is_array" is
  undefined

        : public __bool_constant<__is_array(_Tp)>
                                 ^

  

  /usr/include/c++/14.2.1/type_traits(581): error: type name is not allowed

        : public __bool_constant<__is_member_object_pointer(_Tp)>
                                                            ^

  

  /usr/include/c++/14.2.1/type_traits(581): error: identifier
  "__is_member_object_pointer" is undefined

        : public __bool_constant<__is_member_object_pointer(_Tp)>
                                 ^

  

  /usr/include/c++/14.2.1/type_traits(603): error: type name is not allowed

        : public __bool_constant<__is_member_function_pointer(_Tp)>
                                                              ^

  

  /usr/include/c++/14.2.1/type_traits(603): error: identifier
  "__is_member_function_pointer" is undefined

        : public __bool_constant<__is_member_function_pointer(_Tp)>
                                 ^

  

  /usr/include/c++/14.2.1/type_traits(695): error: type name is not allowed

        : public __bool_constant<__is_reference(_Tp)>
                                                ^

  

  /usr/include/c++/14.2.1/type_traits(695): error: identifier
  "__is_reference" is undefined

        : public __bool_constant<__is_reference(_Tp)>
                                 ^

  

  /usr/include/c++/14.2.1/type_traits(731): error: type name is not allowed

        : public __bool_constant<__is_object(_Tp)>
                                             ^

  

  /usr/include/c++/14.2.1/type_traits(731): error: identifier "__is_object"
  is undefined

        : public __bool_constant<__is_object(_Tp)>
                                 ^

  

  /usr/include/c++/14.2.1/type_traits(760): error: type name is not allowed

        : public __bool_constant<__is_member_pointer(_Tp)>
                                                     ^

  

  /usr/include/c++/14.2.1/type_traits(760): error: identifier
  "__is_member_pointer" is undefined

        : public __bool_constant<__is_member_pointer(_Tp)>
                                 ^

  

  /usr/include/c++/14.2.1/type_traits(3247): error: type name is not allowed

      inline constexpr bool is_array_v = __is_array(_Tp);
                                                    ^

  

  /usr/include/c++/14.2.1/type_traits(3271): error: type name is not allowed

        __is_member_object_pointer(_Tp);
                                   ^

  

  /usr/include/c++/14.2.1/type_traits(3281): error: type name is not allowed

        __is_member_function_pointer(_Tp);
                                     ^

  

  /usr/include/c++/14.2.1/type_traits(3298): error: type name is not allowed

      inline constexpr bool is_reference_v = __is_reference(_Tp);
                                                            ^

  

  /usr/include/c++/14.2.1/type_traits(3315): error: type name is not allowed

      inline constexpr bool is_object_v = __is_object(_Tp);
                                                      ^

  

  /usr/include/c++/14.2.1/type_traits(3328): error: type name is not allowed

      inline constexpr bool is_member_pointer_v = __is_member_pointer(_Tp);
                                                                      ^

  

  /usr/include/c++/14.2.1/bits/utility.h(237): error: __type_pack_element is
  not a template

        { using type = __type_pack_element<_Np, _Types...>; };
                       ^

  

  20 errors detected in the compilation of "CMakeCUDACompilerId.cu".

  # --error 0x2 --





Call Stack (most recent call first):
  /usr/share/cmake/Modules/CMakeDetermineCompilerId.cmake:8 (CMAKE_DETERMINE_COMPILER_ID_BUILD)
  /usr/share/cmake/Modules/CMakeDetermineCompilerId.cmake:53 (__determine_compiler_id_test)
  /usr/share/cmake/Modules/CMakeDetermineCUDACompiler.cmake:131 (CMAKE_DETERMINE_COMPILER_ID)
  ggml/src/ggml-cuda/CMakeLists.txt:25 (enable_language)

@envolution commented on GitHub (Dec 16, 2024): here's a llama.cpp compilation log showing the same error - this issue isn't rooted in ollama ``` $ CUDAToolkit_ROOT=/opt/cuda CUDACXX=/opt/cuda/bin/nvcc cmake -B build -DGGML_CUDA=ON -- ccache found, compilation results will be cached. Disable with GGML_CCACHE=OFF. -- CMAKE_SYSTEM_PROCESSOR: x86_64 -- Including CPU backend -- Adding CPU backend variant ggml-cpu: -march=native -- CUDA Toolkit found -- Using CUDA architectures: native CMake Error at /usr/share/cmake/Modules/CMakeDetermineCompilerId.cmake:865 (message): Compiling the CUDA compiler identification source file "CMakeCUDACompilerId.cu" failed. Compiler: /opt/cuda/bin/nvcc Build flags: Id flags: --keep;--keep-dir;tmp -v The output was: 2 #$ _NVVM_BRANCH_=nvvm #$ _SPACE_= #$ _CUDART_=cudart #$ _HERE_=/opt/cuda/bin #$ _THERE_=/opt/cuda/bin #$ _TARGET_SIZE_= #$ _TARGET_DIR_= #$ _TARGET_DIR_=targets/x86_64-linux #$ TOP=/opt/cuda/bin/.. #$ CICC_PATH=/opt/cuda/bin/../nvvm/bin #$ NVVMIR_LIBRARY_DIR=/opt/cuda/bin/../nvvm/libdevice #$ LD_LIBRARY_PATH=/opt/cuda/bin/../lib: #$ PATH=/opt/cuda/bin/../nvvm/bin:/opt/cuda/bin:/home/evo/.bun/bin:/home/evo/.nvm/versions/node/v20.18.0/bin:/home/evo/.local/share/pnpm:/usr/local/bin:/usr/bin:/home/evo/.cache/lm-studio/bin:/home/evo/scripts #$ INCLUDES="-I/opt/cuda/bin/../targets/x86_64-linux/include" #$ LIBRARIES= "-L/opt/cuda/bin/../targets/x86_64-linux/lib/stubs" "-L/opt/cuda/bin/../targets/x86_64-linux/lib" #$ CUDAFE_FLAGS= #$ PTXAS_FLAGS= #$ rm tmp/a_dlink.reg.c #$ gcc -D__CUDA_ARCH_LIST__=520 -D__NV_LEGACY_LAUNCH -E -x c++ -D__CUDACC__ -D__NVCC__ "-I/opt/cuda/bin/../targets/x86_64-linux/include" -D__CUDACC_VER_MAJOR__=12 -D__CUDACC_VER_MINOR__=6 -D__CUDACC_VER_BUILD__=85 -D__CUDA_API_VER_MAJOR__=12 -D__CUDA_API_VER_MINOR__=6 -D__NVCC_DIAG_PRAGMA_SUPPORT__=1 -include "cuda_runtime.h" -m64 "CMakeCUDACompilerId.cu" -o "tmp/CMakeCUDACompilerId.cpp4.ii" #$ cudafe++ --c++17 --gnu_version=140201 --display_error_number --orig_src_file_name "CMakeCUDACompilerId.cu" --orig_src_path_name "/tmp/llama.cpp/build/CMakeFiles/3.31.2/CompilerIdCUDA/CMakeCUDACompilerId.cu" --allow_managed --m64 --parse_templates --gen_c_file_name "tmp/CMakeCUDACompilerId.cudafe1.cpp" --stub_file_name "CMakeCUDACompilerId.cudafe1.stub.c" --gen_module_id_file --module_id_file_name "tmp/CMakeCUDACompilerId.module_id" "tmp/CMakeCUDACompilerId.cpp4.ii" /usr/include/c++/14.2.1/x86_64-pc-linux-gnu/bits/c++config.h(827): error: user-defined literal operator not found typedef __decltype(0.0bf16) __bfloat16_t; ^ /usr/include/c++/14.2.1/type_traits(529): error: type name is not allowed : public __bool_constant<__is_array(_Tp)> ^ /usr/include/c++/14.2.1/type_traits(529): error: identifier "__is_array" is undefined : public __bool_constant<__is_array(_Tp)> ^ /usr/include/c++/14.2.1/type_traits(581): error: type name is not allowed : public __bool_constant<__is_member_object_pointer(_Tp)> ^ /usr/include/c++/14.2.1/type_traits(581): error: identifier "__is_member_object_pointer" is undefined : public __bool_constant<__is_member_object_pointer(_Tp)> ^ /usr/include/c++/14.2.1/type_traits(603): error: type name is not allowed : public __bool_constant<__is_member_function_pointer(_Tp)> ^ /usr/include/c++/14.2.1/type_traits(603): error: identifier "__is_member_function_pointer" is undefined : public __bool_constant<__is_member_function_pointer(_Tp)> ^ /usr/include/c++/14.2.1/type_traits(695): error: type name is not allowed : public __bool_constant<__is_reference(_Tp)> ^ /usr/include/c++/14.2.1/type_traits(695): error: identifier "__is_reference" is undefined : public __bool_constant<__is_reference(_Tp)> ^ /usr/include/c++/14.2.1/type_traits(731): error: type name is not allowed : public __bool_constant<__is_object(_Tp)> ^ /usr/include/c++/14.2.1/type_traits(731): error: identifier "__is_object" is undefined : public __bool_constant<__is_object(_Tp)> ^ /usr/include/c++/14.2.1/type_traits(760): error: type name is not allowed : public __bool_constant<__is_member_pointer(_Tp)> ^ /usr/include/c++/14.2.1/type_traits(760): error: identifier "__is_member_pointer" is undefined : public __bool_constant<__is_member_pointer(_Tp)> ^ /usr/include/c++/14.2.1/type_traits(3247): error: type name is not allowed inline constexpr bool is_array_v = __is_array(_Tp); ^ /usr/include/c++/14.2.1/type_traits(3271): error: type name is not allowed __is_member_object_pointer(_Tp); ^ /usr/include/c++/14.2.1/type_traits(3281): error: type name is not allowed __is_member_function_pointer(_Tp); ^ /usr/include/c++/14.2.1/type_traits(3298): error: type name is not allowed inline constexpr bool is_reference_v = __is_reference(_Tp); ^ /usr/include/c++/14.2.1/type_traits(3315): error: type name is not allowed inline constexpr bool is_object_v = __is_object(_Tp); ^ /usr/include/c++/14.2.1/type_traits(3328): error: type name is not allowed inline constexpr bool is_member_pointer_v = __is_member_pointer(_Tp); ^ /usr/include/c++/14.2.1/bits/utility.h(237): error: __type_pack_element is not a template { using type = __type_pack_element<_Np, _Types...>; }; ^ 20 errors detected in the compilation of "CMakeCUDACompilerId.cu". # --error 0x2 -- Call Stack (most recent call first): /usr/share/cmake/Modules/CMakeDetermineCompilerId.cmake:8 (CMAKE_DETERMINE_COMPILER_ID_BUILD) /usr/share/cmake/Modules/CMakeDetermineCompilerId.cmake:53 (__determine_compiler_id_test) /usr/share/cmake/Modules/CMakeDetermineCUDACompiler.cmake:131 (CMAKE_DETERMINE_COMPILER_ID) ggml/src/ggml-cuda/CMakeLists.txt:25 (enable_language) ```

GiteaMirror commented

2026-04-12 16:14:33 -05:00

@FatihOztank commented on GitHub (Jan 10, 2025):

Can be related to this issue: https://bbs.archlinux.org/viewtopic.php?id=300160

@FatihOztank commented on GitHub (Jan 10, 2025): Can be related to this issue: https://bbs.archlinux.org/viewtopic.php?id=300160

GiteaMirror commented

2026-04-12 16:14:34 -05:00

@envolution commented on GitHub (Jan 10, 2025):

it was yes - i was able to compile by updating with this commit https://aur.archlinux.org/cgit/aur.git/commit/?h=ollama-cuda-git&id=1bae2d23dba06da3c4b0a8e7e7f2f1a37c723ca3

@envolution commented on GitHub (Jan 10, 2025): it was yes - i was able to compile by updating with this commit https://aur.archlinux.org/cgit/aur.git/commit/?h=ollama-cuda-git&id=1bae2d23dba06da3c4b0a8e7e7f2f1a37c723ca3

GiteaMirror referenced this issue

2026-04-22 07:35:21 -05:00

[GH-ISSUE #5138] Merge saved model #29000

GiteaMirror referenced this issue

2026-04-28 12:51:54 -05:00

[GH-ISSUE #5138] Merge saved model #49751

GiteaMirror referenced this issue

2026-05-03 20:19:32 -05:00

[GH-ISSUE #5138] Merge saved model #65277

Sign in to join this conversation.

Branches Tags

main

hoyyeva/anthropic-local-image-path

dhiltgen/ci

dhiltgen/llama-runner

parth-remove-claude-desktop-launch

hoyyeva/anthropic-reference-images-path

parth-anthropic-reference-images-path

brucemacd/download-before-remove

hoyyeva/editor-config-repair

parth-mlx-decode-checkpoints

parth-launch-codex-app

hoyyeva/fix-codex-model-metadata-warning

hoyyeva/qwen

parth/hide-claude-desktop-till-release

hoyyeva/opencode-image-modality

parth-add-claude-code-autoinstall

release_v0.22.0

pdevine/manifest-list

codex/fix-codex-model-metadata-warning

pdevine/addressable-manifest

brucemacd/launch-fetch-reccomended

jmorganca/llama-compat

launch-copilot-cli

hoyyeva/opencode-thinking

release_v0.20.7

parth-auto-save-backup

parth-test

jmorganca/gemma4-audio-replacements

fix-manifest-digest-on-pull

hoyyeva/vscode-improve

brucemacd/install-server-wait

parth/update-claude-docs

brucemac/start-ap-install

pdevine/mlx-update

pdevine/qwen35_vision

drifkin/api-show-fallback

mintlify/image-generation-1773352582

hoyyeva/server-context-length-local-config

jmorganca/faster-reptition-penalties

jmorganca/convert-nemotron

parth-pi-thinking

pdevine/sampling-penalties

jmorganca/fix-create-quantization-memory

dongchen/resumable_transfer_fix

pdevine/sampling-cache-error

jessegross/mlx-usage

hoyyeva/openclaw-config

hoyyeva/app-html

pdevine/qwen3next

brucemacd/sign-sh-install

brucemacd/tui-update

brucemacd/usage-api

jmorganca/launch-empty

fix-app-dist-embed

mxyng/mlx-compile

mxyng/mlx-quant

mxyng/mlx-glm4.7

mxyng/mlx

brucemacd/simplify-model-picker

jmorganca/qwen3-concurrent

fix-glm-4.7-flash-mla-config

drifkin/qwen3-coder-opening-tag

brucemacd/usage-cli

fix-cuda12-fattn-shmem

ollama-imagegen-docs

parth/fix-multiline-inputs

brucemacd/config-docs

mxyng/model-files

mxyng/simple-execute

fix-imagegen-ollama-models

mxyng/async-upload

jmorganca/lazy-no-dtype-changes

imagegen-auto-detect-create

parth/decrease-concurrent-download-hf

fix-mlx-quantize-init

jmorganca/x-cleanup

usage

imagegen-readme

jmorganca/glm-image

mlx-gpu-cd

jmorganca/imagegen-modelfile

parth/agent-skills

parth/agent-allowlist

parth/signed-in-offline

parth/agents

parth/fix-context-chopping

improve-cloud-flow

parth/add-models-websearch

parth/prompt-renderer-mcp

jmorganca/native-settings

jmorganca/download-stream-hash

jmorganca/client2-rebased

brucemacd/oai-chat-req-multipart

jessegross/multi_chunk_reserve

grace/additional-omit-empty

grace/mistral-3-large

mxyng/tokenizer2

mxyng/tokenizer

jessegross/flash

hoyyeva/windows-nacked-app

mxyng/cleanup-attention

grace/deepseek-parser

hoyyeva/remember-unsent-prompt

parth/add-lfs-pointer-error-conversion

parth/olmo2-test2

hoyyeva/ollama-launchagent-plist

nicole/olmo-model

parth/olmo-test

mxyng/remove-embedded

parth/render-template

jmorganca/intellect-3

parth/remove-prealloc-linter

jmorganca/cmd-eval

nicole/nomic-embed-text-fix

mxyng/lint-2

hoyyeva/add-gemini-3-pro-preview

hoyyeva/load-model-list

mxyng/expand-path

mxyng/environ-2

hoyyeva/deeplink-json-encoding

parth/improve-tool-calling-tests

hoyyeva/conversation

hoyyeva/assistant-edit-response

hoyyeva/thinking

origin/brucemacd/invalid-char-i-err

parth/improve-tool-calling

jmorganca/required-omitempty

grace/qwen3-vl-tests

mxyng/iter-client

parth/docs-readme

nicole/embed-test

pdevine/integration-benchstat

parth/remove-generate-cmd

parth/add-toolcall-id

mxyng/server-tests

jmorganca/glm-4.6

jmorganca/gin-h-compat

drifkin/stable-tool-args

pdevine/qwen3-more-thinking

parth/add-websearch-client

nicole/websearch_local

jmorganca/qwen3-coder-updates

grace/deepseek-v3-migration-tests

mxyng/fix-create

jmorganca/cloud-errors

pdevine/parser-tidy

revert-12233-parth/simplify-entrypoints-runner

parth/enable-so-gpt-oss

brucemacd/qwen3vl

jmorganca/readme-simplify

parth/gpt-oss-structured-outputs

revert-12039-jmorganca/tools-braces

mxyng/embeddings

mxyng/gguf

mxyng/benchmark

mxyng/types-null

parth/move-parsing

mxyng/gemma2

jmorganca/docs

mxyng/16-bit

mxyng/create-stdin

pdevine/authorizedkeys

mxyng/quant

parth/opt-in-error-context-window

brucemacd/cache-models

brucemacd/runner-completion

jmorganca/llama-update-6

brucemacd/benchmark-list

brucemacd/partial-read-caps

parth/deepseek-r1-tools

mxyng/omit-array

parth/tool-prefix-temp

brucemacd/runner-test

jmorganca/qwen25vl

brucemacd/model-forward-test-ext

parth/python-function-parsing

jmorganca/cuda-compression-none

drifkin/num-parallel

drifkin/chat-truncation-fix

jmorganca/sync

parth/python-tools-calling

drifkin/array-head-count

brucemacd/create-no-loop

parth/server-enable-content-stream-with-tools

qwen25omni

mxyng/v3

brucemacd/ropeconfig

jmorganca/silence-tokenizer

parth/sample-so-test

parth/sampling-structured-outputs

brucemacd/doc-go-engine

parth/constrained-sampling-json

jmorganca/mistral-wip

brucemacd/mistral-small-convert

parth/sample-unmarshal-json-for-params

brucemacd/jomorganca/mistral

pdevine/bfloat16

jmorganca/mistral

brucemacd/mistral

pdevine/logging

parth/sample-correctness-fix

parth/sample-fix-sorting

jmorgan/sample-fix-sorting-extras

jmorganca/temp-0-images

brucemacd/parallel-embed-models

brucemacd/shim-grammar

jmorganca/fix-gguf-error

bmizerany/nameswork

jmorganca/faster-releases

bmizerany/validatenames

brucemacd/err-no-vocab

brucemacd/rope-config

brucemacd/err-hint

brucemacd/qwen2_5

brucemacd/logprobs

brucemacd/new_runner_graph_bench

progress-flicker

brucemacd/forward-test

brucemacd/go_qwen2

pdevine/gemma2

jmorganca/add-missing-symlink-eval

mxyng/next-debug

parth/set-context-size-openai

brucemacd/next-bpe-bench

brucemacd/next-bpe-test

brucemacd/new_runner_e2e

brucemacd/new_runner_qwen2

pdevine/convert-cohere2

brucemacd/convert-cli

parth/log-probs

mxyng/next-mlx

mxyng/cmd-history

parth/templating

parth/tokenize-detokenize

brucemacd/check-key-register

bmizerany/grammar

jmorganca/vendor-081b29bd

mxyng/func-checks

jmorganca/fix-null-format

parth/fix-default-to-warn-json

jmorganca/qwen2vl

jmorganca/no-concat

parth/cmd-cleanup-SO

brucemacd/check-key-register-structured-err

parth/openai-stream-usage

parth/fix-referencing-so

stream-tools-stop

jmorganca/degin-1

brucemacd/install-path-clean

brucemacd/push-name-validation

brucemacd/browser-key-register

jmorganca/openai-fix-first-message

jmorganca/fix-proxy

jessegross/sample

parth/disallow-streaming-tools

dhiltgen/remove_submodule

jmorganca/ga

jmorganca/mllama

pdevine/newlines

pdevine/geems-2b

jmorganca/llama-bump

mxyng/modelname-7

mxyng/gin-slog

mxyng/modelname-6

jyan/convert-prog

jyan/quant5

paligemma-support

pdevine/import-docs

jmorganca/openai-context

jyan/paligemma

jyan/p2

jyan/palitest

bmizerany/embedspeedup

jmorganca/llama-vit

brucemacd/allow-ollama

royh/ep-methods

royh/whisper

mxyng/api-models

mxyng/fix-memory

jyan/q4_4/8

jyan/ollama-v

royh/stream-tools

roy-embed-parallel

bmizerany/hrm

revert-5963-revert-5924-mxyng/llama3.1-rope

royh/embed-viz

jyan/local2

jyan/auth

jyan/local

jyan/parse-temp

jmorganca/template-mistral

jyan/reord-g

royh-openai-suffixdocs

royh-imgembed

royh-embed-parallel

jyan/quant4

royh-precision

jyan/progress

pdevine/fix-template

jyan/quant3

pdevine/ggla

mxyng/update-registry-domain

jmorganca/ggml-static

mxyng/create-context

jyan/v0.146

mxyng/layers-from-files

build_dist

bmizerany/noseek

royh-ls

royh-name

timeout

mxyng/server-timestamp

bmizerany/nosillyggufslurps

royh-params

jmorganca/llama-cpp-7c26775

royh-openai-delete

royh-show-rigid

jmorganca/enable-fa

jmorganca/no-error-template

jyan/format

royh-testdelete

bmizerany/fastverify

language_support

pdevine/ps-glitches

brucemacd/tokenize

bruce/iq-quants

bmizerany/filepathwithcoloninhost

mxyng/split-bin

bmizerany/client-registry

jmorganca/if-none-match

native

jmorganca/native

jmorganca/batch-embeddings

jmorganca/initcmake

jmorganca/mm

pdevine/showggmlinfo

modenameenforcealphanum

bmizerany/modenameenforcealphanum

jmorganca/done-reason

jmorganca/llama-cpp-8960fe8

ollama.com

bmizerany/filepathnobuild

bmizerany/types/model/defaultfix

rmdisplaylong

nogogen

bmizerany/x

modelfile-readme

bmizerany/replacecolon

jmorganca/limit

jmorganca/execstack

jmorganca/replace-assets

mxyng/tune-concurrency

jmorganca/testing

whitespace-detection

jmorganca/options

upgrade-all

scratch

cuda-search

mattw/airenamer

mattw/allmodelsonhuggingface

mattw/quantcontext

mattw/whatneedstorun

brucemacd/llama-mem-calc

mattw/faq-context

mattw/communitylinks

mattw/noprune

mattw/python-functioncalling

rename

mxyng/install

pulse

remove-first

editor

mattw/selfqueryingretrieval

cgo

mattw/howtoquant

api

matt/streamingapi

format-config

mxyng/extra-args

shell

update-nous-hermes

cp-model

upload-progress

fix-unknown-model

fix-model-names

delete-fix

insecure-registry

ls

deletemodels

progressbar

readme-updates

license-layers

skip-list

list-models

modelpath

matt/examplemodelfiles

distribution

go-opts

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: github-starred/ollama#5138