[GH-ISSUE #11515] ‘_mm256_set_m128’ was not declared in this scope #54117

Closed
opened 2026-04-29 05:14:27 -05:00 by GiteaMirror · 21 comments
Owner

Originally created by @abcbarryn on GitHub (Jul 24, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/11515

What is the issue?

Tried to build ollama with:
cmake -B build
cmake --build build
The build failed with the output below...

Relevant log output

/usr/src/ollama-main/ml/backend/ggml/ggml/src/ggml-cpu/ggml-cpu-aarch64.cpp: In function ‘void ggml_gemm_q4_K_8x8_q8_K(int, float*, size_t, const void*, const void*, int, int)’:
/usr/src/ollama-main/ml/backend/ggml/ggml/src/ggml-cpu/ggml-cpu-aarch64.cpp:5111:54: error: ‘_mm256_set_m128’ was not declared in this scope
                         const __m256 row_scale_f32 = _mm256_set_m128(row_scale_f32_sse, row_scale_f32_sse);//GGML_F32Cx8_REPEAT_LOAD(a_ptrs[rp][b].d, loadMask);
                                                      ^~~~~~~~~~~~~~~
/usr/src/ollama-main/ml/backend/ggml/ggml/src/ggml-cpu/ggml-cpu-aarch64.cpp:5111:54: note: suggested alternative: ‘_mm256_set_epi8’
                         const __m256 row_scale_f32 = _mm256_set_m128(row_scale_f32_sse, row_scale_f32_sse);//GGML_F32Cx8_REPEAT_LOAD(a_ptrs[rp][b].d, loadMask);
                                                      ^~~~~~~~~~~~~~~
                                                      _mm256_set_epi8
/usr/src/ollama-main/ml/backend/ggml/ggml/src/ggml-cpu/ggml-cpu-aarch64.cpp:5441:50: error: ‘_mm256_set_m128’ was not declared in this scope
                     const __m256 row_scale_f32 = _mm256_set_m128(row_scale_f32_sse, row_scale_f32_sse); //GGML_F32Cx8_REPEAT_LOAD(a_ptrs[rp][b].d, loadMask);
                                                  ^~~~~~~~~~~~~~~
/usr/src/ollama-main/ml/backend/ggml/ggml/src/ggml-cpu/ggml-cpu-aarch64.cpp:5441:50: note: suggested alternative: ‘_mm256_set_epi8’
                     const __m256 row_scale_f32 = _mm256_set_m128(row_scale_f32_sse, row_scale_f32_sse); //GGML_F32Cx8_REPEAT_LOAD(a_ptrs[rp][b].d, loadMask);
                                                  ^~~~~~~~~~~~~~~
                                                  _mm256_set_epi8
gmake[2]: *** [ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/build.make:104: ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/ggml-cpu-aarch64.cpp.o] Error 1
gmake[1]: *** [CMakeFiles/Makefile2:415: ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/all] Error 2
gmake: *** [Makefile:136: all] Error 2

OS

Linux

GPU

Nvidia

CPU

Intel

Ollama version

No response

Originally created by @abcbarryn on GitHub (Jul 24, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/11515 ### What is the issue? Tried to build ollama with: cmake -B build cmake --build build The build failed with the output below... ### Relevant log output ```shell /usr/src/ollama-main/ml/backend/ggml/ggml/src/ggml-cpu/ggml-cpu-aarch64.cpp: In function ‘void ggml_gemm_q4_K_8x8_q8_K(int, float*, size_t, const void*, const void*, int, int)’: /usr/src/ollama-main/ml/backend/ggml/ggml/src/ggml-cpu/ggml-cpu-aarch64.cpp:5111:54: error: ‘_mm256_set_m128’ was not declared in this scope const __m256 row_scale_f32 = _mm256_set_m128(row_scale_f32_sse, row_scale_f32_sse);//GGML_F32Cx8_REPEAT_LOAD(a_ptrs[rp][b].d, loadMask); ^~~~~~~~~~~~~~~ /usr/src/ollama-main/ml/backend/ggml/ggml/src/ggml-cpu/ggml-cpu-aarch64.cpp:5111:54: note: suggested alternative: ‘_mm256_set_epi8’ const __m256 row_scale_f32 = _mm256_set_m128(row_scale_f32_sse, row_scale_f32_sse);//GGML_F32Cx8_REPEAT_LOAD(a_ptrs[rp][b].d, loadMask); ^~~~~~~~~~~~~~~ _mm256_set_epi8 /usr/src/ollama-main/ml/backend/ggml/ggml/src/ggml-cpu/ggml-cpu-aarch64.cpp:5441:50: error: ‘_mm256_set_m128’ was not declared in this scope const __m256 row_scale_f32 = _mm256_set_m128(row_scale_f32_sse, row_scale_f32_sse); //GGML_F32Cx8_REPEAT_LOAD(a_ptrs[rp][b].d, loadMask); ^~~~~~~~~~~~~~~ /usr/src/ollama-main/ml/backend/ggml/ggml/src/ggml-cpu/ggml-cpu-aarch64.cpp:5441:50: note: suggested alternative: ‘_mm256_set_epi8’ const __m256 row_scale_f32 = _mm256_set_m128(row_scale_f32_sse, row_scale_f32_sse); //GGML_F32Cx8_REPEAT_LOAD(a_ptrs[rp][b].d, loadMask); ^~~~~~~~~~~~~~~ _mm256_set_epi8 gmake[2]: *** [ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/build.make:104: ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/ggml-cpu-aarch64.cpp.o] Error 1 gmake[1]: *** [CMakeFiles/Makefile2:415: ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/all] Error 2 gmake: *** [Makefile:136: all] Error 2 ``` ### OS Linux ### GPU Nvidia ### CPU Intel ### Ollama version _No response_
GiteaMirror added the bug label 2026-04-29 05:14:27 -05:00
Author
Owner

@rick-github commented on GitHub (Jul 24, 2025):

$ git clone https://github.com/ollama/ollama.git
Cloning into 'ollama'...
...
Resolving deltas: 100% (23190/23190), done.
$ cd ollama
$ cmake -B build
-- The C compiler identification is GNU 13.2.0
-- The CXX compiler identification is GNU 13.2.0
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working C compiler: /usr/bin/cc - skipped
-- Detecting C compile features
-- Detecting C compile features - done
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Check for working CXX compiler: /usr/bin/c++ - skipped
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Success
-- Found Threads: TRUE  
-- Warning: ccache not found - consider installing it for faster compilation or disable this warning with GGML_CCACHE=OFF
-- CMAKE_SYSTEM_PROCESSOR: x86_64
-- Including CPU backend
-- x86 detected
-- Adding CPU backend variant ggml-cpu-x64:  
-- x86 detected
-- Adding CPU backend variant ggml-cpu-sse42: -msse4.2 GGML_SSE42
-- x86 detected
-- Adding CPU backend variant ggml-cpu-sandybridge: -msse4.2;-mavx GGML_SSE42;GGML_AVX
-- x86 detected
-- Adding CPU backend variant ggml-cpu-haswell: -msse4.2;-mf16c;-mfma;-mbmi2;-mavx;-mavx2 GGML_SSE42;GGML_F16C;GGML_FMA;GGML_BMI2;GGML_AVX;GGML_AVX2
-- x86 detected
-- Adding CPU backend variant ggml-cpu-skylakex: -msse4.2;-mf16c;-mfma;-mbmi2;-mavx;-mavx2;-mavx512f;-mavx512cd;-mavx512vl;-mavx512dq;-mavx512bw GGML_SSE42;GGML_F16C;GGML_FMA;GGML_BMI2;GGML_AVX;GGML_AVX2;GGML_AVX512
-- x86 detected
-- Adding CPU backend variant ggml-cpu-icelake: -msse4.2;-mf16c;-mfma;-mbmi2;-mavx;-mavx2;-mavx512f;-mavx512cd;-mavx512vl;-mavx512dq;-mavx512bw;-mavx512vbmi;-mavx512vnni GGML_SSE42;GGML_F16C;GGML_FMA;GGML_BMI2;GGML_AVX;GGML_AVX2;GGML_AVX512;GGML_AVX512_VBMI;GGML_AVX512_VNNI
-- x86 detected
-- Adding CPU backend variant ggml-cpu-alderlake: -msse4.2;-mf16c;-mfma;-mbmi2;-mavx;-mavx2;-mavxvnni GGML_SSE42;GGML_F16C;GGML_FMA;GGML_BMI2;GGML_AVX;GGML_AVX2;GGML_AVX_VNNI
-- Looking for a CUDA compiler
-- Looking for a CUDA compiler - /usr/bin/nvcc
-- Found CUDAToolkit: /usr/include (found version "12.0.140") 
-- CUDA Toolkit found
-- Using CUDA architectures: native
-- The CUDA compiler identification is NVIDIA 12.0.140
-- Detecting CUDA compiler ABI info
-- Detecting CUDA compiler ABI info - done
-- Check for working CUDA compiler: /usr/bin/nvcc - skipped
-- Detecting CUDA compile features
-- Detecting CUDA compile features - done
-- Looking for a HIP compiler
-- Looking for a HIP compiler - NOTFOUND
-- Configuring done (6.6s)
-- Generating done (0.0s)
-- Build files have been written to: /home/rick/ollama-issues/11515/ollama/build
$ cmake --build build
[  1%] Building C object ml/backend/ggml/ggml/src/CMakeFiles/ggml-base.dir/ggml.c.o
...
[ 27%] Building C object ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/ggml-cpu.c.o
[ 28%] Building CXX object ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/ggml-cpu.cpp.o
[ 28%] Building CXX object ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/ggml-cpu-aarch64.cpp.o
[ 29%] Building CXX object ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/ggml-cpu-hbm.cpp.o
[ 29%] Building C object ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/ggml-cpu-quants.c.o
[ 30%] Building CXX object ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/ggml-cpu-traits.cpp.o
[ 30%] Building CXX object ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/amx/amx.cpp.o
[ 31%] Building CXX object ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/amx/mmq.cpp.o
[ 31%] Building CXX object ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/binary-ops.cpp.o
[ 32%] Building CXX object ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/unary-ops.cpp.o
[ 32%] Building CXX object ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/vec.cpp.o
[ 33%] Building CXX object ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/ops.cpp.o
[ 33%] Building CXX object ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/llamafile/sgemm.cpp.o
[ 34%] Linking CXX shared module ../../../../../lib/ollama/libggml-cpu-haswell.so
[ 34%] Built target ggml-cpu-haswell
...
[100%] Linking CUDA shared module ../../../../../../lib/ollama/libggml-cuda.so
[100%] Built target ggml-cuda
$ OLLAMA_HOST=:11515 go run . serve
time=2025-07-25T00:46:23.768+02:00 level=INFO source=routes.go:1238 msg="server config" env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_CONTEXT_LENGTH:4096 OLLAMA_DEBUG:INFO OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://:11515 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE: OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/home/rick/.ollama/models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NEW_ENGINE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:1 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://* vscode-file://*] OLLAMA_SCHED_SPREAD:false ROCR_VISIBLE_DEVICES: http_proxy: https_proxy: no_proxy:]"

What steps were different in your download and compile? Full output of cmake -B build may shed some light.

<!-- gh-comment-id:3115230273 --> @rick-github commented on GitHub (Jul 24, 2025): ```console $ git clone https://github.com/ollama/ollama.git Cloning into 'ollama'... ... Resolving deltas: 100% (23190/23190), done. $ cd ollama $ cmake -B build -- The C compiler identification is GNU 13.2.0 -- The CXX compiler identification is GNU 13.2.0 -- Detecting C compiler ABI info -- Detecting C compiler ABI info - done -- Check for working C compiler: /usr/bin/cc - skipped -- Detecting C compile features -- Detecting C compile features - done -- Detecting CXX compiler ABI info -- Detecting CXX compiler ABI info - done -- Check for working CXX compiler: /usr/bin/c++ - skipped -- Detecting CXX compile features -- Detecting CXX compile features - done -- Performing Test CMAKE_HAVE_LIBC_PTHREAD -- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Success -- Found Threads: TRUE -- Warning: ccache not found - consider installing it for faster compilation or disable this warning with GGML_CCACHE=OFF -- CMAKE_SYSTEM_PROCESSOR: x86_64 -- Including CPU backend -- x86 detected -- Adding CPU backend variant ggml-cpu-x64: -- x86 detected -- Adding CPU backend variant ggml-cpu-sse42: -msse4.2 GGML_SSE42 -- x86 detected -- Adding CPU backend variant ggml-cpu-sandybridge: -msse4.2;-mavx GGML_SSE42;GGML_AVX -- x86 detected -- Adding CPU backend variant ggml-cpu-haswell: -msse4.2;-mf16c;-mfma;-mbmi2;-mavx;-mavx2 GGML_SSE42;GGML_F16C;GGML_FMA;GGML_BMI2;GGML_AVX;GGML_AVX2 -- x86 detected -- Adding CPU backend variant ggml-cpu-skylakex: -msse4.2;-mf16c;-mfma;-mbmi2;-mavx;-mavx2;-mavx512f;-mavx512cd;-mavx512vl;-mavx512dq;-mavx512bw GGML_SSE42;GGML_F16C;GGML_FMA;GGML_BMI2;GGML_AVX;GGML_AVX2;GGML_AVX512 -- x86 detected -- Adding CPU backend variant ggml-cpu-icelake: -msse4.2;-mf16c;-mfma;-mbmi2;-mavx;-mavx2;-mavx512f;-mavx512cd;-mavx512vl;-mavx512dq;-mavx512bw;-mavx512vbmi;-mavx512vnni GGML_SSE42;GGML_F16C;GGML_FMA;GGML_BMI2;GGML_AVX;GGML_AVX2;GGML_AVX512;GGML_AVX512_VBMI;GGML_AVX512_VNNI -- x86 detected -- Adding CPU backend variant ggml-cpu-alderlake: -msse4.2;-mf16c;-mfma;-mbmi2;-mavx;-mavx2;-mavxvnni GGML_SSE42;GGML_F16C;GGML_FMA;GGML_BMI2;GGML_AVX;GGML_AVX2;GGML_AVX_VNNI -- Looking for a CUDA compiler -- Looking for a CUDA compiler - /usr/bin/nvcc -- Found CUDAToolkit: /usr/include (found version "12.0.140") -- CUDA Toolkit found -- Using CUDA architectures: native -- The CUDA compiler identification is NVIDIA 12.0.140 -- Detecting CUDA compiler ABI info -- Detecting CUDA compiler ABI info - done -- Check for working CUDA compiler: /usr/bin/nvcc - skipped -- Detecting CUDA compile features -- Detecting CUDA compile features - done -- Looking for a HIP compiler -- Looking for a HIP compiler - NOTFOUND -- Configuring done (6.6s) -- Generating done (0.0s) -- Build files have been written to: /home/rick/ollama-issues/11515/ollama/build $ cmake --build build [ 1%] Building C object ml/backend/ggml/ggml/src/CMakeFiles/ggml-base.dir/ggml.c.o ... [ 27%] Building C object ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/ggml-cpu.c.o [ 28%] Building CXX object ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/ggml-cpu.cpp.o [ 28%] Building CXX object ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/ggml-cpu-aarch64.cpp.o [ 29%] Building CXX object ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/ggml-cpu-hbm.cpp.o [ 29%] Building C object ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/ggml-cpu-quants.c.o [ 30%] Building CXX object ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/ggml-cpu-traits.cpp.o [ 30%] Building CXX object ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/amx/amx.cpp.o [ 31%] Building CXX object ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/amx/mmq.cpp.o [ 31%] Building CXX object ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/binary-ops.cpp.o [ 32%] Building CXX object ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/unary-ops.cpp.o [ 32%] Building CXX object ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/vec.cpp.o [ 33%] Building CXX object ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/ops.cpp.o [ 33%] Building CXX object ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/llamafile/sgemm.cpp.o [ 34%] Linking CXX shared module ../../../../../lib/ollama/libggml-cpu-haswell.so [ 34%] Built target ggml-cpu-haswell ... [100%] Linking CUDA shared module ../../../../../../lib/ollama/libggml-cuda.so [100%] Built target ggml-cuda $ OLLAMA_HOST=:11515 go run . serve time=2025-07-25T00:46:23.768+02:00 level=INFO source=routes.go:1238 msg="server config" env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_CONTEXT_LENGTH:4096 OLLAMA_DEBUG:INFO OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://:11515 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE: OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/home/rick/.ollama/models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NEW_ENGINE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:1 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://* vscode-file://*] OLLAMA_SCHED_SPREAD:false ROCR_VISIBLE_DEVICES: http_proxy: https_proxy: no_proxy:]" ``` What steps were different in your download and compile? Full output of `cmake -B build` may shed some light.
Author
Owner

@abcbarryn commented on GitHub (Jul 25, 2025):

# cd /usr/src/ollama-main
amobile:/usr/src/ollama-main # cmake -B build
-- Warning: ccache not found - consider installing it for faster compilation or disable this warning with GGML_CCACHE=OFF
-- CMAKE_SYSTEM_PROCESSOR: x86_64
-- Including CPU backend
-- x86 detected
-- Adding CPU backend variant ggml-cpu-x64:
-- x86 detected
-- Adding CPU backend variant ggml-cpu-sse42: -msse4.2 GGML_SSE42
-- x86 detected
-- Adding CPU backend variant ggml-cpu-sandybridge: -msse4.2;-mavx GGML_SSE42;GGML_AVX
-- x86 detected
-- Adding CPU backend variant ggml-cpu-haswell: -msse4.2;-mf16c;-mfma;-mbmi2;-mavx;-mavx2 GGML_SSE42;GGML_F16C;GGML_FMA;GGML_BMI2;GGML_AVX;GGML_AVX2
-- x86 detected
-- Adding CPU backend variant ggml-cpu-skylakex: -msse4.2;-mf16c;-mfma;-mbmi2;-mavx;-mavx2;-mavx512f;-mavx512cd;-mavx512vl;-mavx512dq;-mavx512bw GGML_SSE42;GGML_F16C;GGML_FMA;GGML_BMI2;GGML_AVX;GGML_AVX2;GGML_AVX512
-- x86 detected
-- Adding CPU backend variant ggml-cpu-icelake: -msse4.2;-mf16c;-mfma;-mbmi2;-mavx;-mavx2;-mavx512f;-mavx512cd;-mavx512vl;-mavx512dq;-mavx512bw;-mavx512vbmi;-mavx512vnni GGML_SSE42;GGML_F16C;GGML_FMA;GGML_BMI2;GGML_AVX;GGML_AVX2;GGML_AVX512;GGML_AVX512_VBMI;GGML_AVX512_VNNI
-- x86 detected
-- Adding CPU backend variant ggml-cpu-alderlake: -msse4.2;-mf16c;-mfma;-mbmi2;-mavx;-mavx2;-mavxvnni GGML_SSE42;GGML_F16C;GGML_FMA;GGML_BMI2;GGML_AVX;GGML_AVX2;GGML_AVX_VNNI
-- CUDA Toolkit found
-- Using CUDA architectures: native
-- Configuring done (0.2s)
-- Generating done (0.1s)
-- Build files have been written to: /usr/src/ollama-main/build
amobile:/usr/src/ollama-main # cmake --build build
[  4%] Built target ggml-base
[  5%] Built target ggml-cpu-x64-feats
[ 12%] Built target ggml-cpu-x64
[ 12%] Built target ggml-cpu-sse42-feats
[ 19%] Built target ggml-cpu-sse42
[ 20%] Built target ggml-cpu-sandybridge-feats
[ 27%] Built target ggml-cpu-sandybridge
[ 27%] Built target ggml-cpu-haswell-feats
[ 27%] Building CXX object ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/ggml-cpu-aarch64.cpp.o
/usr/src/ollama-main/ml/backend/ggml/ggml/src/ggml-cpu/ggml-cpu-aarch64.cpp: In function ‘void ggml_gemm_q4_K_8x8_q8_K(int, float*, size_t, const void*, const void*, int, int)’:
/usr/src/ollama-main/ml/backend/ggml/ggml/src/ggml-cpu/ggml-cpu-aarch64.cpp:5111:54: error: ‘_mm256_set_m128’ was not declared in this scope
                         const __m256 row_scale_f32 = _mm256_set_m128(row_scale_f32_sse, row_scale_f32_sse);//GGML_F32Cx8_REPEAT_LOAD(a_ptrs[rp][b].d, loadMask);
                                                      ^~~~~~~~~~~~~~~
/usr/src/ollama-main/ml/backend/ggml/ggml/src/ggml-cpu/ggml-cpu-aarch64.cpp:5111:54: note: suggested alternative: ‘_mm256_set_epi8’
                         const __m256 row_scale_f32 = _mm256_set_m128(row_scale_f32_sse, row_scale_f32_sse);//GGML_F32Cx8_REPEAT_LOAD(a_ptrs[rp][b].d, loadMask);
                                                      ^~~~~~~~~~~~~~~
                                                      _mm256_set_epi8
/usr/src/ollama-main/ml/backend/ggml/ggml/src/ggml-cpu/ggml-cpu-aarch64.cpp:5441:50: error: ‘_mm256_set_m128’ was not declared in this scope
                     const __m256 row_scale_f32 = _mm256_set_m128(row_scale_f32_sse, row_scale_f32_sse); //GGML_F32Cx8_REPEAT_LOAD(a_ptrs[rp][b].d, loadMask);
                                                  ^~~~~~~~~~~~~~~
/usr/src/ollama-main/ml/backend/ggml/ggml/src/ggml-cpu/ggml-cpu-aarch64.cpp:5441:50: note: suggested alternative: ‘_mm256_set_epi8’
                     const __m256 row_scale_f32 = _mm256_set_m128(row_scale_f32_sse, row_scale_f32_sse); //GGML_F32Cx8_REPEAT_LOAD(a_ptrs[rp][b].d, loadMask);
                                                  ^~~~~~~~~~~~~~~
                                                  _mm256_set_epi8
gmake[2]: *** [ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/build.make:104: ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/ggml-cpu-aarch64.cpp.o] Error 1
gmake[1]: *** [CMakeFiles/Makefile2:415: ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/all] Error 2
gmake: *** [Makefile:136: all] Error 2
amobile:/usr/src/ollama-main # gcc --version
gcc (SUSE Linux) 14.2.0
Copyright (C) 2024 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
<!-- gh-comment-id:3115366759 --> @abcbarryn commented on GitHub (Jul 25, 2025): ``` # cd /usr/src/ollama-main amobile:/usr/src/ollama-main # cmake -B build -- Warning: ccache not found - consider installing it for faster compilation or disable this warning with GGML_CCACHE=OFF -- CMAKE_SYSTEM_PROCESSOR: x86_64 -- Including CPU backend -- x86 detected -- Adding CPU backend variant ggml-cpu-x64: -- x86 detected -- Adding CPU backend variant ggml-cpu-sse42: -msse4.2 GGML_SSE42 -- x86 detected -- Adding CPU backend variant ggml-cpu-sandybridge: -msse4.2;-mavx GGML_SSE42;GGML_AVX -- x86 detected -- Adding CPU backend variant ggml-cpu-haswell: -msse4.2;-mf16c;-mfma;-mbmi2;-mavx;-mavx2 GGML_SSE42;GGML_F16C;GGML_FMA;GGML_BMI2;GGML_AVX;GGML_AVX2 -- x86 detected -- Adding CPU backend variant ggml-cpu-skylakex: -msse4.2;-mf16c;-mfma;-mbmi2;-mavx;-mavx2;-mavx512f;-mavx512cd;-mavx512vl;-mavx512dq;-mavx512bw GGML_SSE42;GGML_F16C;GGML_FMA;GGML_BMI2;GGML_AVX;GGML_AVX2;GGML_AVX512 -- x86 detected -- Adding CPU backend variant ggml-cpu-icelake: -msse4.2;-mf16c;-mfma;-mbmi2;-mavx;-mavx2;-mavx512f;-mavx512cd;-mavx512vl;-mavx512dq;-mavx512bw;-mavx512vbmi;-mavx512vnni GGML_SSE42;GGML_F16C;GGML_FMA;GGML_BMI2;GGML_AVX;GGML_AVX2;GGML_AVX512;GGML_AVX512_VBMI;GGML_AVX512_VNNI -- x86 detected -- Adding CPU backend variant ggml-cpu-alderlake: -msse4.2;-mf16c;-mfma;-mbmi2;-mavx;-mavx2;-mavxvnni GGML_SSE42;GGML_F16C;GGML_FMA;GGML_BMI2;GGML_AVX;GGML_AVX2;GGML_AVX_VNNI -- CUDA Toolkit found -- Using CUDA architectures: native -- Configuring done (0.2s) -- Generating done (0.1s) -- Build files have been written to: /usr/src/ollama-main/build amobile:/usr/src/ollama-main # cmake --build build [ 4%] Built target ggml-base [ 5%] Built target ggml-cpu-x64-feats [ 12%] Built target ggml-cpu-x64 [ 12%] Built target ggml-cpu-sse42-feats [ 19%] Built target ggml-cpu-sse42 [ 20%] Built target ggml-cpu-sandybridge-feats [ 27%] Built target ggml-cpu-sandybridge [ 27%] Built target ggml-cpu-haswell-feats [ 27%] Building CXX object ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/ggml-cpu-aarch64.cpp.o /usr/src/ollama-main/ml/backend/ggml/ggml/src/ggml-cpu/ggml-cpu-aarch64.cpp: In function ‘void ggml_gemm_q4_K_8x8_q8_K(int, float*, size_t, const void*, const void*, int, int)’: /usr/src/ollama-main/ml/backend/ggml/ggml/src/ggml-cpu/ggml-cpu-aarch64.cpp:5111:54: error: ‘_mm256_set_m128’ was not declared in this scope const __m256 row_scale_f32 = _mm256_set_m128(row_scale_f32_sse, row_scale_f32_sse);//GGML_F32Cx8_REPEAT_LOAD(a_ptrs[rp][b].d, loadMask); ^~~~~~~~~~~~~~~ /usr/src/ollama-main/ml/backend/ggml/ggml/src/ggml-cpu/ggml-cpu-aarch64.cpp:5111:54: note: suggested alternative: ‘_mm256_set_epi8’ const __m256 row_scale_f32 = _mm256_set_m128(row_scale_f32_sse, row_scale_f32_sse);//GGML_F32Cx8_REPEAT_LOAD(a_ptrs[rp][b].d, loadMask); ^~~~~~~~~~~~~~~ _mm256_set_epi8 /usr/src/ollama-main/ml/backend/ggml/ggml/src/ggml-cpu/ggml-cpu-aarch64.cpp:5441:50: error: ‘_mm256_set_m128’ was not declared in this scope const __m256 row_scale_f32 = _mm256_set_m128(row_scale_f32_sse, row_scale_f32_sse); //GGML_F32Cx8_REPEAT_LOAD(a_ptrs[rp][b].d, loadMask); ^~~~~~~~~~~~~~~ /usr/src/ollama-main/ml/backend/ggml/ggml/src/ggml-cpu/ggml-cpu-aarch64.cpp:5441:50: note: suggested alternative: ‘_mm256_set_epi8’ const __m256 row_scale_f32 = _mm256_set_m128(row_scale_f32_sse, row_scale_f32_sse); //GGML_F32Cx8_REPEAT_LOAD(a_ptrs[rp][b].d, loadMask); ^~~~~~~~~~~~~~~ _mm256_set_epi8 gmake[2]: *** [ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/build.make:104: ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/ggml-cpu-aarch64.cpp.o] Error 1 gmake[1]: *** [CMakeFiles/Makefile2:415: ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/all] Error 2 gmake: *** [Makefile:136: all] Error 2 ``` ``` amobile:/usr/src/ollama-main # gcc --version gcc (SUSE Linux) 14.2.0 Copyright (C) 2024 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. ```
Author
Owner

@abcbarryn commented on GitHub (Jul 25, 2025):

amobile:/usr/src/ollama-main # go version
go version go1.24.5 linux/amd64
amobile:/usr/src/ollama-main # cat /etc/os-release
NAME="openSUSE Leap"
VERSION="15.6"
ID="opensuse-leap"
ID_LIKE="suse opensuse"
VERSION_ID="15.6"
PRETTY_NAME="openSUSE Leap 15.6"
ANSI_COLOR="0;32"
CPE_NAME="cpe:/o:opensuse:leap:15.6"
BUG_REPORT_URL="https://bugs.opensuse.org"
HOME_URL="https://www.opensuse.org/"
DOCUMENTATION_URL="https://en.opensuse.org/Portal:Leap"
LOGO="distributor-logo-Leap"
<!-- gh-comment-id:3115368354 --> @abcbarryn commented on GitHub (Jul 25, 2025): ``` amobile:/usr/src/ollama-main # go version go version go1.24.5 linux/amd64 amobile:/usr/src/ollama-main # cat /etc/os-release NAME="openSUSE Leap" VERSION="15.6" ID="opensuse-leap" ID_LIKE="suse opensuse" VERSION_ID="15.6" PRETTY_NAME="openSUSE Leap 15.6" ANSI_COLOR="0;32" CPE_NAME="cpe:/o:opensuse:leap:15.6" BUG_REPORT_URL="https://bugs.opensuse.org" HOME_URL="https://www.opensuse.org/" DOCUMENTATION_URL="https://en.opensuse.org/Portal:Leap" LOGO="distributor-logo-Leap" ```
Author
Owner

@rick-github commented on GitHub (Jul 25, 2025):

Builds fine with g++-14 here:

$ CC=gcc-14 CXX=g++-14 cmake -B build --fresh
-- The C compiler identification is GNU 14.2.0
-- The CXX compiler identification is GNU 14.2.0
...
-- Build files have been written to: /home/rick/ollama-issues/11515/ollama/build
$ cmake --build build
[  1%] Building C object ml/backend/ggml/ggml/src/CMakeFiles/ggml-base.dir/ggml.c.o
...
[100%] Built target ggml-cuda
$ OLLAMA_HOST=:11515 go run . serve
time=2025-07-25T02:46:35.448+02:00 level=INFO source=routes.go:1238 msg="server config" env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_CONTEXT_LENGTH:4096 OLLAMA_DEBUG:INFO OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://:11515 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE: OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/home/rick/.ollama/models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NEW_ENGINE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:1 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://* vscode-file://*] OLLAMA_SCHED_SPREAD:false ROCR_VISIBLE_DEVICES: http_proxy: https_proxy: no_proxy:]"

Perhaps re-install g++-14, or try with g++-13/gcc-13.

<!-- gh-comment-id:3115433311 --> @rick-github commented on GitHub (Jul 25, 2025): Builds fine with g++-14 here: ```console $ CC=gcc-14 CXX=g++-14 cmake -B build --fresh -- The C compiler identification is GNU 14.2.0 -- The CXX compiler identification is GNU 14.2.0 ... -- Build files have been written to: /home/rick/ollama-issues/11515/ollama/build $ cmake --build build [ 1%] Building C object ml/backend/ggml/ggml/src/CMakeFiles/ggml-base.dir/ggml.c.o ... [100%] Built target ggml-cuda $ OLLAMA_HOST=:11515 go run . serve time=2025-07-25T02:46:35.448+02:00 level=INFO source=routes.go:1238 msg="server config" env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_CONTEXT_LENGTH:4096 OLLAMA_DEBUG:INFO OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://:11515 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE: OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/home/rick/.ollama/models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NEW_ENGINE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:1 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://* vscode-file://*] OLLAMA_SCHED_SPREAD:false ROCR_VISIBLE_DEVICES: http_proxy: https_proxy: no_proxy:]" ``` Perhaps re-install g++-14, or try with g++-13/gcc-13.
Author
Owner

@abcbarryn commented on GitHub (Jul 25, 2025):

The gcc14 is a fresh install. It works for other projects.

<!-- gh-comment-id:3115444224 --> @abcbarryn commented on GitHub (Jul 25, 2025): The gcc14 is a fresh install. It works for other projects.
Author
Owner

@abcbarryn commented on GitHub (Aug 11, 2025):

How about some help here rather than just closing the ticket as "not planned"? What exactly is not planned? Do you not plan to resolve compile issues? Is this software no longer supported? I have a full fresh install of GCC 14, gcc version 14.2.0 (SUSE Linux)

gcc14-d-14.2.0+git10526-150000.1.6.1.x86_64
libubsan1-14.2.0+git10526-150000.1.6.1.x86_64
gcc14-PIE-14.2.0+git10526-150000.1.6.1.x86_64
libasan8-14.2.0+git10526-150000.1.6.1.x86_64
libgomp1-14.2.0+git10526-150000.1.6.1.x86_64
libtsan2-14.2.0+git10526-150000.1.6.1.x86_64
libquadmath0-14.2.0+git10526-150000.1.6.1.x86_64
libm2iso19-14.2.0+git10526-150000.1.6.1.x86_64
libstdc++6-14.2.0+git10526-150000.1.6.1.x86_64
gcc14-ada-14.2.0+git10526-150000.1.6.1.x86_64
libstdc++6-devel-gcc14-14.2.0+git10526-150000.1.6.1.x86_64
liblsan0-14.2.0+git10526-150000.1.6.1.x86_64
libm2min19-14.2.0+git10526-150000.1.6.1.x86_64
libatomic1-14.2.0+git10526-150000.1.6.1.x86_64
libm2cor19-14.2.0+git10526-150000.1.6.1.x86_64
libgo23-14.2.0+git10526-150000.1.6.1.x86_64
libitm1-14.2.0+git10526-150000.1.6.1.x86_64
libm2log19-14.2.0+git10526-150000.1.6.1.x86_64
gdb-14.2-150400.15.23.1.x86_64
libhwasan0-14.2.0+git10526-150000.1.6.1.x86_64
libgfortran5-14.2.0+git10526-150000.1.6.1.x86_64
gcc14-m2-14.2.0+git10526-150000.1.6.1.x86_64
gcc14-fortran-14.2.0+git10526-150000.1.6.1.x86_64
libada14-14.2.0+git10526-150000.1.6.1.x86_64
gcc14-14.2.0+git10526-150000.1.6.1.x86_64
libgphobos5-14.2.0+git10526-150000.1.6.1.x86_64
gcc14-objc-14.2.0+git10526-150000.1.6.1.x86_64
gcc14-info-14.2.0+git10526-150000.1.6.1.noarch
libobjc4-14.2.0+git10526-150000.1.6.1.x86_64
libstdc++6-pp-14.2.0+git10526-150000.1.6.1.x86_64
libquadmath0-devel-gcc14-14.2.0+git10526-150000.1.6.1.x86_64
gcc14-go-14.2.0+git10526-150000.1.6.1.x86_64
gcc14-locale-14.2.0+git10526-150000.1.6.1.x86_64
gcc14-c++-14.2.0+git10526-150000.1.6.1.x86_64
cpp14-14.2.0+git10526-150000.1.6.1.x86_64
gcc14-obj-c++-14.2.0+git10526-150000.1.6.1.x86_64
libgcc_s1-14.2.0+git10526-150000.1.6.1.x86_64

<!-- gh-comment-id:3177201649 --> @abcbarryn commented on GitHub (Aug 11, 2025): How about some help here rather than just closing the ticket as "not planned"? What exactly is not planned? Do you not plan to resolve compile issues? Is this software no longer supported? I have a full fresh install of GCC 14, gcc version 14.2.0 (SUSE Linux) gcc14-d-14.2.0+git10526-150000.1.6.1.x86_64 libubsan1-14.2.0+git10526-150000.1.6.1.x86_64 gcc14-PIE-14.2.0+git10526-150000.1.6.1.x86_64 libasan8-14.2.0+git10526-150000.1.6.1.x86_64 libgomp1-14.2.0+git10526-150000.1.6.1.x86_64 libtsan2-14.2.0+git10526-150000.1.6.1.x86_64 libquadmath0-14.2.0+git10526-150000.1.6.1.x86_64 libm2iso19-14.2.0+git10526-150000.1.6.1.x86_64 libstdc++6-14.2.0+git10526-150000.1.6.1.x86_64 gcc14-ada-14.2.0+git10526-150000.1.6.1.x86_64 libstdc++6-devel-gcc14-14.2.0+git10526-150000.1.6.1.x86_64 liblsan0-14.2.0+git10526-150000.1.6.1.x86_64 libm2min19-14.2.0+git10526-150000.1.6.1.x86_64 libatomic1-14.2.0+git10526-150000.1.6.1.x86_64 libm2cor19-14.2.0+git10526-150000.1.6.1.x86_64 libgo23-14.2.0+git10526-150000.1.6.1.x86_64 libitm1-14.2.0+git10526-150000.1.6.1.x86_64 libm2log19-14.2.0+git10526-150000.1.6.1.x86_64 gdb-14.2-150400.15.23.1.x86_64 libhwasan0-14.2.0+git10526-150000.1.6.1.x86_64 libgfortran5-14.2.0+git10526-150000.1.6.1.x86_64 gcc14-m2-14.2.0+git10526-150000.1.6.1.x86_64 gcc14-fortran-14.2.0+git10526-150000.1.6.1.x86_64 libada14-14.2.0+git10526-150000.1.6.1.x86_64 gcc14-14.2.0+git10526-150000.1.6.1.x86_64 libgphobos5-14.2.0+git10526-150000.1.6.1.x86_64 gcc14-objc-14.2.0+git10526-150000.1.6.1.x86_64 gcc14-info-14.2.0+git10526-150000.1.6.1.noarch libobjc4-14.2.0+git10526-150000.1.6.1.x86_64 libstdc++6-pp-14.2.0+git10526-150000.1.6.1.x86_64 libquadmath0-devel-gcc14-14.2.0+git10526-150000.1.6.1.x86_64 gcc14-go-14.2.0+git10526-150000.1.6.1.x86_64 gcc14-locale-14.2.0+git10526-150000.1.6.1.x86_64 gcc14-c++-14.2.0+git10526-150000.1.6.1.x86_64 cpp14-14.2.0+git10526-150000.1.6.1.x86_64 gcc14-obj-c++-14.2.0+git10526-150000.1.6.1.x86_64 libgcc_s1-14.2.0+git10526-150000.1.6.1.x86_64
Author
Owner

@rick-github commented on GitHub (Aug 11, 2025):

I suggested reinstalling g++-14 and you made no comment on that for 3 weeks, so the issue seemed stale. My attempts at replication failed, indicating a problem with your specific environment. If you don't want to work at resolving the issue, there's not much I can do.

<!-- gh-comment-id:3177234846 --> @rick-github commented on GitHub (Aug 11, 2025): I suggested reinstalling g++-14 and you made no comment on that for 3 weeks, so the issue seemed stale. My attempts at replication failed, indicating a problem with your specific environment. If you don't want to work at resolving the issue, there's not much I can do.
Author
Owner

@abcbarryn commented on GitHub (Aug 12, 2025):

Ok, let me be clear. I did reinstall. I suspect an incompatibility with the header files used by ggml-cpu-aarch64.cpp. I think aarch64 is an architecture I am not even using. My system is intel x86_64, but it is trying build ggml-cpu-aarch64.cpp anyway and breaking the build process.

<!-- gh-comment-id:3177602709 --> @abcbarryn commented on GitHub (Aug 12, 2025): Ok, let me be clear. I did reinstall. I suspect an incompatibility with the header files used by ggml-cpu-aarch64.cpp. I think aarch64 is an architecture I am not even using. My system is intel x86_64, but it is trying build ggml-cpu-aarch64.cpp anyway and breaking the build process.
Author
Owner

@rick-github commented on GitHub (Aug 12, 2025):

The replication tests done above were also done on x86_64 machines.

What's the output of:

lscpu

Let's also verify that the compiler can handle the code that the ollama compile fails on. Copy&paste the following into a terminal session and post the result:

cat > /tmp/x.cpp <<EOF
#include <immintrin.h>

void func(void) {
  const __m256 row_scale_f32_ymm = _mm256_set_m128(_mm_load_ps(0), _mm_load_ps(0));
}
EOF
g++-14 -mavx -c -o /tmp/x.o /tmp/x.cpp && objdump -D /tmp/x.o

And then try:

g++-14 -msse4.2 -mf16c -mfma -mbmi2 -mavx -mavx2 -c -o /tmp/x.o /tmp/x.cpp && objdump -D /tmp/x.o

<!-- gh-comment-id:3179827319 --> @rick-github commented on GitHub (Aug 12, 2025): The replication tests done above were also done on x86_64 machines. What's the output of: ``` lscpu ``` Let's also verify that the compiler can handle the code that the ollama compile fails on. Copy&paste the following into a terminal session and post the result: ```console cat > /tmp/x.cpp <<EOF #include <immintrin.h> void func(void) { const __m256 row_scale_f32_ymm = _mm256_set_m128(_mm_load_ps(0), _mm_load_ps(0)); } EOF g++-14 -mavx -c -o /tmp/x.o /tmp/x.cpp && objdump -D /tmp/x.o ``` And then try: ```console g++-14 -msse4.2 -mf16c -mfma -mbmi2 -mavx -mavx2 -c -o /tmp/x.o /tmp/x.cpp && objdump -D /tmp/x.o ```
Author
Owner

@abcbarryn commented on GitHub (Aug 13, 2025):

# lscpu
Architecture:            x86_64
  CPU op-mode(s):        32-bit, 64-bit
  Address sizes:         46 bits physical, 48 bits virtual
  Byte Order:            Little Endian
CPU(s):                  56
  On-line CPU(s) list:   0-55
Vendor ID:               GenuineIntel
  Model name:            Intel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz
    CPU family:          6
    Model:               79
    Thread(s) per core:  2
    Core(s) per socket:  14
    Socket(s):           2
    Stepping:            1
    CPU(s) scaling MHz:  40%
    CPU max MHz:         3300.0000
    CPU min MHz:         1200.0000
    BogoMIPS:            4794.37
    Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mc
                         a cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss
                         ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arc
                         h_perfmon pebs bts rep_good nopl xtopology nonstop_tsc
                         cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vm
                         x smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca ss
                         e4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes
                         xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_f
                         ault epb cat_l3 cdp_l3 invpcid_single pti intel_ppin ss
                         bd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpi
                         d ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 er
                         ms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsave
                         opt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local d
                         therm ida arat pln pts md_clear flush_l1d
Virtualization features:
  Virtualization:        VT-x
Caches (sum of all):
  L1d:                   896 KiB (28 instances)
  L1i:                   896 KiB (28 instances)
  L2:                    7 MiB (28 instances)
  L3:                    70 MiB (2 instances)
NUMA:
  NUMA node(s):          2
  NUMA node0 CPU(s):     0-13,28-41
  NUMA node1 CPU(s):     14-27,42-55
Vulnerabilities:
  Itlb multihit:         KVM: Mitigation: VMX disabled
  L1tf:                  Mitigation; PTE Inversion; VMX conditional cache flushe
                         s, SMT vulnerable
  Mds:                   Mitigation; Clear CPU buffers; SMT vulnerable
  Meltdown:              Mitigation; PTI
  Mmio stale data:       Mitigation; Clear CPU buffers; SMT vulnerable
  Retbleed:              Not affected
  Spec store bypass:     Mitigation; Speculative Store Bypass disabled via prctl
  Spectre v1:            Mitigation; usercopy/swapgs barriers and __user pointer
                          sanitization
  Spectre v2:            Mitigation; Retpolines, IBPB conditional, IBRS_FW, STIB
                         P conditional, RSB filling, PBRSB-eIBRS Not affected
  Srbds:                 Not affected
  Tsx async abort:       Mitigation; Clear CPU buffers; SMT vulnerable
# cat > /tmp/x.c <<EOF
> #include <immintrin.h>
>
> void func(void) {
>   const __m256 row_scale_f32_ymm = _mm256_set_m128(_mm_load_ps(0), _mm_load_ps(0));
> }
> EOF
# g++-14 -mavx -c -o /tmp/x.o /tmp/x.c && echo OK
OK
<!-- gh-comment-id:3184892795 --> @abcbarryn commented on GitHub (Aug 13, 2025): ``` # lscpu Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Address sizes: 46 bits physical, 48 bits virtual Byte Order: Little Endian CPU(s): 56 On-line CPU(s) list: 0-55 Vendor ID: GenuineIntel Model name: Intel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz CPU family: 6 Model: 79 Thread(s) per core: 2 Core(s) per socket: 14 Socket(s): 2 Stepping: 1 CPU(s) scaling MHz: 40% CPU max MHz: 3300.0000 CPU min MHz: 1200.0000 BogoMIPS: 4794.37 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mc a cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arc h_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vm x smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca ss e4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_f ault epb cat_l3 cdp_l3 invpcid_single pti intel_ppin ss bd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpi d ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 er ms invpcid rtm cqm rdt_a rdseed adx smap intel_pt xsave opt cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local d therm ida arat pln pts md_clear flush_l1d Virtualization features: Virtualization: VT-x Caches (sum of all): L1d: 896 KiB (28 instances) L1i: 896 KiB (28 instances) L2: 7 MiB (28 instances) L3: 70 MiB (2 instances) NUMA: NUMA node(s): 2 NUMA node0 CPU(s): 0-13,28-41 NUMA node1 CPU(s): 14-27,42-55 Vulnerabilities: Itlb multihit: KVM: Mitigation: VMX disabled L1tf: Mitigation; PTE Inversion; VMX conditional cache flushe s, SMT vulnerable Mds: Mitigation; Clear CPU buffers; SMT vulnerable Meltdown: Mitigation; PTI Mmio stale data: Mitigation; Clear CPU buffers; SMT vulnerable Retbleed: Not affected Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization Spectre v2: Mitigation; Retpolines, IBPB conditional, IBRS_FW, STIB P conditional, RSB filling, PBRSB-eIBRS Not affected Srbds: Not affected Tsx async abort: Mitigation; Clear CPU buffers; SMT vulnerable ``` ``` # cat > /tmp/x.c <<EOF > #include <immintrin.h> > > void func(void) { > const __m256 row_scale_f32_ymm = _mm256_set_m128(_mm_load_ps(0), _mm_load_ps(0)); > } > EOF # g++-14 -mavx -c -o /tmp/x.o /tmp/x.c && echo OK OK ```
Author
Owner

@rick-github commented on GitHub (Aug 13, 2025):

g++-14 -mavx -c -o /tmp/x.o /tmp/x.c && objdump -xsd /tmp/x.o
g++-14 -msse4.2 -mf16c -mfma -mbmi2 -mavx -mavx2 -c -o /tmp/x.o /tmp/x.c && objdump -xsd /tmp/x.o
<!-- gh-comment-id:3184934761 --> @rick-github commented on GitHub (Aug 13, 2025): ``` g++-14 -mavx -c -o /tmp/x.o /tmp/x.c && objdump -xsd /tmp/x.o ``` ``` g++-14 -msse4.2 -mf16c -mfma -mbmi2 -mavx -mavx2 -c -o /tmp/x.o /tmp/x.c && objdump -xsd /tmp/x.o ```
Author
Owner

@rick-github commented on GitHub (Aug 13, 2025):

The contents of ./build/CMakeCache.txt may also be useful, and the output of

objdump -s -j .comment build/ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/ggml-cpu.cpp.o

<!-- gh-comment-id:3185002751 --> @rick-github commented on GitHub (Aug 13, 2025): The contents of `./build/CMakeCache.txt` may also be useful, and the output of ``` objdump -s -j .comment build/ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/ggml-cpu.cpp.o ```
Author
Owner

@abcbarryn commented on GitHub (Aug 14, 2025):

# cat > /tmp/x.cpp <<EOF
> #include <immintrin.h>
>
> void func(void) {
>   const __m256 row_scale_f32_ymm = _mm256_set_m128(_mm_load_ps(0), _mm_load_ps(0));
> }
> EOF
# g++-14 -mavx -c -o /tmp/x.o /tmp/x.cpp && objdump -D /tmp/x.o

/tmp/x.o:     file format elf64-x86-64


Disassembly of section .text:

0000000000000000 <_Z4funcv>:
   0:   55                      push   %rbp
   1:   48 89 e5                mov    %rsp,%rbp
   4:   48 83 e4 e0             and    $0xffffffffffffffe0,%rsp
   8:   48 c7 44 24 a0 00 00    movq   $0x0,-0x60(%rsp)
   f:   00 00
  11:   48 8b 44 24 a0          mov    -0x60(%rsp),%rax
  16:   c5 f8 28 00             vmovaps (%rax),%xmm0
  1a:   48 c7 44 24 a8 00 00    movq   $0x0,-0x58(%rsp)
  21:   00 00
  23:   48 8b 44 24 a8          mov    -0x58(%rsp),%rax
  28:   c5 f8 28 08             vmovaps (%rax),%xmm1
  2c:   c5 f8 29 4c 24 d0       vmovaps %xmm1,-0x30(%rsp)
  32:   c5 f8 29 44 24 c0       vmovaps %xmm0,-0x40(%rsp)
  38:   c5 f8 28 44 24 c0       vmovaps -0x40(%rsp),%xmm0
  3e:   c5 f8 29 44 24 b0       vmovaps %xmm0,-0x50(%rsp)
  44:   c5 f8 28 44 24 b0       vmovaps -0x50(%rsp),%xmm0
  4a:   90                      nop
  4b:   c4 e3 7d 18 44 24 d0    vinsertf128 $0x1,-0x30(%rsp),%ymm0,%ymm0
  52:   01
  53:   c5 fc 29 44 24 e0       vmovaps %ymm0,-0x20(%rsp)
  59:   90                      nop
  5a:   c9                      leave
  5b:   c3                      ret

Disassembly of section .comment:

0000000000000000 <.comment>:
   0:   00 47 43                add    %al,0x43(%rdi)
   3:   43 3a 20                rex.XB cmp (%r8),%spl
   6:   28 53 55                sub    %dl,0x55(%rbx)
   9:   53                      push   %rbx
   a:   45 20 4c 69 6e          and    %r9b,0x6e(%r9,%rbp,2)
   f:   75 78                   jne    89 <_Z4funcv+0x89>
  11:   29 20                   sub    %esp,(%rax)
  13:   31 34 2e                xor    %esi,(%rsi,%rbp,1)
  16:   32 2e                   xor    (%rsi),%ch
  18:   30 00                   xor    %al,(%rax)

Disassembly of section .eh_frame:

0000000000000000 <.eh_frame>:
   0:   14 00                   adc    $0x0,%al
   2:   00 00                   add    %al,(%rax)
   4:   00 00                   add    %al,(%rax)
   6:   00 00                   add    %al,(%rax)
   8:   01 7a 52                add    %edi,0x52(%rdx)
   b:   00 01                   add    %al,(%rcx)
   d:   78 10                   js     1f <.eh_frame+0x1f>
   f:   01 1b                   add    %ebx,(%rbx)
  11:   0c 07                   or     $0x7,%al
  13:   08 90 01 00 00 1c       or     %dl,0x1c000001(%rax)
  19:   00 00                   add    %al,(%rax)
  1b:   00 1c 00                add    %bl,(%rax,%rax,1)
  1e:   00 00                   add    %al,(%rax)
  20:   00 00                   add    %al,(%rax)
  22:   00 00                   add    %al,(%rax)
  24:   5c                      pop    %rsp
  25:   00 00                   add    %al,(%rax)
  27:   00 00                   add    %al,(%rax)
  29:   41 0e                   rex.B (bad)
  2b:   10 86 02 43 0d 06       adc    %al,0x60d4302(%rsi)
  31:   02 57 0c                add    0xc(%rdi),%dl
  34:   07                      (bad)
  35:   08 00                   or     %al,(%rax)
    ...
<!-- gh-comment-id:3189066751 --> @abcbarryn commented on GitHub (Aug 14, 2025): ``` # cat > /tmp/x.cpp <<EOF > #include <immintrin.h> > > void func(void) { > const __m256 row_scale_f32_ymm = _mm256_set_m128(_mm_load_ps(0), _mm_load_ps(0)); > } > EOF # g++-14 -mavx -c -o /tmp/x.o /tmp/x.cpp && objdump -D /tmp/x.o /tmp/x.o: file format elf64-x86-64 Disassembly of section .text: 0000000000000000 <_Z4funcv>: 0: 55 push %rbp 1: 48 89 e5 mov %rsp,%rbp 4: 48 83 e4 e0 and $0xffffffffffffffe0,%rsp 8: 48 c7 44 24 a0 00 00 movq $0x0,-0x60(%rsp) f: 00 00 11: 48 8b 44 24 a0 mov -0x60(%rsp),%rax 16: c5 f8 28 00 vmovaps (%rax),%xmm0 1a: 48 c7 44 24 a8 00 00 movq $0x0,-0x58(%rsp) 21: 00 00 23: 48 8b 44 24 a8 mov -0x58(%rsp),%rax 28: c5 f8 28 08 vmovaps (%rax),%xmm1 2c: c5 f8 29 4c 24 d0 vmovaps %xmm1,-0x30(%rsp) 32: c5 f8 29 44 24 c0 vmovaps %xmm0,-0x40(%rsp) 38: c5 f8 28 44 24 c0 vmovaps -0x40(%rsp),%xmm0 3e: c5 f8 29 44 24 b0 vmovaps %xmm0,-0x50(%rsp) 44: c5 f8 28 44 24 b0 vmovaps -0x50(%rsp),%xmm0 4a: 90 nop 4b: c4 e3 7d 18 44 24 d0 vinsertf128 $0x1,-0x30(%rsp),%ymm0,%ymm0 52: 01 53: c5 fc 29 44 24 e0 vmovaps %ymm0,-0x20(%rsp) 59: 90 nop 5a: c9 leave 5b: c3 ret Disassembly of section .comment: 0000000000000000 <.comment>: 0: 00 47 43 add %al,0x43(%rdi) 3: 43 3a 20 rex.XB cmp (%r8),%spl 6: 28 53 55 sub %dl,0x55(%rbx) 9: 53 push %rbx a: 45 20 4c 69 6e and %r9b,0x6e(%r9,%rbp,2) f: 75 78 jne 89 <_Z4funcv+0x89> 11: 29 20 sub %esp,(%rax) 13: 31 34 2e xor %esi,(%rsi,%rbp,1) 16: 32 2e xor (%rsi),%ch 18: 30 00 xor %al,(%rax) Disassembly of section .eh_frame: 0000000000000000 <.eh_frame>: 0: 14 00 adc $0x0,%al 2: 00 00 add %al,(%rax) 4: 00 00 add %al,(%rax) 6: 00 00 add %al,(%rax) 8: 01 7a 52 add %edi,0x52(%rdx) b: 00 01 add %al,(%rcx) d: 78 10 js 1f <.eh_frame+0x1f> f: 01 1b add %ebx,(%rbx) 11: 0c 07 or $0x7,%al 13: 08 90 01 00 00 1c or %dl,0x1c000001(%rax) 19: 00 00 add %al,(%rax) 1b: 00 1c 00 add %bl,(%rax,%rax,1) 1e: 00 00 add %al,(%rax) 20: 00 00 add %al,(%rax) 22: 00 00 add %al,(%rax) 24: 5c pop %rsp 25: 00 00 add %al,(%rax) 27: 00 00 add %al,(%rax) 29: 41 0e rex.B (bad) 2b: 10 86 02 43 0d 06 adc %al,0x60d4302(%rsi) 31: 02 57 0c add 0xc(%rdi),%dl 34: 07 (bad) 35: 08 00 or %al,(%rax) ``` ...
Author
Owner

@abcbarryn commented on GitHub (Aug 14, 2025):

# g++-14 -msse4.2 -mf16c -mfma -mbmi2 -mavx -mavx2 -c -o /tmp/x.o /tmp/x.cpp && objdump -D /tmp/x.o

/tmp/x.o:     file format elf64-x86-64


Disassembly of section .text:

0000000000000000 <_Z4funcv>:
   0:   55                      push   %rbp
   1:   48 89 e5                mov    %rsp,%rbp
   4:   48 83 e4 e0             and    $0xffffffffffffffe0,%rsp
   8:   48 c7 44 24 a0 00 00    movq   $0x0,-0x60(%rsp)
   f:   00 00
  11:   48 8b 44 24 a0          mov    -0x60(%rsp),%rax
  16:   c5 f8 28 00             vmovaps (%rax),%xmm0
  1a:   48 c7 44 24 a8 00 00    movq   $0x0,-0x58(%rsp)
  21:   00 00
  23:   48 8b 44 24 a8          mov    -0x58(%rsp),%rax
  28:   c5 f8 28 08             vmovaps (%rax),%xmm1
  2c:   c5 f8 29 4c 24 d0       vmovaps %xmm1,-0x30(%rsp)
  32:   c5 f8 29 44 24 c0       vmovaps %xmm0,-0x40(%rsp)
  38:   c5 f8 28 44 24 c0       vmovaps -0x40(%rsp),%xmm0
  3e:   c5 f8 29 44 24 b0       vmovaps %xmm0,-0x50(%rsp)
  44:   c5 f8 28 44 24 b0       vmovaps -0x50(%rsp),%xmm0
  4a:   90                      nop
  4b:   c4 e3 7d 18 44 24 d0    vinsertf128 $0x1,-0x30(%rsp),%ymm0,%ymm0
  52:   01
  53:   c5 fc 29 44 24 e0       vmovaps %ymm0,-0x20(%rsp)
  59:   90                      nop
  5a:   c9                      leave
  5b:   c3                      ret

Disassembly of section .comment:

0000000000000000 <.comment>:
   0:   00 47 43                add    %al,0x43(%rdi)
   3:   43 3a 20                rex.XB cmp (%r8),%spl
   6:   28 53 55                sub    %dl,0x55(%rbx)
   9:   53                      push   %rbx
   a:   45 20 4c 69 6e          and    %r9b,0x6e(%r9,%rbp,2)
   f:   75 78                   jne    89 <_Z4funcv+0x89>
  11:   29 20                   sub    %esp,(%rax)
  13:   31 34 2e                xor    %esi,(%rsi,%rbp,1)
  16:   32 2e                   xor    (%rsi),%ch
  18:   30 00                   xor    %al,(%rax)

Disassembly of section .eh_frame:

0000000000000000 <.eh_frame>:
   0:   14 00                   adc    $0x0,%al
   2:   00 00                   add    %al,(%rax)
   4:   00 00                   add    %al,(%rax)
   6:   00 00                   add    %al,(%rax)
   8:   01 7a 52                add    %edi,0x52(%rdx)
   b:   00 01                   add    %al,(%rcx)
   d:   78 10                   js     1f <.eh_frame+0x1f>
   f:   01 1b                   add    %ebx,(%rbx)
  11:   0c 07                   or     $0x7,%al
  13:   08 90 01 00 00 1c       or     %dl,0x1c000001(%rax)
  19:   00 00                   add    %al,(%rax)
  1b:   00 1c 00                add    %bl,(%rax,%rax,1)
  1e:   00 00                   add    %al,(%rax)
  20:   00 00                   add    %al,(%rax)
  22:   00 00                   add    %al,(%rax)
  24:   5c                      pop    %rsp
  25:   00 00                   add    %al,(%rax)
  27:   00 00                   add    %al,(%rax)
  29:   41 0e                   rex.B (bad)
  2b:   10 86 02 43 0d 06       adc    %al,0x60d4302(%rsi)
  31:   02 57 0c                add    0xc(%rdi),%dl
  34:   07                      (bad)
  35:   08 00                   or     %al,(%rax)
        ...
<!-- gh-comment-id:3189075425 --> @abcbarryn commented on GitHub (Aug 14, 2025): ``` # g++-14 -msse4.2 -mf16c -mfma -mbmi2 -mavx -mavx2 -c -o /tmp/x.o /tmp/x.cpp && objdump -D /tmp/x.o /tmp/x.o: file format elf64-x86-64 Disassembly of section .text: 0000000000000000 <_Z4funcv>: 0: 55 push %rbp 1: 48 89 e5 mov %rsp,%rbp 4: 48 83 e4 e0 and $0xffffffffffffffe0,%rsp 8: 48 c7 44 24 a0 00 00 movq $0x0,-0x60(%rsp) f: 00 00 11: 48 8b 44 24 a0 mov -0x60(%rsp),%rax 16: c5 f8 28 00 vmovaps (%rax),%xmm0 1a: 48 c7 44 24 a8 00 00 movq $0x0,-0x58(%rsp) 21: 00 00 23: 48 8b 44 24 a8 mov -0x58(%rsp),%rax 28: c5 f8 28 08 vmovaps (%rax),%xmm1 2c: c5 f8 29 4c 24 d0 vmovaps %xmm1,-0x30(%rsp) 32: c5 f8 29 44 24 c0 vmovaps %xmm0,-0x40(%rsp) 38: c5 f8 28 44 24 c0 vmovaps -0x40(%rsp),%xmm0 3e: c5 f8 29 44 24 b0 vmovaps %xmm0,-0x50(%rsp) 44: c5 f8 28 44 24 b0 vmovaps -0x50(%rsp),%xmm0 4a: 90 nop 4b: c4 e3 7d 18 44 24 d0 vinsertf128 $0x1,-0x30(%rsp),%ymm0,%ymm0 52: 01 53: c5 fc 29 44 24 e0 vmovaps %ymm0,-0x20(%rsp) 59: 90 nop 5a: c9 leave 5b: c3 ret Disassembly of section .comment: 0000000000000000 <.comment>: 0: 00 47 43 add %al,0x43(%rdi) 3: 43 3a 20 rex.XB cmp (%r8),%spl 6: 28 53 55 sub %dl,0x55(%rbx) 9: 53 push %rbx a: 45 20 4c 69 6e and %r9b,0x6e(%r9,%rbp,2) f: 75 78 jne 89 <_Z4funcv+0x89> 11: 29 20 sub %esp,(%rax) 13: 31 34 2e xor %esi,(%rsi,%rbp,1) 16: 32 2e xor (%rsi),%ch 18: 30 00 xor %al,(%rax) Disassembly of section .eh_frame: 0000000000000000 <.eh_frame>: 0: 14 00 adc $0x0,%al 2: 00 00 add %al,(%rax) 4: 00 00 add %al,(%rax) 6: 00 00 add %al,(%rax) 8: 01 7a 52 add %edi,0x52(%rdx) b: 00 01 add %al,(%rcx) d: 78 10 js 1f <.eh_frame+0x1f> f: 01 1b add %ebx,(%rbx) 11: 0c 07 or $0x7,%al 13: 08 90 01 00 00 1c or %dl,0x1c000001(%rax) 19: 00 00 add %al,(%rax) 1b: 00 1c 00 add %bl,(%rax,%rax,1) 1e: 00 00 add %al,(%rax) 20: 00 00 add %al,(%rax) 22: 00 00 add %al,(%rax) 24: 5c pop %rsp 25: 00 00 add %al,(%rax) 27: 00 00 add %al,(%rax) 29: 41 0e rex.B (bad) 2b: 10 86 02 43 0d 06 adc %al,0x60d4302(%rsi) 31: 02 57 0c add 0xc(%rdi),%dl 34: 07 (bad) 35: 08 00 or %al,(%rax) ... ```
Author
Owner

@abcbarryn commented on GitHub (Aug 14, 2025):

# cat ./build/CMakeCache.txt
# This is the CMakeCache file.
# For build in directory: /usr/src/ollama-main/build
# It was generated by CMake: /usr/local/lib64/python3.11/site-packages/cmake/data/bin/cmake
# You can edit this file to change values found and used by cmake.
# If you do not want to change any of the values, simply exit the editor.
# If you do want to change a value, simply edit, save, and exit the editor.
# The syntax for the file is as follows:
# KEY:TYPE=VALUE
# KEY is the name of a variable in the cache.
# TYPE is a hint to GUIs for the type of VALUE, DO NOT EDIT TYPE!.
# VALUE is the current value for the KEY.

########################
# EXTERNAL cache entries
########################

//Path to a program.
CMAKE_ADDR2LINE:FILEPATH=/usr/bin/addr2line

//Path to a program.
CMAKE_AR:FILEPATH=/usr/bin/ar

//Choose the type of build, options are: None Debug Release RelWithDebInfo
// MinSizeRel ...
CMAKE_BUILD_TYPE:STRING=

//Enable/Disable color output during build.
CMAKE_COLOR_MAKEFILE:BOOL=ON

//CUDA compiler
CMAKE_CUDA_COMPILER:STRING=/usr/local/cuda-12.9/bin/nvcc

//Flags used by the CUDA compiler during all build types.
CMAKE_CUDA_FLAGS:STRING=

//Flags used by the CUDA compiler during DEBUG builds.
CMAKE_CUDA_FLAGS_DEBUG:STRING=-g

//Flags used by the CUDA compiler during MINSIZEREL builds.
CMAKE_CUDA_FLAGS_MINSIZEREL:STRING=-O1 -DNDEBUG

//Flags used by the CUDA compiler during RELEASE builds.
CMAKE_CUDA_FLAGS_RELEASE:STRING=-O3 -DNDEBUG

//Flags used by the CUDA compiler during RELWITHDEBINFO builds.
CMAKE_CUDA_FLAGS_RELWITHDEBINFO:STRING=-O2 -g -DNDEBUG

//CXX compiler
CMAKE_CXX_COMPILER:STRING=/usr/bin/c++

//A wrapper around 'ar' adding the appropriate '--plugin' option
// for the GCC compiler
CMAKE_CXX_COMPILER_AR:FILEPATH=/usr/bin/gcc-ar-7

//A wrapper around 'ranlib' adding the appropriate '--plugin' option
// for the GCC compiler
CMAKE_CXX_COMPILER_RANLIB:FILEPATH=/usr/bin/gcc-ranlib-7

//Flags used by the CXX compiler during all build types.
CMAKE_CXX_FLAGS:STRING=

//Flags used by the CXX compiler during DEBUG builds.
CMAKE_CXX_FLAGS_DEBUG:STRING=-g

//Flags used by the CXX compiler during MINSIZEREL builds.
CMAKE_CXX_FLAGS_MINSIZEREL:STRING=-Os -DNDEBUG

//Flags used by the CXX compiler during RELEASE builds.
CMAKE_CXX_FLAGS_RELEASE:STRING=-O3 -DNDEBUG

//Flags used by the CXX compiler during RELWITHDEBINFO builds.
CMAKE_CXX_FLAGS_RELWITHDEBINFO:STRING=-O2 -g -DNDEBUG

//C compiler
CMAKE_C_COMPILER:STRING=/usr/bin/cc

//A wrapper around 'ar' adding the appropriate '--plugin' option
// for the GCC compiler
CMAKE_C_COMPILER_AR:FILEPATH=/usr/bin/gcc-ar-7

//A wrapper around 'ranlib' adding the appropriate '--plugin' option
// for the GCC compiler
CMAKE_C_COMPILER_RANLIB:FILEPATH=/usr/bin/gcc-ranlib-7

//Flags used by the C compiler during all build types.
CMAKE_C_FLAGS:STRING=

//Flags used by the C compiler during DEBUG builds.
CMAKE_C_FLAGS_DEBUG:STRING=-g

//Flags used by the C compiler during MINSIZEREL builds.
CMAKE_C_FLAGS_MINSIZEREL:STRING=-Os -DNDEBUG

//Flags used by the C compiler during RELEASE builds.
CMAKE_C_FLAGS_RELEASE:STRING=-O3 -DNDEBUG

//Flags used by the C compiler during RELWITHDEBINFO builds.
CMAKE_C_FLAGS_RELWITHDEBINFO:STRING=-O2 -g -DNDEBUG

//Path to a program.
CMAKE_DLLTOOL:FILEPATH=CMAKE_DLLTOOL-NOTFOUND

//Flags used by the linker during all build types.
CMAKE_EXE_LINKER_FLAGS:STRING=

//Flags used by the linker during DEBUG builds.
CMAKE_EXE_LINKER_FLAGS_DEBUG:STRING=

//Flags used by the linker during MINSIZEREL builds.
CMAKE_EXE_LINKER_FLAGS_MINSIZEREL:STRING=

//Flags used by the linker during RELEASE builds.
CMAKE_EXE_LINKER_FLAGS_RELEASE:STRING=

//Flags used by the linker during RELWITHDEBINFO builds.
CMAKE_EXE_LINKER_FLAGS_RELWITHDEBINFO:STRING=

//Enable/Disable output of compile commands during generation.
CMAKE_EXPORT_COMPILE_COMMANDS:BOOL=

//Value Computed by CMake.
CMAKE_FIND_PACKAGE_REDIRECTS_DIR:STATIC=/usr/src/ollama-main/build/CMakeFiles/pkgRedirects

//HIP compiler
CMAKE_HIP_COMPILER:FILEPATH=NOTFOUND

//Install path prefix, prepended onto install directories.
CMAKE_INSTALL_PREFIX:PATH=/usr/local

//Path to a program.
CMAKE_LINKER:FILEPATH=/usr/bin/ld

//Path to a program.
CMAKE_MAKE_PROGRAM:FILEPATH=/usr/bin/gmake

//Flags used by the linker during the creation of modules during
// all build types.
CMAKE_MODULE_LINKER_FLAGS:STRING=

//Flags used by the linker during the creation of modules during
// DEBUG builds.
CMAKE_MODULE_LINKER_FLAGS_DEBUG:STRING=

//Flags used by the linker during the creation of modules during
// MINSIZEREL builds.
CMAKE_MODULE_LINKER_FLAGS_MINSIZEREL:STRING=

//Flags used by the linker during the creation of modules during
// RELEASE builds.
CMAKE_MODULE_LINKER_FLAGS_RELEASE:STRING=

//Flags used by the linker during the creation of modules during
// RELWITHDEBINFO builds.
CMAKE_MODULE_LINKER_FLAGS_RELWITHDEBINFO:STRING=

//Path to a program.
CMAKE_NM:FILEPATH=/usr/bin/nm

//Path to a program.
CMAKE_OBJCOPY:FILEPATH=/usr/bin/objcopy

//Path to a program.
CMAKE_OBJDUMP:FILEPATH=/usr/bin/objdump

//Value Computed by CMake
CMAKE_PROJECT_DESCRIPTION:STATIC=

//Value Computed by CMake
CMAKE_PROJECT_HOMEPAGE_URL:STATIC=

//Value Computed by CMake
CMAKE_PROJECT_NAME:STATIC=Ollama

//Path to a program.
CMAKE_RANLIB:FILEPATH=/usr/bin/ranlib

//Path to a program.
CMAKE_READELF:FILEPATH=/usr/bin/readelf

//Flags used by the linker during the creation of shared libraries
// during all build types.
CMAKE_SHARED_LINKER_FLAGS:STRING=

//Flags used by the linker during the creation of shared libraries
// during DEBUG builds.
CMAKE_SHARED_LINKER_FLAGS_DEBUG:STRING=

//Flags used by the linker during the creation of shared libraries
// during MINSIZEREL builds.
CMAKE_SHARED_LINKER_FLAGS_MINSIZEREL:STRING=

//Flags used by the linker during the creation of shared libraries
// during RELEASE builds.
CMAKE_SHARED_LINKER_FLAGS_RELEASE:STRING=

//Flags used by the linker during the creation of shared libraries
// during RELWITHDEBINFO builds.
CMAKE_SHARED_LINKER_FLAGS_RELWITHDEBINFO:STRING=

//If set, runtime paths are not added when installing shared libraries,
// but are added when building.
CMAKE_SKIP_INSTALL_RPATH:BOOL=NO

//If set, runtime paths are not added when using shared libraries.
CMAKE_SKIP_RPATH:BOOL=NO

//Flags used by the linker during the creation of static libraries
// during all build types.
CMAKE_STATIC_LINKER_FLAGS:STRING=

//Flags used by the linker during the creation of static libraries
// during DEBUG builds.
CMAKE_STATIC_LINKER_FLAGS_DEBUG:STRING=

//Flags used by the linker during the creation of static libraries
// during MINSIZEREL builds.
CMAKE_STATIC_LINKER_FLAGS_MINSIZEREL:STRING=

//Flags used by the linker during the creation of static libraries
// during RELEASE builds.
CMAKE_STATIC_LINKER_FLAGS_RELEASE:STRING=

//Flags used by the linker during the creation of static libraries
// during RELWITHDEBINFO builds.
CMAKE_STATIC_LINKER_FLAGS_RELWITHDEBINFO:STRING=

//Path to a program.
CMAKE_STRIP:FILEPATH=/usr/bin/strip

//Path to a program.
CMAKE_TAPI:FILEPATH=CMAKE_TAPI-NOTFOUND

//If this value is on, makefiles will be generated without the
// .SILENT directive, and all commands will be echoed to the console
// during the make.  This is useful for debugging only. With Visual
// Studio IDE projects all commands are done without /nologo.
CMAKE_VERBOSE_MAKEFILE:BOOL=FALSE

CUDAToolkit_BIN_DIR:PATH=/usr/local/cuda-12.9/bin

//Path to a file.
CUDAToolkit_CUPTI_INCLUDE_DIR:PATH=/usr/local/cuda-12.9/targets/x86_64-linux/include

//Path to a program.
CUDAToolkit_NVCC_EXECUTABLE:FILEPATH=/usr/local/cuda-12.9/bin/nvcc

//Path to a library.
CUDAToolkit_rt_LIBRARY:FILEPATH=/usr/lib64/librt.a

//Path to a library.
CUDA_CUDART:FILEPATH=/usr/local/cuda-12.9/lib64/libcudart.so

//Path to a library.
CUDA_OpenCL_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libOpenCL.so

//Path to a library.
CUDA_cuFile_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcufile.so

//Path to a library.
CUDA_cuFile_rdma_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcufile_rdma.so

//Path to a library.
CUDA_cuFile_rdma_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcufile_rdma_static.a

//Path to a library.
CUDA_cuFile_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcufile_static.a

//Path to a library.
CUDA_cublasLt_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcublasLt.so

//Path to a library.
CUDA_cublasLt_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcublasLt_static.a

//Path to a library.
CUDA_cublas_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcublas.so

//Path to a library.
CUDA_cublas_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcublas_static.a

//Path to a library.
CUDA_cuda_driver_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/stubs/libcuda.so

//Path to a library.
CUDA_cudart_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcudart.so

//Path to a library.
CUDA_cudart_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcudart_static.a

//Path to a library.
CUDA_cudla_LIBRARY:FILEPATH=CUDA_cudla_LIBRARY-NOTFOUND

//Path to a library.
CUDA_cufft_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcufft.so

//Path to a library.
CUDA_cufft_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcufft_static.a

//Path to a library.
CUDA_cufft_static_nocallback_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcufft_static_nocallback.a

//Path to a library.
CUDA_cufftw_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcufftw.so

//Path to a library.
CUDA_cufftw_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcufftw_static.a

//Path to a library.
CUDA_culibos_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libculibos.a

//Path to a library.
CUDA_cupti_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcupti.so

//Path to a library.
CUDA_cupti_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcupti_static.a

//Path to a library.
CUDA_curand_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcurand.so

//Path to a library.
CUDA_curand_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcurand_static.a

//Path to a library.
CUDA_cusolver_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcusolver.so

//Path to a library.
CUDA_cusolver_lapack_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcusolver_lapack_static.a

//Path to a library.
CUDA_cusolver_metis_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcusolver_metis_static.a

//Path to a library.
CUDA_cusolver_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcusolver_static.a

//Path to a library.
CUDA_cusparse_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcusparse.so

//Path to a library.
CUDA_cusparse_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcusparse_static.a

//Path to a library.
CUDA_nppc_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnppc.so

//Path to a library.
CUDA_nppc_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnppc_static.a

//Path to a library.
CUDA_nppial_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnppial.so

//Path to a library.
CUDA_nppial_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnppial_static.a

//Path to a library.
CUDA_nppicc_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnppicc.so

//Path to a library.
CUDA_nppicc_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnppicc_static.a

//Path to a library.
CUDA_nppicom_LIBRARY:FILEPATH=CUDA_nppicom_LIBRARY-NOTFOUND

//Path to a library.
CUDA_nppicom_static_LIBRARY:FILEPATH=CUDA_nppicom_static_LIBRARY-NOTFOUND

//Path to a library.
CUDA_nppidei_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnppidei.so

//Path to a library.
CUDA_nppidei_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnppidei_static.a

//Path to a library.
CUDA_nppif_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnppif.so

//Path to a library.
CUDA_nppif_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnppif_static.a

//Path to a library.
CUDA_nppig_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnppig.so

//Path to a library.
CUDA_nppig_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnppig_static.a

//Path to a library.
CUDA_nppim_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnppim.so

//Path to a library.
CUDA_nppim_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnppim_static.a

//Path to a library.
CUDA_nppist_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnppist.so

//Path to a library.
CUDA_nppist_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnppist_static.a

//Path to a library.
CUDA_nppisu_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnppisu.so

//Path to a library.
CUDA_nppisu_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnppisu_static.a

//Path to a library.
CUDA_nppitc_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnppitc.so

//Path to a library.
CUDA_nppitc_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnppitc_static.a

//Path to a library.
CUDA_npps_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnpps.so

//Path to a library.
CUDA_npps_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnpps_static.a

//Path to a library.
CUDA_nvJitLink_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnvJitLink.so

//Path to a library.
CUDA_nvJitLink_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnvJitLink_static.a

//Path to a library.
CUDA_nvToolsExt_LIBRARY:FILEPATH=CUDA_nvToolsExt_LIBRARY-NOTFOUND

//Path to a library.
CUDA_nvfatbin_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnvfatbin.so

//Path to a library.
CUDA_nvfatbin_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnvfatbin_static.a

//Path to a library.
CUDA_nvgraph_LIBRARY:FILEPATH=CUDA_nvgraph_LIBRARY-NOTFOUND

//Path to a library.
CUDA_nvgraph_static_LIBRARY:FILEPATH=CUDA_nvgraph_static_LIBRARY-NOTFOUND

//Path to a library.
CUDA_nvjpeg_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnvjpeg.so

//Path to a library.
CUDA_nvjpeg_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnvjpeg_static.a

//Path to a library.
CUDA_nvml_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/stubs/libnvidia-ml.so

//Path to a library.
CUDA_nvml_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/stubs/libnvidia-ml.a

//Path to a library.
CUDA_nvperf_host_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnvperf_host.so

//Path to a library.
CUDA_nvperf_host_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnvperf_host_static.a

//Path to a library.
CUDA_nvperf_target_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnvperf_target.so

//Path to a library.
CUDA_nvptxcompiler_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnvptxcompiler_static.a

//Path to a library.
CUDA_nvrtc_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnvrtc.so

//Path to a library.
CUDA_nvrtc_builtins_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnvrtc-builtins.so

//Path to a library.
CUDA_nvrtc_builtins_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnvrtc-builtins_static.a

//Path to a library.
CUDA_nvrtc_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnvrtc_static.a

//Path to a library.
CUDA_pcsamplingutil_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libpcsamplingutil.so

//Path to a program.
GGML_CCACHE_FOUND:FILEPATH=GGML_CCACHE_FOUND-NOTFOUND

//Path to a program.
GGML_SCCACHE_FOUND:FILEPATH=GGML_SCCACHE_FOUND-NOTFOUND

//Path to a library.
MATH_LIBRARY:FILEPATH=/usr/lib64/libm.so

//Value Computed by CMake
Ollama_BINARY_DIR:STATIC=/usr/src/ollama-main/build

//Value Computed by CMake
Ollama_IS_TOP_LEVEL:STATIC=ON

//Value Computed by CMake
Ollama_SOURCE_DIR:STATIC=/usr/src/ollama-main

//Regular expression describing AMDGPU_TARGETS not supported on
// Windows. Override to force building these targets. Default "^gfx(906|908|90a|1200|1201):xnack[+-]$".
WINDOWS_AMDGPU_TARGETS_EXCLUDE_REGEX:STRING=^gfx(906|908|90a|1200|1201):xnack[+-]$


########################
# INTERNAL cache entries
########################

//ADVANCED property for variable: CMAKE_ADDR2LINE
CMAKE_ADDR2LINE-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_AR
CMAKE_AR-ADVANCED:INTERNAL=1
//This is the directory where this CMakeCache.txt was created
CMAKE_CACHEFILE_DIR:INTERNAL=/usr/src/ollama-main/build
//Major version of cmake used to create the current loaded cache
CMAKE_CACHE_MAJOR_VERSION:INTERNAL=4
//Minor version of cmake used to create the current loaded cache
CMAKE_CACHE_MINOR_VERSION:INTERNAL=0
//Patch version of cmake used to create the current loaded cache
CMAKE_CACHE_PATCH_VERSION:INTERNAL=3
//ADVANCED property for variable: CMAKE_COLOR_MAKEFILE
CMAKE_COLOR_MAKEFILE-ADVANCED:INTERNAL=1
//Path to CMake executable.
CMAKE_COMMAND:INTERNAL=/usr/local/lib64/python3.11/site-packages/cmake/data/bin/cmake
//Path to cpack program executable.
CMAKE_CPACK_COMMAND:INTERNAL=/usr/local/lib64/python3.11/site-packages/cmake/data/bin/cpack
//Path to ctest program executable.
CMAKE_CTEST_COMMAND:INTERNAL=/usr/local/lib64/python3.11/site-packages/cmake/data/bin/ctest
//ADVANCED property for variable: CMAKE_CUDA_COMPILER
CMAKE_CUDA_COMPILER-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_CUDA_FLAGS
CMAKE_CUDA_FLAGS-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_CUDA_FLAGS_DEBUG
CMAKE_CUDA_FLAGS_DEBUG-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_CUDA_FLAGS_MINSIZEREL
CMAKE_CUDA_FLAGS_MINSIZEREL-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_CUDA_FLAGS_RELEASE
CMAKE_CUDA_FLAGS_RELEASE-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_CUDA_FLAGS_RELWITHDEBINFO
CMAKE_CUDA_FLAGS_RELWITHDEBINFO-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_CXX_COMPILER
CMAKE_CXX_COMPILER-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_CXX_COMPILER_AR
CMAKE_CXX_COMPILER_AR-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_CXX_COMPILER_RANLIB
CMAKE_CXX_COMPILER_RANLIB-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_CXX_FLAGS
CMAKE_CXX_FLAGS-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_CXX_FLAGS_DEBUG
CMAKE_CXX_FLAGS_DEBUG-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_CXX_FLAGS_MINSIZEREL
CMAKE_CXX_FLAGS_MINSIZEREL-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_CXX_FLAGS_RELEASE
CMAKE_CXX_FLAGS_RELEASE-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_CXX_FLAGS_RELWITHDEBINFO
CMAKE_CXX_FLAGS_RELWITHDEBINFO-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_C_COMPILER
CMAKE_C_COMPILER-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_C_COMPILER_AR
CMAKE_C_COMPILER_AR-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_C_COMPILER_RANLIB
CMAKE_C_COMPILER_RANLIB-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_C_FLAGS
CMAKE_C_FLAGS-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_C_FLAGS_DEBUG
CMAKE_C_FLAGS_DEBUG-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_C_FLAGS_MINSIZEREL
CMAKE_C_FLAGS_MINSIZEREL-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_C_FLAGS_RELEASE
CMAKE_C_FLAGS_RELEASE-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_C_FLAGS_RELWITHDEBINFO
CMAKE_C_FLAGS_RELWITHDEBINFO-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_DLLTOOL
CMAKE_DLLTOOL-ADVANCED:INTERNAL=1
//Path to cache edit program executable.
CMAKE_EDIT_COMMAND:INTERNAL=/usr/bin/ccmake
//Executable file format
CMAKE_EXECUTABLE_FORMAT:INTERNAL=ELF
//ADVANCED property for variable: CMAKE_EXE_LINKER_FLAGS
CMAKE_EXE_LINKER_FLAGS-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_EXE_LINKER_FLAGS_DEBUG
CMAKE_EXE_LINKER_FLAGS_DEBUG-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_EXE_LINKER_FLAGS_MINSIZEREL
CMAKE_EXE_LINKER_FLAGS_MINSIZEREL-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_EXE_LINKER_FLAGS_RELEASE
CMAKE_EXE_LINKER_FLAGS_RELEASE-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_EXE_LINKER_FLAGS_RELWITHDEBINFO
CMAKE_EXE_LINKER_FLAGS_RELWITHDEBINFO-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_EXPORT_COMPILE_COMMANDS
CMAKE_EXPORT_COMPILE_COMMANDS-ADVANCED:INTERNAL=1
//Name of external makefile project generator.
CMAKE_EXTRA_GENERATOR:INTERNAL=
//Name of generator.
CMAKE_GENERATOR:INTERNAL=Unix Makefiles
//Generator instance identifier.
CMAKE_GENERATOR_INSTANCE:INTERNAL=
//Name of generator platform.
CMAKE_GENERATOR_PLATFORM:INTERNAL=
//Name of generator toolset.
CMAKE_GENERATOR_TOOLSET:INTERNAL=
//Test CMAKE_HAVE_LIBC_PTHREAD
CMAKE_HAVE_LIBC_PTHREAD:INTERNAL=1
//ADVANCED property for variable: CMAKE_HIP_COMPILER
CMAKE_HIP_COMPILER-ADVANCED:INTERNAL=1
//Source directory with the top level CMakeLists.txt file for this
// project
CMAKE_HOME_DIRECTORY:INTERNAL=/usr/src/ollama-main
//Install .so files without execute permission.
CMAKE_INSTALL_SO_NO_EXE:INTERNAL=0
//ADVANCED property for variable: CMAKE_LINKER
CMAKE_LINKER-ADVANCED:INTERNAL=1
//Name of CMakeLists files to read
CMAKE_LIST_FILE_NAME:INTERNAL=CMakeLists.txt
//ADVANCED property for variable: CMAKE_MAKE_PROGRAM
CMAKE_MAKE_PROGRAM-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_MODULE_LINKER_FLAGS
CMAKE_MODULE_LINKER_FLAGS-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_MODULE_LINKER_FLAGS_DEBUG
CMAKE_MODULE_LINKER_FLAGS_DEBUG-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_MODULE_LINKER_FLAGS_MINSIZEREL
CMAKE_MODULE_LINKER_FLAGS_MINSIZEREL-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_MODULE_LINKER_FLAGS_RELEASE
CMAKE_MODULE_LINKER_FLAGS_RELEASE-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_MODULE_LINKER_FLAGS_RELWITHDEBINFO
CMAKE_MODULE_LINKER_FLAGS_RELWITHDEBINFO-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_NM
CMAKE_NM-ADVANCED:INTERNAL=1
//number of local generators
CMAKE_NUMBER_OF_MAKEFILES:INTERNAL=4
//ADVANCED property for variable: CMAKE_OBJCOPY
CMAKE_OBJCOPY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_OBJDUMP
CMAKE_OBJDUMP-ADVANCED:INTERNAL=1
//Platform information initialized
CMAKE_PLATFORM_INFO_INITIALIZED:INTERNAL=1
//ADVANCED property for variable: CMAKE_RANLIB
CMAKE_RANLIB-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_READELF
CMAKE_READELF-ADVANCED:INTERNAL=1
//Path to CMake installation.
CMAKE_ROOT:INTERNAL=/usr/local/lib64/python3.11/site-packages/cmake/data/share/cmake-4.0
//ADVANCED property for variable: CMAKE_SHARED_LINKER_FLAGS
CMAKE_SHARED_LINKER_FLAGS-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_SHARED_LINKER_FLAGS_DEBUG
CMAKE_SHARED_LINKER_FLAGS_DEBUG-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_SHARED_LINKER_FLAGS_MINSIZEREL
CMAKE_SHARED_LINKER_FLAGS_MINSIZEREL-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_SHARED_LINKER_FLAGS_RELEASE
CMAKE_SHARED_LINKER_FLAGS_RELEASE-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_SHARED_LINKER_FLAGS_RELWITHDEBINFO
CMAKE_SHARED_LINKER_FLAGS_RELWITHDEBINFO-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_SKIP_INSTALL_RPATH
CMAKE_SKIP_INSTALL_RPATH-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_SKIP_RPATH
CMAKE_SKIP_RPATH-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_STATIC_LINKER_FLAGS
CMAKE_STATIC_LINKER_FLAGS-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_STATIC_LINKER_FLAGS_DEBUG
CMAKE_STATIC_LINKER_FLAGS_DEBUG-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_STATIC_LINKER_FLAGS_MINSIZEREL
CMAKE_STATIC_LINKER_FLAGS_MINSIZEREL-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_STATIC_LINKER_FLAGS_RELEASE
CMAKE_STATIC_LINKER_FLAGS_RELEASE-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_STATIC_LINKER_FLAGS_RELWITHDEBINFO
CMAKE_STATIC_LINKER_FLAGS_RELWITHDEBINFO-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_STRIP
CMAKE_STRIP-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CMAKE_TAPI
CMAKE_TAPI-ADVANCED:INTERNAL=1
//uname command
CMAKE_UNAME:INTERNAL=/usr/bin/uname
//ADVANCED property for variable: CMAKE_VERBOSE_MAKEFILE
CMAKE_VERBOSE_MAKEFILE-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDAToolkit_BIN_DIR
CUDAToolkit_BIN_DIR-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDAToolkit_CUPTI_INCLUDE_DIR
CUDAToolkit_CUPTI_INCLUDE_DIR-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDAToolkit_NVCC_EXECUTABLE
CUDAToolkit_NVCC_EXECUTABLE-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDAToolkit_rt_LIBRARY
CUDAToolkit_rt_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_CUDART
CUDA_CUDART-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_OpenCL_LIBRARY
CUDA_OpenCL_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_cuFile_LIBRARY
CUDA_cuFile_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_cuFile_rdma_LIBRARY
CUDA_cuFile_rdma_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_cuFile_rdma_static_LIBRARY
CUDA_cuFile_rdma_static_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_cuFile_static_LIBRARY
CUDA_cuFile_static_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_cublasLt_LIBRARY
CUDA_cublasLt_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_cublasLt_static_LIBRARY
CUDA_cublasLt_static_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_cublas_LIBRARY
CUDA_cublas_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_cublas_static_LIBRARY
CUDA_cublas_static_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_cuda_driver_LIBRARY
CUDA_cuda_driver_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_cudart_LIBRARY
CUDA_cudart_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_cudart_static_LIBRARY
CUDA_cudart_static_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_cudla_LIBRARY
CUDA_cudla_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_cufft_LIBRARY
CUDA_cufft_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_cufft_static_LIBRARY
CUDA_cufft_static_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_cufft_static_nocallback_LIBRARY
CUDA_cufft_static_nocallback_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_cufftw_LIBRARY
CUDA_cufftw_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_cufftw_static_LIBRARY
CUDA_cufftw_static_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_culibos_LIBRARY
CUDA_culibos_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_cupti_LIBRARY
CUDA_cupti_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_cupti_static_LIBRARY
CUDA_cupti_static_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_curand_LIBRARY
CUDA_curand_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_curand_static_LIBRARY
CUDA_curand_static_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_cusolver_LIBRARY
CUDA_cusolver_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_cusolver_lapack_static_LIBRARY
CUDA_cusolver_lapack_static_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_cusolver_metis_static_LIBRARY
CUDA_cusolver_metis_static_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_cusolver_static_LIBRARY
CUDA_cusolver_static_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_cusparse_LIBRARY
CUDA_cusparse_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_cusparse_static_LIBRARY
CUDA_cusparse_static_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_nppc_LIBRARY
CUDA_nppc_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_nppc_static_LIBRARY
CUDA_nppc_static_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_nppial_LIBRARY
CUDA_nppial_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_nppial_static_LIBRARY
CUDA_nppial_static_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_nppicc_LIBRARY
CUDA_nppicc_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_nppicc_static_LIBRARY
CUDA_nppicc_static_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_nppicom_LIBRARY
CUDA_nppicom_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_nppicom_static_LIBRARY
CUDA_nppicom_static_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_nppidei_LIBRARY
CUDA_nppidei_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_nppidei_static_LIBRARY
CUDA_nppidei_static_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_nppif_LIBRARY
CUDA_nppif_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_nppif_static_LIBRARY
CUDA_nppif_static_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_nppig_LIBRARY
CUDA_nppig_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_nppig_static_LIBRARY
CUDA_nppig_static_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_nppim_LIBRARY
CUDA_nppim_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_nppim_static_LIBRARY
CUDA_nppim_static_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_nppist_LIBRARY
CUDA_nppist_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_nppist_static_LIBRARY
CUDA_nppist_static_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_nppisu_LIBRARY
CUDA_nppisu_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_nppisu_static_LIBRARY
CUDA_nppisu_static_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_nppitc_LIBRARY
CUDA_nppitc_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_nppitc_static_LIBRARY
CUDA_nppitc_static_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_npps_LIBRARY
CUDA_npps_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_npps_static_LIBRARY
CUDA_npps_static_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_nvJitLink_LIBRARY
CUDA_nvJitLink_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_nvJitLink_static_LIBRARY
CUDA_nvJitLink_static_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_nvToolsExt_LIBRARY
CUDA_nvToolsExt_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_nvfatbin_LIBRARY
CUDA_nvfatbin_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_nvfatbin_static_LIBRARY
CUDA_nvfatbin_static_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_nvgraph_LIBRARY
CUDA_nvgraph_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_nvgraph_static_LIBRARY
CUDA_nvgraph_static_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_nvjpeg_LIBRARY
CUDA_nvjpeg_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_nvjpeg_static_LIBRARY
CUDA_nvjpeg_static_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_nvml_LIBRARY
CUDA_nvml_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_nvml_static_LIBRARY
CUDA_nvml_static_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_nvperf_host_LIBRARY
CUDA_nvperf_host_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_nvperf_host_static_LIBRARY
CUDA_nvperf_host_static_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_nvperf_target_LIBRARY
CUDA_nvperf_target_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_nvptxcompiler_static_LIBRARY
CUDA_nvptxcompiler_static_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_nvrtc_LIBRARY
CUDA_nvrtc_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_nvrtc_builtins_LIBRARY
CUDA_nvrtc_builtins_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_nvrtc_builtins_static_LIBRARY
CUDA_nvrtc_builtins_static_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_nvrtc_static_LIBRARY
CUDA_nvrtc_static_LIBRARY-ADVANCED:INTERNAL=1
//ADVANCED property for variable: CUDA_pcsamplingutil_LIBRARY
CUDA_pcsamplingutil_LIBRARY-ADVANCED:INTERNAL=1
//Details about finding CUDAToolkit
FIND_PACKAGE_MESSAGE_DETAILS_CUDAToolkit:INTERNAL=[/usr/local/cuda-12.9/targets/x86_64-linux/include][/usr/local/cuda-12.9/lib64/libcudart.so][/usr/local/cuda-12.9/bin][v12.9.86()]
//Details about finding Threads
FIND_PACKAGE_MESSAGE_DETAILS_Threads:INTERNAL=[TRUE][v()]
//List of backends for cmake package
GGML_AVAILABLE_BACKENDS:INTERNAL=ggml-cpu-x64;ggml-cpu-sse42;ggml-cpu-sandybridge;ggml-cpu-haswell;ggml-cpu-skylakex;ggml-cpu-icelake;ggml-cpu-alderlake;ggml-cuda
//linker supports push/pop state
_CMAKE_LINKER_PUSHPOP_STATE_SUPPORTED:INTERNAL=TRUE
//CUDAToolkit internal list of implicit link directories
_cmake_CUDAToolkit_implicit_link_directories:INTERNAL=/usr/local/cuda-12.9/targets/x86_64-linux/lib/stubs;/usr/local/cuda-12.9/targets/x86_64-linux/lib
//CUDAToolkit internal list of include directories
_cmake_CUDAToolkit_include_directories:INTERNAL=/usr/local/cuda-12.9/targets/x86_64-linux/include


<!-- gh-comment-id:3189098362 --> @abcbarryn commented on GitHub (Aug 14, 2025): ``` # cat ./build/CMakeCache.txt # This is the CMakeCache file. # For build in directory: /usr/src/ollama-main/build # It was generated by CMake: /usr/local/lib64/python3.11/site-packages/cmake/data/bin/cmake # You can edit this file to change values found and used by cmake. # If you do not want to change any of the values, simply exit the editor. # If you do want to change a value, simply edit, save, and exit the editor. # The syntax for the file is as follows: # KEY:TYPE=VALUE # KEY is the name of a variable in the cache. # TYPE is a hint to GUIs for the type of VALUE, DO NOT EDIT TYPE!. # VALUE is the current value for the KEY. ######################## # EXTERNAL cache entries ######################## //Path to a program. CMAKE_ADDR2LINE:FILEPATH=/usr/bin/addr2line //Path to a program. CMAKE_AR:FILEPATH=/usr/bin/ar //Choose the type of build, options are: None Debug Release RelWithDebInfo // MinSizeRel ... CMAKE_BUILD_TYPE:STRING= //Enable/Disable color output during build. CMAKE_COLOR_MAKEFILE:BOOL=ON //CUDA compiler CMAKE_CUDA_COMPILER:STRING=/usr/local/cuda-12.9/bin/nvcc //Flags used by the CUDA compiler during all build types. CMAKE_CUDA_FLAGS:STRING= //Flags used by the CUDA compiler during DEBUG builds. CMAKE_CUDA_FLAGS_DEBUG:STRING=-g //Flags used by the CUDA compiler during MINSIZEREL builds. CMAKE_CUDA_FLAGS_MINSIZEREL:STRING=-O1 -DNDEBUG //Flags used by the CUDA compiler during RELEASE builds. CMAKE_CUDA_FLAGS_RELEASE:STRING=-O3 -DNDEBUG //Flags used by the CUDA compiler during RELWITHDEBINFO builds. CMAKE_CUDA_FLAGS_RELWITHDEBINFO:STRING=-O2 -g -DNDEBUG //CXX compiler CMAKE_CXX_COMPILER:STRING=/usr/bin/c++ //A wrapper around 'ar' adding the appropriate '--plugin' option // for the GCC compiler CMAKE_CXX_COMPILER_AR:FILEPATH=/usr/bin/gcc-ar-7 //A wrapper around 'ranlib' adding the appropriate '--plugin' option // for the GCC compiler CMAKE_CXX_COMPILER_RANLIB:FILEPATH=/usr/bin/gcc-ranlib-7 //Flags used by the CXX compiler during all build types. CMAKE_CXX_FLAGS:STRING= //Flags used by the CXX compiler during DEBUG builds. CMAKE_CXX_FLAGS_DEBUG:STRING=-g //Flags used by the CXX compiler during MINSIZEREL builds. CMAKE_CXX_FLAGS_MINSIZEREL:STRING=-Os -DNDEBUG //Flags used by the CXX compiler during RELEASE builds. CMAKE_CXX_FLAGS_RELEASE:STRING=-O3 -DNDEBUG //Flags used by the CXX compiler during RELWITHDEBINFO builds. CMAKE_CXX_FLAGS_RELWITHDEBINFO:STRING=-O2 -g -DNDEBUG //C compiler CMAKE_C_COMPILER:STRING=/usr/bin/cc //A wrapper around 'ar' adding the appropriate '--plugin' option // for the GCC compiler CMAKE_C_COMPILER_AR:FILEPATH=/usr/bin/gcc-ar-7 //A wrapper around 'ranlib' adding the appropriate '--plugin' option // for the GCC compiler CMAKE_C_COMPILER_RANLIB:FILEPATH=/usr/bin/gcc-ranlib-7 //Flags used by the C compiler during all build types. CMAKE_C_FLAGS:STRING= //Flags used by the C compiler during DEBUG builds. CMAKE_C_FLAGS_DEBUG:STRING=-g //Flags used by the C compiler during MINSIZEREL builds. CMAKE_C_FLAGS_MINSIZEREL:STRING=-Os -DNDEBUG //Flags used by the C compiler during RELEASE builds. CMAKE_C_FLAGS_RELEASE:STRING=-O3 -DNDEBUG //Flags used by the C compiler during RELWITHDEBINFO builds. CMAKE_C_FLAGS_RELWITHDEBINFO:STRING=-O2 -g -DNDEBUG //Path to a program. CMAKE_DLLTOOL:FILEPATH=CMAKE_DLLTOOL-NOTFOUND //Flags used by the linker during all build types. CMAKE_EXE_LINKER_FLAGS:STRING= //Flags used by the linker during DEBUG builds. CMAKE_EXE_LINKER_FLAGS_DEBUG:STRING= //Flags used by the linker during MINSIZEREL builds. CMAKE_EXE_LINKER_FLAGS_MINSIZEREL:STRING= //Flags used by the linker during RELEASE builds. CMAKE_EXE_LINKER_FLAGS_RELEASE:STRING= //Flags used by the linker during RELWITHDEBINFO builds. CMAKE_EXE_LINKER_FLAGS_RELWITHDEBINFO:STRING= //Enable/Disable output of compile commands during generation. CMAKE_EXPORT_COMPILE_COMMANDS:BOOL= //Value Computed by CMake. CMAKE_FIND_PACKAGE_REDIRECTS_DIR:STATIC=/usr/src/ollama-main/build/CMakeFiles/pkgRedirects //HIP compiler CMAKE_HIP_COMPILER:FILEPATH=NOTFOUND //Install path prefix, prepended onto install directories. CMAKE_INSTALL_PREFIX:PATH=/usr/local //Path to a program. CMAKE_LINKER:FILEPATH=/usr/bin/ld //Path to a program. CMAKE_MAKE_PROGRAM:FILEPATH=/usr/bin/gmake //Flags used by the linker during the creation of modules during // all build types. CMAKE_MODULE_LINKER_FLAGS:STRING= //Flags used by the linker during the creation of modules during // DEBUG builds. CMAKE_MODULE_LINKER_FLAGS_DEBUG:STRING= //Flags used by the linker during the creation of modules during // MINSIZEREL builds. CMAKE_MODULE_LINKER_FLAGS_MINSIZEREL:STRING= //Flags used by the linker during the creation of modules during // RELEASE builds. CMAKE_MODULE_LINKER_FLAGS_RELEASE:STRING= //Flags used by the linker during the creation of modules during // RELWITHDEBINFO builds. CMAKE_MODULE_LINKER_FLAGS_RELWITHDEBINFO:STRING= //Path to a program. CMAKE_NM:FILEPATH=/usr/bin/nm //Path to a program. CMAKE_OBJCOPY:FILEPATH=/usr/bin/objcopy //Path to a program. CMAKE_OBJDUMP:FILEPATH=/usr/bin/objdump //Value Computed by CMake CMAKE_PROJECT_DESCRIPTION:STATIC= //Value Computed by CMake CMAKE_PROJECT_HOMEPAGE_URL:STATIC= //Value Computed by CMake CMAKE_PROJECT_NAME:STATIC=Ollama //Path to a program. CMAKE_RANLIB:FILEPATH=/usr/bin/ranlib //Path to a program. CMAKE_READELF:FILEPATH=/usr/bin/readelf //Flags used by the linker during the creation of shared libraries // during all build types. CMAKE_SHARED_LINKER_FLAGS:STRING= //Flags used by the linker during the creation of shared libraries // during DEBUG builds. CMAKE_SHARED_LINKER_FLAGS_DEBUG:STRING= //Flags used by the linker during the creation of shared libraries // during MINSIZEREL builds. CMAKE_SHARED_LINKER_FLAGS_MINSIZEREL:STRING= //Flags used by the linker during the creation of shared libraries // during RELEASE builds. CMAKE_SHARED_LINKER_FLAGS_RELEASE:STRING= //Flags used by the linker during the creation of shared libraries // during RELWITHDEBINFO builds. CMAKE_SHARED_LINKER_FLAGS_RELWITHDEBINFO:STRING= //If set, runtime paths are not added when installing shared libraries, // but are added when building. CMAKE_SKIP_INSTALL_RPATH:BOOL=NO //If set, runtime paths are not added when using shared libraries. CMAKE_SKIP_RPATH:BOOL=NO //Flags used by the linker during the creation of static libraries // during all build types. CMAKE_STATIC_LINKER_FLAGS:STRING= //Flags used by the linker during the creation of static libraries // during DEBUG builds. CMAKE_STATIC_LINKER_FLAGS_DEBUG:STRING= //Flags used by the linker during the creation of static libraries // during MINSIZEREL builds. CMAKE_STATIC_LINKER_FLAGS_MINSIZEREL:STRING= //Flags used by the linker during the creation of static libraries // during RELEASE builds. CMAKE_STATIC_LINKER_FLAGS_RELEASE:STRING= //Flags used by the linker during the creation of static libraries // during RELWITHDEBINFO builds. CMAKE_STATIC_LINKER_FLAGS_RELWITHDEBINFO:STRING= //Path to a program. CMAKE_STRIP:FILEPATH=/usr/bin/strip //Path to a program. CMAKE_TAPI:FILEPATH=CMAKE_TAPI-NOTFOUND //If this value is on, makefiles will be generated without the // .SILENT directive, and all commands will be echoed to the console // during the make. This is useful for debugging only. With Visual // Studio IDE projects all commands are done without /nologo. CMAKE_VERBOSE_MAKEFILE:BOOL=FALSE CUDAToolkit_BIN_DIR:PATH=/usr/local/cuda-12.9/bin //Path to a file. CUDAToolkit_CUPTI_INCLUDE_DIR:PATH=/usr/local/cuda-12.9/targets/x86_64-linux/include //Path to a program. CUDAToolkit_NVCC_EXECUTABLE:FILEPATH=/usr/local/cuda-12.9/bin/nvcc //Path to a library. CUDAToolkit_rt_LIBRARY:FILEPATH=/usr/lib64/librt.a //Path to a library. CUDA_CUDART:FILEPATH=/usr/local/cuda-12.9/lib64/libcudart.so //Path to a library. CUDA_OpenCL_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libOpenCL.so //Path to a library. CUDA_cuFile_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcufile.so //Path to a library. CUDA_cuFile_rdma_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcufile_rdma.so //Path to a library. CUDA_cuFile_rdma_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcufile_rdma_static.a //Path to a library. CUDA_cuFile_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcufile_static.a //Path to a library. CUDA_cublasLt_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcublasLt.so //Path to a library. CUDA_cublasLt_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcublasLt_static.a //Path to a library. CUDA_cublas_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcublas.so //Path to a library. CUDA_cublas_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcublas_static.a //Path to a library. CUDA_cuda_driver_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/stubs/libcuda.so //Path to a library. CUDA_cudart_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcudart.so //Path to a library. CUDA_cudart_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcudart_static.a //Path to a library. CUDA_cudla_LIBRARY:FILEPATH=CUDA_cudla_LIBRARY-NOTFOUND //Path to a library. CUDA_cufft_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcufft.so //Path to a library. CUDA_cufft_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcufft_static.a //Path to a library. CUDA_cufft_static_nocallback_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcufft_static_nocallback.a //Path to a library. CUDA_cufftw_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcufftw.so //Path to a library. CUDA_cufftw_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcufftw_static.a //Path to a library. CUDA_culibos_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libculibos.a //Path to a library. CUDA_cupti_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcupti.so //Path to a library. CUDA_cupti_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcupti_static.a //Path to a library. CUDA_curand_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcurand.so //Path to a library. CUDA_curand_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcurand_static.a //Path to a library. CUDA_cusolver_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcusolver.so //Path to a library. CUDA_cusolver_lapack_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcusolver_lapack_static.a //Path to a library. CUDA_cusolver_metis_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcusolver_metis_static.a //Path to a library. CUDA_cusolver_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcusolver_static.a //Path to a library. CUDA_cusparse_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcusparse.so //Path to a library. CUDA_cusparse_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libcusparse_static.a //Path to a library. CUDA_nppc_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnppc.so //Path to a library. CUDA_nppc_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnppc_static.a //Path to a library. CUDA_nppial_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnppial.so //Path to a library. CUDA_nppial_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnppial_static.a //Path to a library. CUDA_nppicc_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnppicc.so //Path to a library. CUDA_nppicc_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnppicc_static.a //Path to a library. CUDA_nppicom_LIBRARY:FILEPATH=CUDA_nppicom_LIBRARY-NOTFOUND //Path to a library. CUDA_nppicom_static_LIBRARY:FILEPATH=CUDA_nppicom_static_LIBRARY-NOTFOUND //Path to a library. CUDA_nppidei_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnppidei.so //Path to a library. CUDA_nppidei_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnppidei_static.a //Path to a library. CUDA_nppif_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnppif.so //Path to a library. CUDA_nppif_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnppif_static.a //Path to a library. CUDA_nppig_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnppig.so //Path to a library. CUDA_nppig_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnppig_static.a //Path to a library. CUDA_nppim_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnppim.so //Path to a library. CUDA_nppim_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnppim_static.a //Path to a library. CUDA_nppist_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnppist.so //Path to a library. CUDA_nppist_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnppist_static.a //Path to a library. CUDA_nppisu_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnppisu.so //Path to a library. CUDA_nppisu_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnppisu_static.a //Path to a library. CUDA_nppitc_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnppitc.so //Path to a library. CUDA_nppitc_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnppitc_static.a //Path to a library. CUDA_npps_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnpps.so //Path to a library. CUDA_npps_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnpps_static.a //Path to a library. CUDA_nvJitLink_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnvJitLink.so //Path to a library. CUDA_nvJitLink_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnvJitLink_static.a //Path to a library. CUDA_nvToolsExt_LIBRARY:FILEPATH=CUDA_nvToolsExt_LIBRARY-NOTFOUND //Path to a library. CUDA_nvfatbin_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnvfatbin.so //Path to a library. CUDA_nvfatbin_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnvfatbin_static.a //Path to a library. CUDA_nvgraph_LIBRARY:FILEPATH=CUDA_nvgraph_LIBRARY-NOTFOUND //Path to a library. CUDA_nvgraph_static_LIBRARY:FILEPATH=CUDA_nvgraph_static_LIBRARY-NOTFOUND //Path to a library. CUDA_nvjpeg_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnvjpeg.so //Path to a library. CUDA_nvjpeg_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnvjpeg_static.a //Path to a library. CUDA_nvml_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/stubs/libnvidia-ml.so //Path to a library. CUDA_nvml_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/stubs/libnvidia-ml.a //Path to a library. CUDA_nvperf_host_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnvperf_host.so //Path to a library. CUDA_nvperf_host_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnvperf_host_static.a //Path to a library. CUDA_nvperf_target_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnvperf_target.so //Path to a library. CUDA_nvptxcompiler_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnvptxcompiler_static.a //Path to a library. CUDA_nvrtc_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnvrtc.so //Path to a library. CUDA_nvrtc_builtins_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnvrtc-builtins.so //Path to a library. CUDA_nvrtc_builtins_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnvrtc-builtins_static.a //Path to a library. CUDA_nvrtc_static_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libnvrtc_static.a //Path to a library. CUDA_pcsamplingutil_LIBRARY:FILEPATH=/usr/local/cuda-12.9/targets/x86_64-linux/lib/libpcsamplingutil.so //Path to a program. GGML_CCACHE_FOUND:FILEPATH=GGML_CCACHE_FOUND-NOTFOUND //Path to a program. GGML_SCCACHE_FOUND:FILEPATH=GGML_SCCACHE_FOUND-NOTFOUND //Path to a library. MATH_LIBRARY:FILEPATH=/usr/lib64/libm.so //Value Computed by CMake Ollama_BINARY_DIR:STATIC=/usr/src/ollama-main/build //Value Computed by CMake Ollama_IS_TOP_LEVEL:STATIC=ON //Value Computed by CMake Ollama_SOURCE_DIR:STATIC=/usr/src/ollama-main //Regular expression describing AMDGPU_TARGETS not supported on // Windows. Override to force building these targets. Default "^gfx(906|908|90a|1200|1201):xnack[+-]$". WINDOWS_AMDGPU_TARGETS_EXCLUDE_REGEX:STRING=^gfx(906|908|90a|1200|1201):xnack[+-]$ ######################## # INTERNAL cache entries ######################## //ADVANCED property for variable: CMAKE_ADDR2LINE CMAKE_ADDR2LINE-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_AR CMAKE_AR-ADVANCED:INTERNAL=1 //This is the directory where this CMakeCache.txt was created CMAKE_CACHEFILE_DIR:INTERNAL=/usr/src/ollama-main/build //Major version of cmake used to create the current loaded cache CMAKE_CACHE_MAJOR_VERSION:INTERNAL=4 //Minor version of cmake used to create the current loaded cache CMAKE_CACHE_MINOR_VERSION:INTERNAL=0 //Patch version of cmake used to create the current loaded cache CMAKE_CACHE_PATCH_VERSION:INTERNAL=3 //ADVANCED property for variable: CMAKE_COLOR_MAKEFILE CMAKE_COLOR_MAKEFILE-ADVANCED:INTERNAL=1 //Path to CMake executable. CMAKE_COMMAND:INTERNAL=/usr/local/lib64/python3.11/site-packages/cmake/data/bin/cmake //Path to cpack program executable. CMAKE_CPACK_COMMAND:INTERNAL=/usr/local/lib64/python3.11/site-packages/cmake/data/bin/cpack //Path to ctest program executable. CMAKE_CTEST_COMMAND:INTERNAL=/usr/local/lib64/python3.11/site-packages/cmake/data/bin/ctest //ADVANCED property for variable: CMAKE_CUDA_COMPILER CMAKE_CUDA_COMPILER-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_CUDA_FLAGS CMAKE_CUDA_FLAGS-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_CUDA_FLAGS_DEBUG CMAKE_CUDA_FLAGS_DEBUG-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_CUDA_FLAGS_MINSIZEREL CMAKE_CUDA_FLAGS_MINSIZEREL-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_CUDA_FLAGS_RELEASE CMAKE_CUDA_FLAGS_RELEASE-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_CUDA_FLAGS_RELWITHDEBINFO CMAKE_CUDA_FLAGS_RELWITHDEBINFO-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_CXX_COMPILER CMAKE_CXX_COMPILER-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_CXX_COMPILER_AR CMAKE_CXX_COMPILER_AR-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_CXX_COMPILER_RANLIB CMAKE_CXX_COMPILER_RANLIB-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_CXX_FLAGS CMAKE_CXX_FLAGS-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_CXX_FLAGS_DEBUG CMAKE_CXX_FLAGS_DEBUG-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_CXX_FLAGS_MINSIZEREL CMAKE_CXX_FLAGS_MINSIZEREL-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_CXX_FLAGS_RELEASE CMAKE_CXX_FLAGS_RELEASE-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_CXX_FLAGS_RELWITHDEBINFO CMAKE_CXX_FLAGS_RELWITHDEBINFO-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_C_COMPILER CMAKE_C_COMPILER-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_C_COMPILER_AR CMAKE_C_COMPILER_AR-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_C_COMPILER_RANLIB CMAKE_C_COMPILER_RANLIB-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_C_FLAGS CMAKE_C_FLAGS-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_C_FLAGS_DEBUG CMAKE_C_FLAGS_DEBUG-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_C_FLAGS_MINSIZEREL CMAKE_C_FLAGS_MINSIZEREL-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_C_FLAGS_RELEASE CMAKE_C_FLAGS_RELEASE-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_C_FLAGS_RELWITHDEBINFO CMAKE_C_FLAGS_RELWITHDEBINFO-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_DLLTOOL CMAKE_DLLTOOL-ADVANCED:INTERNAL=1 //Path to cache edit program executable. CMAKE_EDIT_COMMAND:INTERNAL=/usr/bin/ccmake //Executable file format CMAKE_EXECUTABLE_FORMAT:INTERNAL=ELF //ADVANCED property for variable: CMAKE_EXE_LINKER_FLAGS CMAKE_EXE_LINKER_FLAGS-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_EXE_LINKER_FLAGS_DEBUG CMAKE_EXE_LINKER_FLAGS_DEBUG-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_EXE_LINKER_FLAGS_MINSIZEREL CMAKE_EXE_LINKER_FLAGS_MINSIZEREL-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_EXE_LINKER_FLAGS_RELEASE CMAKE_EXE_LINKER_FLAGS_RELEASE-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_EXE_LINKER_FLAGS_RELWITHDEBINFO CMAKE_EXE_LINKER_FLAGS_RELWITHDEBINFO-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_EXPORT_COMPILE_COMMANDS CMAKE_EXPORT_COMPILE_COMMANDS-ADVANCED:INTERNAL=1 //Name of external makefile project generator. CMAKE_EXTRA_GENERATOR:INTERNAL= //Name of generator. CMAKE_GENERATOR:INTERNAL=Unix Makefiles //Generator instance identifier. CMAKE_GENERATOR_INSTANCE:INTERNAL= //Name of generator platform. CMAKE_GENERATOR_PLATFORM:INTERNAL= //Name of generator toolset. CMAKE_GENERATOR_TOOLSET:INTERNAL= //Test CMAKE_HAVE_LIBC_PTHREAD CMAKE_HAVE_LIBC_PTHREAD:INTERNAL=1 //ADVANCED property for variable: CMAKE_HIP_COMPILER CMAKE_HIP_COMPILER-ADVANCED:INTERNAL=1 //Source directory with the top level CMakeLists.txt file for this // project CMAKE_HOME_DIRECTORY:INTERNAL=/usr/src/ollama-main //Install .so files without execute permission. CMAKE_INSTALL_SO_NO_EXE:INTERNAL=0 //ADVANCED property for variable: CMAKE_LINKER CMAKE_LINKER-ADVANCED:INTERNAL=1 //Name of CMakeLists files to read CMAKE_LIST_FILE_NAME:INTERNAL=CMakeLists.txt //ADVANCED property for variable: CMAKE_MAKE_PROGRAM CMAKE_MAKE_PROGRAM-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_MODULE_LINKER_FLAGS CMAKE_MODULE_LINKER_FLAGS-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_MODULE_LINKER_FLAGS_DEBUG CMAKE_MODULE_LINKER_FLAGS_DEBUG-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_MODULE_LINKER_FLAGS_MINSIZEREL CMAKE_MODULE_LINKER_FLAGS_MINSIZEREL-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_MODULE_LINKER_FLAGS_RELEASE CMAKE_MODULE_LINKER_FLAGS_RELEASE-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_MODULE_LINKER_FLAGS_RELWITHDEBINFO CMAKE_MODULE_LINKER_FLAGS_RELWITHDEBINFO-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_NM CMAKE_NM-ADVANCED:INTERNAL=1 //number of local generators CMAKE_NUMBER_OF_MAKEFILES:INTERNAL=4 //ADVANCED property for variable: CMAKE_OBJCOPY CMAKE_OBJCOPY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_OBJDUMP CMAKE_OBJDUMP-ADVANCED:INTERNAL=1 //Platform information initialized CMAKE_PLATFORM_INFO_INITIALIZED:INTERNAL=1 //ADVANCED property for variable: CMAKE_RANLIB CMAKE_RANLIB-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_READELF CMAKE_READELF-ADVANCED:INTERNAL=1 //Path to CMake installation. CMAKE_ROOT:INTERNAL=/usr/local/lib64/python3.11/site-packages/cmake/data/share/cmake-4.0 //ADVANCED property for variable: CMAKE_SHARED_LINKER_FLAGS CMAKE_SHARED_LINKER_FLAGS-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_SHARED_LINKER_FLAGS_DEBUG CMAKE_SHARED_LINKER_FLAGS_DEBUG-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_SHARED_LINKER_FLAGS_MINSIZEREL CMAKE_SHARED_LINKER_FLAGS_MINSIZEREL-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_SHARED_LINKER_FLAGS_RELEASE CMAKE_SHARED_LINKER_FLAGS_RELEASE-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_SHARED_LINKER_FLAGS_RELWITHDEBINFO CMAKE_SHARED_LINKER_FLAGS_RELWITHDEBINFO-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_SKIP_INSTALL_RPATH CMAKE_SKIP_INSTALL_RPATH-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_SKIP_RPATH CMAKE_SKIP_RPATH-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_STATIC_LINKER_FLAGS CMAKE_STATIC_LINKER_FLAGS-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_STATIC_LINKER_FLAGS_DEBUG CMAKE_STATIC_LINKER_FLAGS_DEBUG-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_STATIC_LINKER_FLAGS_MINSIZEREL CMAKE_STATIC_LINKER_FLAGS_MINSIZEREL-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_STATIC_LINKER_FLAGS_RELEASE CMAKE_STATIC_LINKER_FLAGS_RELEASE-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_STATIC_LINKER_FLAGS_RELWITHDEBINFO CMAKE_STATIC_LINKER_FLAGS_RELWITHDEBINFO-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_STRIP CMAKE_STRIP-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CMAKE_TAPI CMAKE_TAPI-ADVANCED:INTERNAL=1 //uname command CMAKE_UNAME:INTERNAL=/usr/bin/uname //ADVANCED property for variable: CMAKE_VERBOSE_MAKEFILE CMAKE_VERBOSE_MAKEFILE-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDAToolkit_BIN_DIR CUDAToolkit_BIN_DIR-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDAToolkit_CUPTI_INCLUDE_DIR CUDAToolkit_CUPTI_INCLUDE_DIR-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDAToolkit_NVCC_EXECUTABLE CUDAToolkit_NVCC_EXECUTABLE-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDAToolkit_rt_LIBRARY CUDAToolkit_rt_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_CUDART CUDA_CUDART-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_OpenCL_LIBRARY CUDA_OpenCL_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_cuFile_LIBRARY CUDA_cuFile_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_cuFile_rdma_LIBRARY CUDA_cuFile_rdma_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_cuFile_rdma_static_LIBRARY CUDA_cuFile_rdma_static_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_cuFile_static_LIBRARY CUDA_cuFile_static_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_cublasLt_LIBRARY CUDA_cublasLt_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_cublasLt_static_LIBRARY CUDA_cublasLt_static_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_cublas_LIBRARY CUDA_cublas_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_cublas_static_LIBRARY CUDA_cublas_static_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_cuda_driver_LIBRARY CUDA_cuda_driver_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_cudart_LIBRARY CUDA_cudart_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_cudart_static_LIBRARY CUDA_cudart_static_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_cudla_LIBRARY CUDA_cudla_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_cufft_LIBRARY CUDA_cufft_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_cufft_static_LIBRARY CUDA_cufft_static_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_cufft_static_nocallback_LIBRARY CUDA_cufft_static_nocallback_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_cufftw_LIBRARY CUDA_cufftw_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_cufftw_static_LIBRARY CUDA_cufftw_static_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_culibos_LIBRARY CUDA_culibos_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_cupti_LIBRARY CUDA_cupti_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_cupti_static_LIBRARY CUDA_cupti_static_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_curand_LIBRARY CUDA_curand_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_curand_static_LIBRARY CUDA_curand_static_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_cusolver_LIBRARY CUDA_cusolver_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_cusolver_lapack_static_LIBRARY CUDA_cusolver_lapack_static_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_cusolver_metis_static_LIBRARY CUDA_cusolver_metis_static_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_cusolver_static_LIBRARY CUDA_cusolver_static_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_cusparse_LIBRARY CUDA_cusparse_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_cusparse_static_LIBRARY CUDA_cusparse_static_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_nppc_LIBRARY CUDA_nppc_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_nppc_static_LIBRARY CUDA_nppc_static_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_nppial_LIBRARY CUDA_nppial_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_nppial_static_LIBRARY CUDA_nppial_static_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_nppicc_LIBRARY CUDA_nppicc_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_nppicc_static_LIBRARY CUDA_nppicc_static_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_nppicom_LIBRARY CUDA_nppicom_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_nppicom_static_LIBRARY CUDA_nppicom_static_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_nppidei_LIBRARY CUDA_nppidei_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_nppidei_static_LIBRARY CUDA_nppidei_static_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_nppif_LIBRARY CUDA_nppif_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_nppif_static_LIBRARY CUDA_nppif_static_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_nppig_LIBRARY CUDA_nppig_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_nppig_static_LIBRARY CUDA_nppig_static_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_nppim_LIBRARY CUDA_nppim_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_nppim_static_LIBRARY CUDA_nppim_static_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_nppist_LIBRARY CUDA_nppist_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_nppist_static_LIBRARY CUDA_nppist_static_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_nppisu_LIBRARY CUDA_nppisu_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_nppisu_static_LIBRARY CUDA_nppisu_static_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_nppitc_LIBRARY CUDA_nppitc_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_nppitc_static_LIBRARY CUDA_nppitc_static_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_npps_LIBRARY CUDA_npps_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_npps_static_LIBRARY CUDA_npps_static_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_nvJitLink_LIBRARY CUDA_nvJitLink_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_nvJitLink_static_LIBRARY CUDA_nvJitLink_static_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_nvToolsExt_LIBRARY CUDA_nvToolsExt_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_nvfatbin_LIBRARY CUDA_nvfatbin_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_nvfatbin_static_LIBRARY CUDA_nvfatbin_static_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_nvgraph_LIBRARY CUDA_nvgraph_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_nvgraph_static_LIBRARY CUDA_nvgraph_static_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_nvjpeg_LIBRARY CUDA_nvjpeg_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_nvjpeg_static_LIBRARY CUDA_nvjpeg_static_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_nvml_LIBRARY CUDA_nvml_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_nvml_static_LIBRARY CUDA_nvml_static_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_nvperf_host_LIBRARY CUDA_nvperf_host_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_nvperf_host_static_LIBRARY CUDA_nvperf_host_static_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_nvperf_target_LIBRARY CUDA_nvperf_target_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_nvptxcompiler_static_LIBRARY CUDA_nvptxcompiler_static_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_nvrtc_LIBRARY CUDA_nvrtc_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_nvrtc_builtins_LIBRARY CUDA_nvrtc_builtins_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_nvrtc_builtins_static_LIBRARY CUDA_nvrtc_builtins_static_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_nvrtc_static_LIBRARY CUDA_nvrtc_static_LIBRARY-ADVANCED:INTERNAL=1 //ADVANCED property for variable: CUDA_pcsamplingutil_LIBRARY CUDA_pcsamplingutil_LIBRARY-ADVANCED:INTERNAL=1 //Details about finding CUDAToolkit FIND_PACKAGE_MESSAGE_DETAILS_CUDAToolkit:INTERNAL=[/usr/local/cuda-12.9/targets/x86_64-linux/include][/usr/local/cuda-12.9/lib64/libcudart.so][/usr/local/cuda-12.9/bin][v12.9.86()] //Details about finding Threads FIND_PACKAGE_MESSAGE_DETAILS_Threads:INTERNAL=[TRUE][v()] //List of backends for cmake package GGML_AVAILABLE_BACKENDS:INTERNAL=ggml-cpu-x64;ggml-cpu-sse42;ggml-cpu-sandybridge;ggml-cpu-haswell;ggml-cpu-skylakex;ggml-cpu-icelake;ggml-cpu-alderlake;ggml-cuda //linker supports push/pop state _CMAKE_LINKER_PUSHPOP_STATE_SUPPORTED:INTERNAL=TRUE //CUDAToolkit internal list of implicit link directories _cmake_CUDAToolkit_implicit_link_directories:INTERNAL=/usr/local/cuda-12.9/targets/x86_64-linux/lib/stubs;/usr/local/cuda-12.9/targets/x86_64-linux/lib //CUDAToolkit internal list of include directories _cmake_CUDAToolkit_include_directories:INTERNAL=/usr/local/cuda-12.9/targets/x86_64-linux/include ```
Author
Owner

@abcbarryn commented on GitHub (Aug 14, 2025):

I found the problem. It's trying to use gcc 7.5 which is also installed but is not the default.

# objdump -s -j .comment build/ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/ggml-cpu.cpp.o

build/ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/ggml-cpu.cpp.o:     file format elf64-x86-64

Contents of section .comment:
 0000 00474343 3a202853 55534520 4c696e75  .GCC: (SUSE Linu
 0010 78292037 2e352e30 00                 x) 7.5.0.
# gcc -v 2>&1 | fgrep ' version '
gcc version 14.2.0 (SUSE Linux)

Why the !!! is it using 7.5?

<!-- gh-comment-id:3189143008 --> @abcbarryn commented on GitHub (Aug 14, 2025): I found the problem. It's trying to use gcc 7.5 which is also installed but is not the default. ``` # objdump -s -j .comment build/ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/ggml-cpu.cpp.o build/ml/backend/ggml/ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/ggml-cpu.cpp.o: file format elf64-x86-64 Contents of section .comment: 0000 00474343 3a202853 55534520 4c696e75 .GCC: (SUSE Linu 0010 78292037 2e352e30 00 x) 7.5.0. ``` ``` # gcc -v 2>&1 | fgrep ' version ' gcc version 14.2.0 (SUSE Linux) ``` Why the !!! is it using 7.5?
Author
Owner

@rick-github commented on GitHub (Aug 14, 2025):

c++ --version
<!-- gh-comment-id:3189296335 --> @rick-github commented on GitHub (Aug 14, 2025): ``` c++ --version ```
Author
Owner

@abcbarryn commented on GitHub (Aug 15, 2025):

# c++ --version
c++ (SUSE Linux) 7.5.0
Copyright (C) 2017 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

Damn it! :(

<!-- gh-comment-id:3190803701 --> @abcbarryn commented on GitHub (Aug 15, 2025): ``` # c++ --version c++ (SUSE Linux) 7.5.0 Copyright (C) 2017 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. ``` Damn it! :(
Author
Owner

@abcbarryn commented on GitHub (Aug 15, 2025):

# rm c++ ; ln -s g++ c++
# c++ --version
c++ (SUSE Linux) 14.2.0
Copyright (C) 2024 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

I bet it works now. The executable for g++ pointed to the right version but c++ was linked to g++-7. :(

<!-- gh-comment-id:3190814837 --> @abcbarryn commented on GitHub (Aug 15, 2025): ``` # rm c++ ; ln -s g++ c++ # c++ --version c++ (SUSE Linux) 14.2.0 Copyright (C) 2024 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. ``` I bet it works now. The executable for g++ pointed to the right version but c++ was linked to g++-7. :(
Author
Owner

@abcbarryn commented on GitHub (Aug 15, 2025):

It's stopping here now...

[ 56%] Building CUDA object ml/backend/ggml/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/acc.cu.o
nvcc fatal   : Unsupported gpu architecture 'compute_35'
gmake[2]: *** [ml/backend/ggml/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/build.make:80: ml/backend/ggml/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/acc.cu.o] Error 1
gmake[1]: *** [CMakeFiles/Makefile2:773: ml/backend/ggml/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/all] Error 2
gmake: *** [Makefile:136: all] Error 2
<!-- gh-comment-id:3190819760 --> @abcbarryn commented on GitHub (Aug 15, 2025): It's stopping here now... ``` [ 56%] Building CUDA object ml/backend/ggml/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/acc.cu.o nvcc fatal : Unsupported gpu architecture 'compute_35' gmake[2]: *** [ml/backend/ggml/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/build.make:80: ml/backend/ggml/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/acc.cu.o] Error 1 gmake[1]: *** [CMakeFiles/Makefile2:773: ml/backend/ggml/ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/all] Error 2 gmake: *** [Makefile:136: all] Error 2 ```
Author
Owner

@abcbarryn commented on GitHub (Aug 15, 2025):

Quote:

CUDA 12.x has dropped support for Kepler compute 3.x devices.

The minimum supported compute capability is 5.0 in CUDA 12.

If you require support for cc3.5, you will need to use an older CUDA version, look thru your project build system (CMakeLists.txt, etc.) and find out where/how compute 3.5 (compute_35) is being requested and try changing that to cc 61 (compute_61).
<!-- gh-comment-id:3190827066 --> @abcbarryn commented on GitHub (Aug 15, 2025): Quote: ``` CUDA 12.x has dropped support for Kepler compute 3.x devices. The minimum supported compute capability is 5.0 in CUDA 12. If you require support for cc3.5, you will need to use an older CUDA version, look thru your project build system (CMakeLists.txt, etc.) and find out where/how compute 3.5 (compute_35) is being requested and try changing that to cc 61 (compute_61). ```
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#54117