Daniel Hiltgen c146a138e3 ggml: handle all streams (#13350) ...

Follow up from #12992

Free all streams, and keep the alloc logic aligned across streams.

2025-12-05 16:10:33 -08:00

..

.gitignore

update vendored llama.cpp and ggml (#11823)

2025-08-14 14:42:58 -07:00

0001-ggml-backend-malloc-and-free-using-the-same-compiler.patch

ggml update to b7108 (#12992)

2025-12-03 19:43:29 -08:00

0002-pretokenizer.patch

ggml update to b7108 (#12992)

2025-12-03 19:43:29 -08:00

0003-clip-unicode.patch

ggml update to b7108 (#12992)

2025-12-03 19:43:29 -08:00

0004-solar-pro.patch

ggml update to b7108 (#12992)

2025-12-03 19:43:29 -08:00

0005-fix-deepseek-deseret-regex.patch

ggml update to b7108 (#12992)

2025-12-03 19:43:29 -08:00

0006-maintain-ordering-for-rules-for-grammar.patch

ggml update to b7108 (#12992)

2025-12-03 19:43:29 -08:00

0007-sort-devices-by-score.patch

ggml update to b6840 (#12791)

2025-11-06 10:19:22 -08:00

0008-add-phony-target-ggml-cpu-for-all-cpu-variants.patch

ggml update to b7108 (#12992)

2025-12-03 19:43:29 -08:00

0009-remove-amx.patch

ggml update to b7108 (#12992)

2025-12-03 19:43:29 -08:00

0010-fix-string-arr-kv-loading.patch

ggml update to b7108 (#12992)

2025-12-03 19:43:29 -08:00

0011-ollama-debug-tensor.patch

ggml update to b7108 (#12992)

2025-12-03 19:43:29 -08:00

0012-add-ollama-vocab-for-grammar-support.patch

ggml update to b7108 (#12992)

2025-12-03 19:43:29 -08:00

0013-add-argsort-and-cuda-copy-for-i32.patch

ggml update to b7108 (#12992)

2025-12-03 19:43:29 -08:00

0014-graph-memory-reporting-on-failure.patch

ggml update to b7108 (#12992)

2025-12-03 19:43:29 -08:00

0015-ggml-Export-GPU-UUIDs.patch

ggml update to b7108 (#12992)

2025-12-03 19:43:29 -08:00

0016-add-C-API-for-mtmd_input_text.patch

ggml update to b7108 (#12992)

2025-12-03 19:43:29 -08:00

0017-no-power-throttling-win32-with-gnuc.patch

ggml update to b7108 (#12992)

2025-12-03 19:43:29 -08:00

0018-ggml-Add-batch-size-hint.patch

ggml update to b7108 (#12992)

2025-12-03 19:43:29 -08:00

0019-fix-mtmd-audio.cpp-build-on-windows.patch

Remove unnecessary MacOs 13 and lower Patches (#12656)

2025-11-06 15:52:56 -08:00

0020-ggml-No-alloc-mode.patch

ggml: handle all streams (#13350)

2025-12-05 16:10:33 -08:00

0021-decode-disable-output_all.patch

ggml update to b7108 (#12992)

2025-12-03 19:43:29 -08:00

0022-ggml-Enable-resetting-backend-devices.patch

ggml: handle all streams (#13350)

2025-12-05 16:10:33 -08:00

0023-harden-uncaught-exception-registration.patch

Remove unnecessary MacOs 13 and lower Patches (#12656)

2025-11-06 15:52:56 -08:00

0024-GPU-discovery-enhancements.patch

ggml: handle all streams (#13350)

2025-12-05 16:10:33 -08:00

0025-NVML-fallback-for-unified-memory-GPUs.patch

Remove unnecessary MacOs 13 and lower Patches (#12656)

2025-11-06 15:52:56 -08:00

0026-report-LoadLibrary-failures.patch

Remove unnecessary MacOs 13 and lower Patches (#12656)

2025-11-06 15:52:56 -08:00

0027-interleave-multi-rope.patch

ggml update to b7108 (#12992)

2025-12-03 19:43:29 -08:00

0028-Add-memory-detection-using-DXGI-PDH.patch

ggml update to b7108 (#12992)

2025-12-03 19:43:29 -08:00

0029-ggml-cuda-skip-large-batches.patch

ggml: handle all streams (#13350)

2025-12-05 16:10:33 -08:00

0030-win-exit-instead-of-abort.patch

ggml update to b7108 (#12992)

2025-12-03 19:43:29 -08:00

0031-fix-bakllava-regression.patch

ggml update to b7108 (#12992)

2025-12-03 19:43:29 -08:00