Daniel HiltgenandGitHub 630882621b llama-server followups (#16353) ...

* llama-server followups

Misc fixes for #16031
- Add back dropped ROCm build flag for multi-GPU support on windows
- Fix amdhip64_*.dll version detection for "latest" selection
- Fix embeddings API for consistent normalize behavior with prior versions

* ci: set up for automated llama.cpp update testing

* reduce batch for fa-disabled, and constrained vram

* mlx: fix v3 load bug on m5

Imagegen was incorrectly loading v3 first.  This DRYs out the loading code so imagegen gets the same new v4/v3 selection logic.

* fix reload bug on embedding models

* bump version

* steer user how to enable iGPU when disabled

2026-06-01 10:44:21 -07:00

..

internal

go: bump to 1.26 (#15904)

2026-05-03 23:24:35 -07:00

auth_test.go

server: reject unexpected auth hosts (#13738)

2026-01-16 14:10:36 -05:00

auth.go

server: reject unexpected auth hosts (#13738)

2026-01-16 14:10:36 -05:00

cloud_proxy_test.go

cloud_proxy: for the web_search legacy path, flush on newlines (#14897)

2026-03-17 13:30:17 -07:00

cloud_proxy.go

cloud_proxy: for the web_search legacy path, flush on newlines (#14897)

2026-03-17 13:30:17 -07:00

create_test.go

runner: Remove CGO engines, use llama-server exclusively for GGML models (#16031)

2026-05-29 13:35:47 -07:00

create.go

runner: Remove CGO engines, use llama-server exclusively for GGML models (#16031)

2026-05-29 13:35:47 -07:00

download.go

Clean up the manifest and modelpath (#13807)

2026-01-21 11:46:17 -08:00

fixblobs_test.go

server: replace blob prefix separator from ':' to '-' (#3146)

2024-03-14 20:18:06 -07:00

fixblobs.go

server: replace blob prefix separator from ':' to '-' (#3146)

2024-03-14 20:18:06 -07:00

gemma4_test.go

runner: Remove CGO engines, use llama-server exclusively for GGML models (#16031)

2026-05-29 13:35:47 -07:00

images_test.go

runner: Remove CGO engines, use llama-server exclusively for GGML models (#16031)

2026-05-29 13:35:47 -07:00

images.go

runner: Remove CGO engines, use llama-server exclusively for GGML models (#16031)

2026-05-29 13:35:47 -07:00

inference_request_log.go

add ability to turn on debug request logging (#14106)

2026-03-19 17:08:17 -07:00

logprob.go

logprob: add bytes to logprobs (#13068)

2025-11-13 13:49:25 -08:00

model_caches.go

Reduce startup model hydration (#16215)

2026-05-19 15:53:08 -07:00

model_list_cache_test.go

Reduce startup model hydration (#16215)

2026-05-19 15:53:08 -07:00

model_list_cache.go

runner: Remove CGO engines, use llama-server exclusively for GGML models (#16031)

2026-05-29 13:35:47 -07:00

model_recommendations_test.go

launch: add plan-aware model gating (#16027)

2026-05-06 14:34:26 -07:00

model_recommendations.go

launch: add plan-aware model gating (#16027)

2026-05-06 14:34:26 -07:00

model_resolver_test.go

Reapply "don't require pulling stubs for cloud models" again (#14608)

2026-03-06 14:27:47 -08:00

model_resolver.go

Reapply "don't require pulling stubs for cloud models" again (#14608)

2026-03-06 14:27:47 -08:00

model_show_cache_test.go

Reduce startup model hydration (#16215)

2026-05-19 15:53:08 -07:00

model_show_cache.go

Reduce startup model hydration (#16215)

2026-05-19 15:53:08 -07:00

model.go

runner: Remove CGO engines, use llama-server exclusively for GGML models (#16031)

2026-05-29 13:35:47 -07:00

prompt_test.go

anthropic: Preserve Claude local image-path tool results in renderer-owned prompt formatting (#16047)

2026-05-12 00:02:17 -04:00

prompt.go

runner: Remove CGO engines, use llama-server exclusively for GGML models (#16031)

2026-05-29 13:35:47 -07:00

quantization_stub_test.go

runner: Remove CGO engines, use llama-server exclusively for GGML models (#16031)

2026-05-29 13:35:47 -07:00

quantization_test.go

convert: fixes for qwen3next model conversion (#16354)

2026-06-01 09:43:11 -07:00

quantization.go

convert: fixes for qwen3next model conversion (#16354)

2026-06-01 09:43:11 -07:00

renderer_resolution.go

gemma4: render differently based on model size

2026-04-15 14:37:16 -07:00

routes_cloud_test.go

revert context length warnings change (#15121)

2026-03-28 16:43:59 -07:00

routes_create_test.go

runner: Remove CGO engines, use llama-server exclusively for GGML models (#16031)

2026-05-29 13:35:47 -07:00

routes_debug_test.go

runner: Remove CGO engines, use llama-server exclusively for GGML models (#16031)

2026-05-29 13:35:47 -07:00

routes_delete_test.go

Reapply "don't require pulling stubs for cloud models" again (#14608)

2026-03-06 14:27:47 -08:00

routes_generate_renderer_test.go

runner: Remove CGO engines, use llama-server exclusively for GGML models (#16031)

2026-05-29 13:35:47 -07:00

routes_generate_test.go

runner: Remove CGO engines, use llama-server exclusively for GGML models (#16031)

2026-05-29 13:35:47 -07:00

routes_harmony_streaming_test.go

sched: Model eviction for MLX

2026-03-16 17:40:29 -07:00

routes_list_test.go

Reduce startup model hydration (#16215)

2026-05-19 15:53:08 -07:00

routes_options_test.go

runner: Remove CGO engines, use llama-server exclusively for GGML models (#16031)

2026-05-29 13:35:47 -07:00

routes_request_log_test.go

add ability to turn on debug request logging (#14106)

2026-03-19 17:08:17 -07:00

routes_test.go

runner: Remove CGO engines, use llama-server exclusively for GGML models (#16031)

2026-05-29 13:35:47 -07:00

routes_web_experimental_test.go

cloud_proxy: send ollama client version (#14769)

2026-03-10 15:53:25 -07:00

routes.go

runner: Remove CGO engines, use llama-server exclusively for GGML models (#16031)

2026-05-29 13:35:47 -07:00

sched_test.go

llama-server followups (#16353)

2026-06-01 10:44:21 -07:00

sched.go

llama-server followups (#16353)

2026-06-01 10:44:21 -07:00

sparse_common.go

Don't hard fail on sparse setup error

2024-08-09 12:16:19 -07:00

sparse_windows.go

Don't hard fail on sparse setup error

2024-08-09 12:16:19 -07:00

test_home_test.go

app: harden update flows (#16100)

2026-05-11 12:24:01 -07:00

upload.go

Clean up the manifest and modelpath (#13807)

2026-01-21 11:46:17 -08:00