Daniel HiltgenandGitHub 84dc81db1f llama-server: allow parallel requests for recurrent and vision models (#19545) ...

These architectures were forced to num_parallel=1 because the older Go
engine's recurrent caches held one sequence. llama-server supports
multiple slots for all of them so we can allow parallelism now.

2026-11-05 09:22:54 -08:00

..

anthropic_thinking_test.go

anthropic: reuse resolved thinking for web search (#19098)

2026-10-22 15:23:42 -07:00

auth_test.go

server: reject unexpected auth hosts (#13738)

2026-01-16 14:10:36 -05:00

auth.go

server: reject unexpected auth hosts (#13738)

2026-01-16 14:10:36 -05:00

capabilities_test.go

mlx: add LFM3 and d1 models (#19333)

2026-10-27 08:47:18 -07:00

cloud_proxy_anthropic_test.go

server: decode cloud web search responses (#19476)

2026-11-02 16:59:50 -08:00

cloud_proxy_test.go

server: decode cloud web search responses (#19476)

2026-11-02 16:59:50 -08:00

cloud_proxy.go

server: decode cloud web search responses (#19476)

2026-11-02 16:59:50 -08:00

codex_proxy_test.go

app: harden Codex desktop proxy handling (#18244)

2026-09-04 17:48:55 -07:00

codex_proxy.go

app: add Ollama to ChatGPT Desktop (#18236)

2026-09-04 14:04:48 -07:00

create_fuzz_test.go

create: add server-side MLX imports and drop GGUF conversion (#14969)

2026-09-14 20:32:36 -07:00

create_split_gguf.go

create: add server-side MLX imports and drop GGUF conversion (#14969)

2026-09-14 20:32:36 -07:00

create_test.go

mlx: System one support (#18701)

2026-10-03 13:17:21 -07:00

create.go

mlx: add PPLX Decider v1.2 support (#19072)

2026-10-17 14:45:55 -07:00

download_test.go

transfer: support proxies on registry redirect targets (#19065)

2026-10-16 15:00:17 -07:00

download.go

transfer: support proxies on registry redirect targets (#19065)

2026-10-16 15:00:17 -07:00

fixblobs_test.go

…

fixblobs.go

…

gemma4_test.go

models: add support for gemma4-12b (#16457)

2026-06-03 07:44:57 -07:00

gguf_metadata_test.go

tests: fix metadata deletion test flake (#18493)

2026-09-17 16:39:42 -07:00

gguf_metadata.go

llama-server: prepare to remove compatibility patch

2026-09-24 19:25:52 -07:00

glimmer_images_test.go

Release v0.32.7 (#17646)

2026-08-10 04:04:56 -07:00

images_test.go

llm: LFM3 GGUF fixes and llama-server speech (#19344)

2026-10-27 18:56:22 -07:00

images.go

llm: LFM3 GGUF fixes and llama-server speech (#19344)

2026-10-27 18:56:22 -07:00

inference_request_log.go

add ability to turn on debug request logging (#14106)

2026-03-19 17:08:17 -07:00

logprob.go

logprob: add bytes to logprobs (#13068)

2025-11-13 13:49:25 -08:00

model_caches.go

server: extract GGUF metadata and unify capabilities (#17858)

2026-09-10 11:16:37 -07:00

model_list_test.go

nemotron_h: add MLX vision support (#17714)

2026-09-17 16:29:14 -07:00

model_list.go

server: hide duplicate and downgrade guards from list (#18874)

2026-10-08 08:54:06 -07:00

model_recommendations_test.go

app: add Ollama to ChatGPT Desktop (#18236)

2026-09-04 14:04:48 -07:00

model_recommendations.go

app: add Ollama to ChatGPT Desktop (#18236)

2026-09-04 14:04:48 -07:00

model_resolver_test.go

Reapply "don't require pulling stubs for cloud models" again (#14608)

2026-03-06 14:27:47 -08:00

model_resolver.go

llama-server: prepare to remove compatibility patch

2026-09-24 19:25:52 -07:00

model_show_cache_test.go

llama-server: prepare to remove compatibility patch

2026-09-24 19:25:52 -07:00

model_show_cache.go

llama-server: prepare to remove compatibility patch

2026-09-24 19:25:52 -07:00

model_thinking_test.go

api: expose model thinking levels and defaults (#18473)

2026-09-18 14:10:53 -07:00

model_thinking.go

api: expose model thinking levels and defaults (#18473)

2026-09-18 14:10:53 -07:00

model.go

llama-server: prepare to remove compatibility patch

2026-09-24 19:25:52 -07:00

prompt_test.go

mlx: add LFM3 and d1 models (#19333)

2026-10-27 08:47:18 -07:00

prompt.go

server: align generate with native chat templates (#16878)

2026-06-24 13:43:56 -07:00

renderer_resolution.go

gemma4: image and audio input support

2026-09-02 15:07:28 -07:00

responses_compact_test.go

openai: preserve readable Responses input content (#19192)

2026-10-28 23:46:40 -04:00

responses_compact.go

server/openai: retry compaction after context overflow (#18324)

2026-09-08 14:42:03 -07:00

responses_thinking_test.go

openai: allow Responses effort on non-thinking models (#19010)

2026-10-16 18:45:46 -07:00

routes_cloud_test.go

openai: clarify Responses authentication errors (#19004)

2026-10-14 22:35:06 -04:00

routes_create_test.go

Merge remote-tracking branch 'upstream/main' into release_v0.40.0

2026-10-01 16:51:30 -07:00

routes_debug_test.go

create: add server-side MLX imports and drop GGUF conversion (#14969)

2026-09-14 20:32:36 -07:00

routes_delete_test.go

llama-server: prepare to remove compatibility patch

2026-09-24 19:25:52 -07:00

routes_generate_renderer_test.go

create: add server-side MLX imports and drop GGUF conversion (#14969)

2026-09-14 20:32:36 -07:00

routes_generate_test.go

server: reuse verified manifests and loaded models in inference routes (#18947)

2026-10-12 08:41:52 -07:00

routes_harmony_streaming_test.go

create: add server-side MLX imports and drop GGUF conversion (#14969)

2026-09-14 20:32:36 -07:00

routes_list_test.go

server: hide duplicate and downgrade guards from list (#18874)

2026-10-08 08:54:06 -07:00

routes_options_test.go

server: fix multimodal embedding load with small num_ctx (#18973)

2026-10-12 17:43:50 -07:00

routes_parse_error_test.go

create: add server-side MLX imports and drop GGUF conversion (#14969)

2026-09-14 20:32:36 -07:00

routes_remote_test.go

anthropic: surface errors after streaming starts (#19188)

2026-10-21 19:00:18 -07:00

routes_reporting_test.go

server: proxy cloud usage and balance APIs (#18829)

2026-10-06 18:31:54 -07:00

routes_request_log_test.go

add ability to turn on debug request logging (#14106)

2026-03-19 17:08:17 -07:00

routes_test.go

llm: LFM3 GGUF fixes and llama-server speech (#19344)

2026-10-27 18:56:22 -07:00

routes_web_experimental_test.go

openai: support web search in Responses API (#17686)

2026-08-12 11:51:54 -07:00

routes.go

Add AutoTrust decision model to MLX (#19399)

2026-11-04 09:47:37 -08:00

sched_test.go

launch: use allocated context for OpenCode (#19193)

2026-10-23 11:45:15 -07:00

sched.go

llama-server: allow parallel requests for recurrent and vision models (#19545)

2026-11-05 09:22:54 -08:00

show_manifest.go

llama-server: prepare to remove compatibility patch

2026-09-24 19:25:52 -07:00

show_safetensors_test.go

Update gemma renderers (#19241)

2026-10-23 07:12:11 -07:00

show_safetensors.go

Update gemma renderers (#19241)

2026-10-23 07:12:11 -07:00

sparse_common.go

…

sparse_windows.go

…

speech_gguf_test.go

llm: LFM3 GGUF fixes and llama-server speech (#19344)

2026-10-27 18:56:22 -07:00

speech_test.go

mlx: add LFM3 and d1 models (#19333)

2026-10-27 08:47:18 -07:00

speech.go

llm: LFM3 GGUF fixes and llama-server speech (#19344)

2026-10-27 18:56:22 -07:00

systemone_test.go

Add AutoTrust decision model to MLX (#19399)

2026-11-04 09:47:37 -08:00

test_home_test.go

app: harden update flows (#16100)

2026-05-11 12:24:01 -07:00

transcription_test.go

mlx: add LFM3 and d1 models (#19333)

2026-10-27 08:47:18 -07:00

transcription.go

mlx: add LFM3 and d1 models (#19333)

2026-10-27 08:47:18 -07:00

upload.go

Clean up the manifest and modelpath (#13807)

2026-01-21 11:46:17 -08:00