mirror of
https://github.com/ollama/ollama.git
synced 2026-11-08 02:16:57 -06:00
Daniel HiltgenandGitHub
66ab8482e0
* MLX, MLX-C: version bump The MLX-C pin now provides its own bindings for gather_qmm global_scale and fast::gated_delta_update, so those two carried patches drop out. Carry 0001-mlx-c-sdpa-window-size instead: sliding-window attention added a window_size argument to fast::scaled_dot_product_attention (ml-explore/mlx#4734) that MLX-C has not bound yet, to be regenerated from MLX-C once the upstream binding PR merges. The SDPA wrappers gain a window size argument; all call sites default to the full context. * mlxrunner: dispatch sliding-window prefills to the native SDPA window Sliding layers no longer materialize a causal∩sliding mask for prefill chunks past the window: resolve() dispatches {causal, window} natively when the rotating cache's L>1 concat has linearized the ring and the mask is otherwise pure causal, via a new MaskApplier.NativeWindow hint. Vision relaxations, padding, model arrays, and decode keep the materialized path. No model changes; sinks compose natively.