github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-04-29 23:48:32 -05:00
Code Issues 11.4k Packages Projects Releases 117 Wiki Activity
Files
764e199d6703d80da4d245381efa4a3a412813b2
ollama/kvcache/causal.go
Michael Yang 764e199d67 kvcache: create cache ctx per layer 
each cache layer creates and maintains its own context instead of using
a large context for all layers
2025-03-07 14:08:21 -08:00

14 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink