Jesse Gross 0334ffa625 server: use tiered VRAM-based default context length ...

Replace binary low VRAM mode with tiered VRAM thresholds that set
default context lengths for all models:

- < 24 GiB VRAM: 4,096 context
- 24-48 GiB VRAM: 32,768 context
- >= 48 GiB VRAM: 262,144 context

2026-02-02 10:47:09 -08:00

3.0 KiB

Raw Permalink Blame History

View Raw