Jesse Gross 73d6a82cce ollamarunner: Memory usage reporting ...

This provides granular information about the backend memory allocations
required by the runner:
 - Per backend
 - Per layer
 - Weights, cache and graph
 - Allocation status

This can be used for debugging and validating memory estimates.

2025-05-22 14:38:09 -07:00

..

ggml

ollamarunner: Memory usage reporting

2025-05-22 14:38:09 -07:00

backend.go

next ollama runner (#7913)

2025-02-13 16:31:21 -08:00