github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-11-10 15:02:13 -06:00
Code Issues 16.9k Packages Projects Releases 122 Wiki Activity
5,985 Commits 493 Branches 730 Tags
docs_restructuring
Commit Graph
5 Commits
Author SHA1 Message Date
Daniel HiltgenandGitHub 855f4bf989 Report cached prompt tokens (#17943) 
* Report cached prompt tokens

Add prompt_eval_cached_count to native responses and expose equivalent cached-token fields through the OpenAI- and Anthropic-compatible APIs. Keep prompt_eval_count as the logical input total while excluding cache hits from CLI and benchmark prefill rates. Surface processed and cached prompt counts in benchmark output.

Collect cache counts from llama-server and MLX, preserve coherent metrics across two-pass structured generation.

Fixes #8008

Related to #15758

* review comments
 2026-09-02 09:30:44 -07:00
Jeffrey MorganandGitHub f0078ae476 docs: update docs examples to use Gemma 4 instead of Gemma 3 (#16607) 2026-06-07 12:43:13 -07:00
Parth SareenandGitHub 3d99d9779a docs: add docs for docs.ollama.com (#12805) 2025-10-28 13:18:48 -07:00
Parth SareenandGitHub 5483497d7a Revert "docs: add reference to docs.ollama.com (#12800)" (#12803) 
This reverts commit 934dd9e196.
 2025-10-28 12:52:49 -07:00
Parth SareenandGitHub 934dd9e196 docs: add reference to docs.ollama.com (#12800) 2025-10-28 12:44:02 -07:00