[GH-ISSUE #6292] Docs: tfs_z description incorrect #3942

Open
opened 2026-04-12 14:49:11 -05:00 by GiteaMirror · 0 comments
Owner

Originally created by @technovangelist on GitHub (Aug 9, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/6292

What is the issue?

In the Modelfile docs (https://github.com/ollama/ollama/blob/main/docs/modelfile.md#parameter) tfs_z is defined as:

Tail free sampling is used to reduce the impact of less probable tokens from the output. A 
higher value (e.g., 2.0) will reduce the impact more, while a value of 1.0 disables this
 setting. (default: 1)


So that says the range will be 1 to something higher. But this part of the llama.cpp docs suggests that it’s a range of 0 to 1.

https://github.com/ggerganov/llama.cpp/blob/master/examples/main/README.md#tail-free-sampling-tfs

OS

macOS

GPU

Apple

CPU

Apple

Ollama version

No response

Originally created by @technovangelist on GitHub (Aug 9, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/6292 ### What is the issue? In the Modelfile docs (https://github.com/ollama/ollama/blob/main/docs/modelfile.md#parameter) tfs_z is defined as: ``` Tail free sampling is used to reduce the impact of less probable tokens from the output. A higher value (e.g., 2.0) will reduce the impact more, while a value of 1.0 disables this setting. (default: 1) ``` So that says the range will be 1 to something higher. But this part of the llama.cpp docs suggests that it’s a range of 0 to 1. https://github.com/ggerganov/llama.cpp/blob/master/examples/main/README.md#tail-free-sampling-tfs ### OS macOS ### GPU Apple ### CPU Apple ### Ollama version _No response_
GiteaMirror added the bug label 2026-04-12 14:49:11 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#3942