[GH-ISSUE #9495] Please allow setting the parameter of top_n_sigma in ModelFile #6184

Open
opened 2026-04-12 17:33:10 -05:00 by GiteaMirror · 2 comments
Owner

Originally created by @focomfy on GitHub (Mar 4, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/9495

This is a brand new sampler that has recently been merged into llama.cpp, it seems very useful.

llama.cpp: Top-nσ

Originally created by @focomfy on GitHub (Mar 4, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/9495 This is a brand new sampler that has recently been merged into llama.cpp, it seems very useful. [llama.cpp: Top-nσ](https://github.com/ggml-org/llama.cpp/pull/11223)
GiteaMirror added the feature request label 2026-04-12 17:33:10 -05:00
Author
Owner

@FellowTraveler commented on GitHub (Apr 30, 2025):

Looking forward to this one for sure! May be the best sampler yet. Double your local model's creativity and intelligence without increasing perplexity

<!-- gh-comment-id:2842138927 --> @FellowTraveler commented on GitHub (Apr 30, 2025): Looking forward to this one for sure! May be the best sampler yet. Double your local model's creativity and intelligence without increasing perplexity
Author
Owner

@SmallAndSoft commented on GitHub (Jul 11, 2025):

I second that. Good sampler in my testing experience with llama.cpp

<!-- gh-comment-id:3063008378 --> @SmallAndSoft commented on GitHub (Jul 11, 2025): I second that. Good sampler in my testing experience with llama.cpp
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#6184