[PR #14778] runner: bring back repetition-based samplers with better performance #25371

Open
opened 2026-04-19 18:10:44 -05:00 by GiteaMirror · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/ollama/ollama/pull/14778
Author: @jmorganca
Created: 3/11/2026
Status: 🔄 Open

Base: mainHead: jmorganca/faster-reptition-penalties


📝 Commits (3)

  • d64d0d2 Add sampler reset on reprocess
  • 4ad9f16 Fix repeat penalty default
  • 7563f51 sample: fix lint issues in penalty sampler

📊 Changes

8 files changed (+247 additions, -14 deletions)

View changed files

📝 api/types.go (+1 -1)
📝 docs/modelfile.mdx (+1 -1)
📝 runner/ollamarunner/runner.go (+23 -1)
📝 sample/samplers.go (+75 -1)
📝 sample/samplers_benchmark_test.go (+4 -4)
📝 sample/samplers_test.go (+53 -6)
📝 sample/transforms.go (+21 -0)
📝 sample/transforms_test.go (+69 -0)

📄 Description

No description provided


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/ollama/ollama/pull/14778 **Author:** [@jmorganca](https://github.com/jmorganca) **Created:** 3/11/2026 **Status:** 🔄 Open **Base:** `main` ← **Head:** `jmorganca/faster-reptition-penalties` --- ### 📝 Commits (3) - [`d64d0d2`](https://github.com/ollama/ollama/commit/d64d0d235d3450dc4a9cd9c1eda44fb7a259410a) Add sampler reset on reprocess - [`4ad9f16`](https://github.com/ollama/ollama/commit/4ad9f16d68bcc6e7406aef1de40ba183162bb0b5) Fix repeat penalty default - [`7563f51`](https://github.com/ollama/ollama/commit/7563f51fdfad4b77f9de420ffbdc5ffa56191ea7) sample: fix lint issues in penalty sampler ### 📊 Changes **8 files changed** (+247 additions, -14 deletions) <details> <summary>View changed files</summary> 📝 `api/types.go` (+1 -1) 📝 `docs/modelfile.mdx` (+1 -1) 📝 `runner/ollamarunner/runner.go` (+23 -1) 📝 `sample/samplers.go` (+75 -1) 📝 `sample/samplers_benchmark_test.go` (+4 -4) 📝 `sample/samplers_test.go` (+53 -6) 📝 `sample/transforms.go` (+21 -0) 📝 `sample/transforms_test.go` (+69 -0) </details> ### 📄 Description _No description provided_ --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
GiteaMirror added the pull-request label 2026-04-19 18:10:44 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#25371