[GH-ISSUE #3795] Support logit_bias #64380

Open
opened 2026-05-03 17:26:12 -05:00 by GiteaMirror · 2 comments
Owner

Originally created by @jmccrosky on GitHub (Apr 21, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/3795

Just want to put on the record that I'd love to see support for the logit_bias parameter for the chat/completions endpoint.

Originally created by @jmccrosky on GitHub (Apr 21, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/3795 Just want to put on the record that I'd love to see support for the logit_bias parameter for the chat/completions endpoint.
GiteaMirror added the feature request label 2026-05-03 17:26:12 -05:00
Author
Owner

@r888800009 commented on GitHub (Apr 3, 2025):

I found a related issue in #2415.
Additionally, PR #9282 is still in progress, modifying the runner to support parameters such as logprobs.

<!-- gh-comment-id:2774552313 --> @r888800009 commented on GitHub (Apr 3, 2025): I found a related issue in #2415. Additionally, PR #9282 is still in progress, modifying the runner to support parameters such as `logprobs`.
Author
Owner

@codelion commented on GitHub (Apr 7, 2025):

You can use optillm for that - https://github.com/codelion/optillm see https://github.com/codelion/optillm/discussions/168#discussioncomment-12399569 you can also visualize the ouputs using the logprobs visualizer - https://huggingface.co/spaces/codelion/LogProbsVisualizer

<!-- gh-comment-id:2784827548 --> @codelion commented on GitHub (Apr 7, 2025): You can use optillm for that - https://github.com/codelion/optillm see https://github.com/codelion/optillm/discussions/168#discussioncomment-12399569 you can also visualize the ouputs using the logprobs visualizer - https://huggingface.co/spaces/codelion/LogProbsVisualizer
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#64380