[GH-ISSUE #6321] Feature request : get probability distribution #3968

Closed
opened 2026-04-12 14:50:32 -05:00 by GiteaMirror · 1 comment
Owner

Originally created by @Alireza3242 on GitHub (Aug 12, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/6321

I have a prompt and then i get an answer. In some part of answer is a JSON, something like this:

{
    res:"yes"
}

or this:

{
    res:"no"
}

I want to know the probability of token "yes" and "no". and use these probabilities in some algorithm.

Originally created by @Alireza3242 on GitHub (Aug 12, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/6321 I have a prompt and then i get an answer. In some part of answer is a JSON, something like this: ``` { res:"yes" } ``` or this: ``` { res:"no" } ``` I want to know the probability of token "yes" and "no". and use these probabilities in some algorithm.
GiteaMirror added the feature request label 2026-04-12 14:50:32 -05:00
Author
Owner

@jmorganca commented on GitHub (Sep 2, 2024):

Hi there, will merge this with https://github.com/ollama/ollama/issues/2415

<!-- gh-comment-id:2325364255 --> @jmorganca commented on GitHub (Sep 2, 2024): Hi there, will merge this with https://github.com/ollama/ollama/issues/2415
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#3968