[GH-ISSUE #5337] How can I set the parameter "num_return_sequences" to get multiple answers within one prompt? #3341

Open
opened 2026-04-12 13:56:36 -05:00 by GiteaMirror · 1 comment
Owner

Originally created by @superjessie on GitHub (Jun 27, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/5337

The parameter "num_return_sequences" is a parameter in model.generate(), while I did not figure out how to set it when using ollama to run LLMs.

Originally created by @superjessie on GitHub (Jun 27, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/5337 The parameter "num_return_sequences" is a parameter in model.generate(), while I did not figure out how to set it when using ollama to run LLMs.
GiteaMirror added the feature request label 2026-04-12 13:56:36 -05:00
Author
Owner

@d-kleine commented on GitHub (Jun 27, 2024):

I think in ollama you can't set it (yet), the framework does not have a direct parameter for that in server.go

<!-- gh-comment-id:2195481280 --> @d-kleine commented on GitHub (Jun 27, 2024): I think in ollama you can't set it (yet), the framework does not have a direct parameter for that in `server.go`
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#3341