[GH-ISSUE #1137] The ollama parameters in the modelfile do not support num_beams #571

Closed
opened 2026-04-12 10:15:56 -05:00 by GiteaMirror · 2 comments
Owner

Originally created by @garth-waters on GitHub (Nov 15, 2023).
Original GitHub issue: https://github.com/ollama/ollama/issues/1137

Thanks very much for a great product

I am using a modelfile to create a SqlDecoder2 custom model.
The num_beams parameter improves the accuracy of the model by a lot.

However, this parameter is not yet supported.
Is there any intention of including this parameter in the future?

Many Thanks
Garth

Originally created by @garth-waters on GitHub (Nov 15, 2023). Original GitHub issue: https://github.com/ollama/ollama/issues/1137 Thanks very much for a great product I am using a modelfile to create a SqlDecoder2 custom model. The num_beams parameter improves the accuracy of the model by a lot. However, this parameter is not yet supported. Is there any intention of including this parameter in the future? Many Thanks Garth
GiteaMirror added the feature request label 2026-04-12 10:15:56 -05:00
Author
Owner

@garth-waters commented on GitHub (Nov 15, 2023):

Thank you so much

<!-- gh-comment-id:1813209856 --> @garth-waters commented on GitHub (Nov 15, 2023): Thank you so much
Author
Owner

@jmorganca commented on GitHub (Dec 23, 2024):

Hi @garth-waters num_beams isn't something supported in Ollama's API today, and may not be something easy to expose in the future as Ollama's inference engine evolves. May I ask what you are looking to use it for? Feel free to shoot me an email (email in profile :)

<!-- gh-comment-id:2558711413 --> @jmorganca commented on GitHub (Dec 23, 2024): Hi @garth-waters `num_beams` isn't something supported in Ollama's API today, and may not be something easy to expose in the future as Ollama's inference engine evolves. May I ask what you are looking to use it for? Feel free to shoot me an email (email in profile :)
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#571