[GH-ISSUE #617] Request: exposing Options in ollama serve #272

Closed
opened 2026-04-12 09:48:46 -05:00 by GiteaMirror · 1 comment
Owner

Originally created by @jamesbraza on GitHub (Sep 27, 2023).
Original GitHub issue: https://github.com/ollama/ollama/issues/617

Coming from https://github.com/jmorganca/ollama/issues/581#issuecomment-1733841969, it would be useful to expose Options parameters like num_predict in the CLI (ollama serve).

Thanks in advance, and also feel free to close this as only supporting options in POST

Originally created by @jamesbraza on GitHub (Sep 27, 2023). Original GitHub issue: https://github.com/ollama/ollama/issues/617 Coming from https://github.com/jmorganca/ollama/issues/581#issuecomment-1733841969, it would be useful to expose `Options` parameters like `num_predict` in the CLI (`ollama serve`). Thanks in advance, and also feel free to close this as only supporting `options` in POST
Author
Owner

@mchiang0610 commented on GitHub (Sep 30, 2023):

if we do it for ollama serve in the CLI, we'd be doing it across all requests.

We give you the flexibility to set this in the API, so you can change it based on the request.

Thank you for bringing this up though! Helps me learn where Ollama is a little weird to use.

<!-- gh-comment-id:1741676234 --> @mchiang0610 commented on GitHub (Sep 30, 2023): if we do it for `ollama serve` in the CLI, we'd be doing it across all requests. We give you the flexibility to set this in the API, so you can change it based on the request. Thank you for bringing this up though! Helps me learn where Ollama is a little weird to use.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#272