[GH-ISSUE #3520] The ability to pass session commands as startup arguments client-side #48681

Closed
opened 2026-04-28 09:05:33 -05:00 by GiteaMirror · 0 comments
Owner

Originally created by @redpiller on GitHub (Apr 7, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/3520

What are you trying to do?

I recently attempted to make permanent adjustments to the system prompt of a model and realized it is a cumbersome process of rebuilding the model, changing its manifest causing a lot of needless IO to my SSD.
This lack of scalability is a critical flaw in a software peace of this magnitude.

How should we solve this?

The ability to pass session commands as startup arguments (client side) would drastically reduce the need of rebuilding the entire language model, consequently improving this project's scalability and enabling its incorporation into other systems.

What is the impact of not solving this?

The lack of scalability preventing this project from being included into more complex environments.
A cumbersome process of rebuilding the model, changing its manifest causing a lot of needless IO to the drive every time a session-level adjustment is in order.

Anything else?

No response

Originally created by @redpiller on GitHub (Apr 7, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/3520 ### What are you trying to do? I recently attempted to make permanent adjustments to the system prompt of a model and realized it is a cumbersome process of rebuilding the model, changing its manifest causing a lot of needless IO to my SSD. This lack of scalability is a critical flaw in a software peace of this magnitude. ### How should we solve this? The ability to pass session commands as startup arguments (client side) would drastically reduce the need of rebuilding the entire language model, consequently improving this project's scalability and enabling its incorporation into other systems. ### What is the impact of not solving this? The lack of scalability preventing this project from being included into more complex environments. A cumbersome process of rebuilding the model, changing its manifest causing a lot of needless IO to the drive every time a session-level adjustment is in order. ### Anything else? _No response_
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#48681