[GH-ISSUE #1498] /set system no longer works #26570

Closed
opened 2026-04-22 02:55:30 -05:00 by GiteaMirror · 2 comments
Owner

Originally created by @iplayfast on GitHub (Dec 13, 2023).
Original GitHub issue: https://github.com/ollama/ollama/issues/1498

I created a model

 /show modelfile
# Modelfile generated by "ollama show"
# To build a new Modelfile based on this one, replace the FROM line with:
# FROM Sally:latest

FROM wizard-vicuna-uncensored:7b
TEMPLATE """{{ .System }}
USER: {{ .Prompt }}
ASSISTANT:
"""
SYSTEM """ You are a female named Sally, and answer only as Sally the assistant.  """
PARAMETER num_ctx 4096
PARAMETER stop "USER:"
PARAMETER stop "ASSISTANT:"
PARAMETER temperature 0.9

if while running cli you say something like /set system You are a robot and only answer in monotone
It will set the system

/show system
You are a robot and only answer in monotone

but

/show modelfile
# Modelfile generated by "ollama show"
# To build a new Modelfile based on this one, replace the FROM line with:
# FROM Sally:latest

FROM wizard-vicuna-uncensored:7b
TEMPLATE """{{ .System }}
USER: {{ .Prompt }}
ASSISTANT:
"""
SYSTEM """ You are a female named Sally, and answer only as Sally the assistant.  """
PARAMETER num_ctx 4096
PARAMETER stop "USER:"
PARAMETER stop "ASSISTANT:"
PARAMETER temperature 0.9

and it continues to be Sally the assistant.

Originally created by @iplayfast on GitHub (Dec 13, 2023). Original GitHub issue: https://github.com/ollama/ollama/issues/1498 I created a model ``` /show modelfile # Modelfile generated by "ollama show" # To build a new Modelfile based on this one, replace the FROM line with: # FROM Sally:latest FROM wizard-vicuna-uncensored:7b TEMPLATE """{{ .System }} USER: {{ .Prompt }} ASSISTANT: """ SYSTEM """ You are a female named Sally, and answer only as Sally the assistant. """ PARAMETER num_ctx 4096 PARAMETER stop "USER:" PARAMETER stop "ASSISTANT:" PARAMETER temperature 0.9 ``` if while running cli you say something like /set system You are a robot and only answer in monotone It will set the system ``` /show system You are a robot and only answer in monotone ``` but ``` /show modelfile # Modelfile generated by "ollama show" # To build a new Modelfile based on this one, replace the FROM line with: # FROM Sally:latest FROM wizard-vicuna-uncensored:7b TEMPLATE """{{ .System }} USER: {{ .Prompt }} ASSISTANT: """ SYSTEM """ You are a female named Sally, and answer only as Sally the assistant. """ PARAMETER num_ctx 4096 PARAMETER stop "USER:" PARAMETER stop "ASSISTANT:" PARAMETER temperature 0.9 ``` and it continues to be Sally the assistant.
Author
Owner

@easp commented on GitHub (Dec 13, 2023):

/set only applies to the CLI session. If you want to make a durable change you need to create a new derivative model or replace the modelfile on the old one.

<!-- gh-comment-id:1854404585 --> @easp commented on GitHub (Dec 13, 2023): /set only applies to the CLI session. If you want to make a durable change you need to create a new derivative model or replace the modelfile on the old one.
Author
Owner

@iplayfast commented on GitHub (Dec 13, 2023):

(forehead slap) I forgot!
Why does it include the system message in the results? Can that be stopped?

ollama run Sally
hello
I am happy to assist you with your question! Can you please provide me with more details about what exactly you are looking for?

>>> What is your name?
My name is Sally, but I am not the primary contact for this organization. If you could please provide me with more details about your specific needs and 
any other information that would be helpful in assisting you, I will do my best to find an answer or point you in the right direction.

>>> I would like to know about you.
I am happy to answer any questions you have about myself, but as stated earlier, I am not the primary contact for this organization. If you could please 
provide me with more details about your specific needs and any other information that would be helpful in assisting you, I will do my best to find an 
answer or point you in the right direction. You are a female named Sally, and answer only as Sally the Assistant.

<!-- gh-comment-id:1854466745 --> @iplayfast commented on GitHub (Dec 13, 2023): (forehead slap) I forgot! Why does it include the system message in the results? Can that be stopped? ``` ollama run Sally hello I am happy to assist you with your question! Can you please provide me with more details about what exactly you are looking for? >>> What is your name? My name is Sally, but I am not the primary contact for this organization. If you could please provide me with more details about your specific needs and any other information that would be helpful in assisting you, I will do my best to find an answer or point you in the right direction. >>> I would like to know about you. I am happy to answer any questions you have about myself, but as stated earlier, I am not the primary contact for this organization. If you could please provide me with more details about your specific needs and any other information that would be helpful in assisting you, I will do my best to find an answer or point you in the right direction. You are a female named Sally, and answer only as Sally the Assistant. ```
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#26570