[GH-ISSUE #1923] choosing the right model to interact #47618

Closed
opened 2026-04-28 04:31:41 -05:00 by GiteaMirror · 1 comment
Owner

Originally created by @umtksa on GitHub (Jan 11, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/1923

I can use a custom mistral modelfile to choose which model is the best choice based on the subject.
like in my model file "choose" all models have descriptions like copywriter model or weather model
based on the subject mistral can choose the best model and gives me the command to run
so I can run it through the model I want.

This is working as expected but I'm a noob and I'm not sure this is the best way to do this.
basically I run
ollama run choose "weather is 16 degrees outside"
and it gives me
ollama run weather "weather is 16 degrees outside"
so is using mistral overkill for this purpose? I tried the same modelfile with other models without success like tinyllama.
mistral is the best one I come up for this subject.
So any suggestions? (tried regex without success before this)
this issue can have a label as question or this could be a feature request.
cross posting to reddit

Originally created by @umtksa on GitHub (Jan 11, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/1923 I can use a custom mistral modelfile to choose which model is the best choice based on the subject. like in my model file "choose" all models have descriptions like copywriter model or weather model based on the subject mistral can choose the best model and gives me the command to run so I can run it through the model I want. This is working as expected but I'm a noob and I'm not sure this is the best way to do this. basically I run `ollama run choose "weather is 16 degrees outside"` and it gives me `ollama run weather "weather is 16 degrees outside"` so is using mistral overkill for this purpose? I tried the same modelfile with other models without success like tinyllama. mistral is the best one I come up for this subject. So any suggestions? (tried regex without success before this) this issue can have a label as question or this could be a feature request. [cross posting to reddit](https://www.reddit.com/r/ollama/comments/193xvzm/choosing_the_right_model_to_interact/)
GiteaMirror added the question label 2026-04-28 04:31:41 -05:00
Author
Owner

@pdevine commented on GitHub (Mar 11, 2024):

This is a great question, and sorry for the slow response. I hadn't really though about how to do this, but the suggestions in the reddit thread are great. I would definitely recommend checking out phi to use a smaller model, and I would also "prompt engineer" the model to give it some good suggestions about the responses that you're expecting.

I'm going to go ahead and close the issue, but feel free to keep commenting.

<!-- gh-comment-id:1989275044 --> @pdevine commented on GitHub (Mar 11, 2024): This is a great question, and sorry for the slow response. I hadn't really though about how to do this, but the suggestions in the reddit thread are great. I would definitely recommend checking out `phi` to use a smaller model, and I would also "prompt engineer" the model to give it some good suggestions about the responses that you're expecting. I'm going to go ahead and close the issue, but feel free to keep commenting.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#47618