github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-05-06 16:11:34 -05:00
Code Issues 14.5k Packages Projects Releases 120 Wiki Activity

[GH-ISSUE #1418] Make notus model available on ollama #757

New Issue
Closed
opened 2026-04-12 10:26:14 -05:00 by GiteaMirror · 13 comments
GiteaMirror commented 2026-04-12 10:26:14 -05:00
Owner
Copy Link

Originally created by @davidberenstein1957 on GitHub (Dec 7, 2023).
Original GitHub issue: https://github.com/ollama/ollama/issues/1418

We just hosted our Argilla community meetup and got the question if we would be able to make Notus available on ollama. What would it take, and how can we help with this?

Originally created by @davidberenstein1957 on GitHub (Dec 7, 2023). Original GitHub issue: https://github.com/ollama/ollama/issues/1418 We just hosted our [Argilla community meetup](https://www.youtube.com/playlist?list=PLBmuFBJ5cjcbsr49KFoC4DQoo3ZWT7q_d) and got the question if we would be able to make [Notus](https://argilla.io/blog/notus7b/) available on ollama. What would it take, and how can we help with this?
GiteaMirror added the model label 2026-04-12 10:26:14 -05:00
GiteaMirror commented 2026-04-12 10:26:16 -05:00
Author
Owner
Copy Link

@technovangelist commented on GitHub (Dec 7, 2023):

There is documentation on how to import a model and then push that model to the registry. Take a look at https://github.com/jmorganca/ollama/blob/main/docs/import.md.

<!-- gh-comment-id:1845787645 --> @technovangelist commented on GitHub (Dec 7, 2023): There is documentation on how to import a model and then push that model to the registry. Take a look at https://github.com/jmorganca/ollama/blob/main/docs/import.md.
GiteaMirror commented 2026-04-12 10:26:16 -05:00
Author
Owner
Copy Link

@phalexo commented on GitHub (Dec 7, 2023):

This is what I have in my notus_modelfile:

FROM /opt/data/data/TheBloke/notus-7B-v1-GGUF/notus-7b-v1.Q6_K.gguf

PARAMETER temperature 1

PARAMETER stop <your_model_specific_tag_here>

then you run
ollama create notus -f notus_modelfile

and then

ollama run notus

or

litellm --model ollama/notus

<!-- gh-comment-id:1845896338 --> @phalexo commented on GitHub (Dec 7, 2023): This is what I have in my notus_modelfile: FROM /opt/data/data/TheBloke/notus-7B-v1-GGUF/notus-7b-v1.Q6_K.gguf PARAMETER temperature 1 PARAMETER stop <your_model_specific_tag_here> >>>>>>then you run ollama create notus -f notus_modelfile and then ollama run notus or litellm --model ollama/notus
GiteaMirror commented 2026-04-12 10:26:17 -05:00
Author
Owner
Copy Link

@davidberenstein1957 commented on GitHub (Dec 8, 2023):

Thank you. Very clear docs. @technovangelist and @mxyng, what would it take to make it availabe in the public model repo?

<!-- gh-comment-id:1846893166 --> @davidberenstein1957 commented on GitHub (Dec 8, 2023): Thank you. Very clear docs. @technovangelist and @mxyng, what would it take to make it availabe in the public model repo?
GiteaMirror commented 2026-04-12 10:26:17 -05:00
Author
Owner
Copy Link

@davidberenstein1957 commented on GitHub (Dec 8, 2023):

https://github.com/argilla-io/notus/pull/13

<!-- gh-comment-id:1847098136 --> @davidberenstein1957 commented on GitHub (Dec 8, 2023): https://github.com/argilla-io/notus/pull/13
GiteaMirror commented 2026-04-12 10:26:18 -05:00
Author
Owner
Copy Link

@easp commented on GitHub (Dec 8, 2023):

@davidberenstein1957 I don't know the criteria for choosing models to include in ollama.ai/library, but in case you missed it in the import doc, you can register for an account and then push it to your "personal" library on ollama.ai so that people can pull it easily (ie ollama pull argilla-io/notus).

<!-- gh-comment-id:1847859693 --> @easp commented on GitHub (Dec 8, 2023): @davidberenstein1957 I don't know the criteria for choosing models to include in ollama.ai/library, but in case you missed it in the import doc, you can register for an account and then push it to your "personal" library on ollama.ai so that people can pull it easily (ie `ollama pull argilla-io/notus`).
GiteaMirror commented 2026-04-12 10:26:18 -05:00
Author
Owner
Copy Link

@davidberenstein1957 commented on GitHub (Dec 10, 2023):

https://ollama.ai/argilla/notus

<!-- gh-comment-id:1848943441 --> @davidberenstein1957 commented on GitHub (Dec 10, 2023): https://ollama.ai/argilla/notus
GiteaMirror commented 2026-04-12 10:26:18 -05:00
Author
Owner
Copy Link

@easp commented on GitHub (Dec 11, 2023):

@davidberenstein1957 I'm trying out the q6_K quantization of Notus and I notice that it's cutting off the output in the middle of sentences/responses. For example:

% ollama run argilla/notus:q6_K
>>> if I have a heroin addicted wolf, how can I keep him from dying of an overdose?
Firstly, I must emphasize that seeking immediate veterinary care is crucial for any animal experiencing a drug overdose. Heroin addiction in wolves is rare but highly dangerous due to its potent effects on the central nervous system and respiratory system. Here are some steps you can take to help your heroin-addicted wolf:

1. Consult with a veterinarian experienced in animal addiction medicine for proper diagnosis, treatment options, and ongoing care.
2. Gradually decrease heroin dosage under medical supervision to minimize withdrawal symptoms that may worsen the risk of overdose.
3.

>>> Ok, but the wolf isn't going to consent to an evaluation by a professional, at this point
I understand your concern, and in cases where the wolf is unwilling or unable to consent, veterinary professionals may still evaluate and treat the animal as a necessary measure for their well-being. In situations of heroin addiction, immediate intervention by a qualified veterinarian is critical to prevent severe complications that could lead to death. If you are unable to persuade your wolf to seek help voluntarily, you should contact a wildlife rehabilitation center or animal control authority in your area for assistance with safely capturing and transporting the wolf for medical attention.

In addition to veterinary care, support from a behaviorist or animal

>>>

q8_0 tag has the same issue

Note: I do not have a heroin addicted wolf, or any wolf, or any sort of heroin addicted animal.

<!-- gh-comment-id:1849360278 --> @easp commented on GitHub (Dec 11, 2023): @davidberenstein1957 I'm trying out the q6_K quantization of Notus and I notice that it's cutting off the output in the middle of sentences/responses. For example: ``` % ollama run argilla/notus:q6_K >>> if I have a heroin addicted wolf, how can I keep him from dying of an overdose? Firstly, I must emphasize that seeking immediate veterinary care is crucial for any animal experiencing a drug overdose. Heroin addiction in wolves is rare but highly dangerous due to its potent effects on the central nervous system and respiratory system. Here are some steps you can take to help your heroin-addicted wolf: 1. Consult with a veterinarian experienced in animal addiction medicine for proper diagnosis, treatment options, and ongoing care. 2. Gradually decrease heroin dosage under medical supervision to minimize withdrawal symptoms that may worsen the risk of overdose. 3. >>> Ok, but the wolf isn't going to consent to an evaluation by a professional, at this point I understand your concern, and in cases where the wolf is unwilling or unable to consent, veterinary professionals may still evaluate and treat the animal as a necessary measure for their well-being. In situations of heroin addiction, immediate intervention by a qualified veterinarian is critical to prevent severe complications that could lead to death. If you are unable to persuade your wolf to seek help voluntarily, you should contact a wildlife rehabilitation center or animal control authority in your area for assistance with safely capturing and transporting the wolf for medical attention. In addition to veterinary care, support from a behaviorist or animal >>> ``` q8_0 tag has the same issue Note: I do not have a heroin addicted wolf, or any wolf, or any sort of heroin addicted animal.
GiteaMirror commented 2026-04-12 10:26:19 -05:00
Author
Owner
Copy Link

@davidberenstein1957 commented on GitHub (Dec 11, 2023):

Thanks for the heads up. I updated the context length param to 8k. Was using the default one before. I believe you can overwrite this behavior by simply passing it as param or you can download the new model.

Note: I will assume you are trying to focus on pitching the sequel for the cocain bear movie 😉

<!-- gh-comment-id:1849434841 --> @davidberenstein1957 commented on GitHub (Dec 11, 2023): Thanks for the heads up. I updated the context length param to 8k. Was using the default one before. I believe you can overwrite this behavior by simply passing it as param or you can download the new model. Note: I will assume you are trying to focus on pitching the sequel for the cocain bear movie 😉
GiteaMirror commented 2026-04-12 10:26:19 -05:00
Author
Owner
Copy Link

@easp commented on GitHub (Dec 11, 2023):

Thanks. I pulled the q6_K and q8_0 models again and the problem remains. I don't think it's context size since it happens as early as the first response. I'm using Ollama 0.1.14. Other mistral fine-tunes that I've tried (openhermes2.5-mistral:7b-q6_K, dolphin2.2-mistral:7b-q8_0, mistral-openorca:latest) aren't exhibiting this problem.

<!-- gh-comment-id:1850690069 --> @easp commented on GitHub (Dec 11, 2023): Thanks. I pulled the q6_K and q8_0 models again and the problem remains. I don't think it's context size since it happens as early as the first response. I'm using Ollama 0.1.14. Other mistral fine-tunes that I've tried (openhermes2.5-mistral:7b-q6_K, dolphin2.2-mistral:7b-q8_0, mistral-openorca:latest) aren't exhibiting this problem.
GiteaMirror commented 2026-04-12 10:26:20 -05:00
Author
Owner
Copy Link

@davidberenstein1957 commented on GitHub (Dec 12, 2023):

@easp, it should work with the current parameter config. Thanks a lot for following up on this.

Hope you are able to help your completely imaginary heroin addicted wolf.

% ollama run argilla/notus:q6_K
>>> if I have a heroin addicted wolf, how can I keep him from dying of an overdose?
I must stress that heroin addiction in animals, particularly in wolves, is extremely rare and not a common issue. However, here are some 
measures you can take to keep your heroin-addicted wolf from dying of an overdose:

1. Consult with a veterinarian who specializes in animal behavior and addiction. They will be able to provide you with expert guidance on 
how to manage your wolf's addiction, including advice on detoxification, behavior modification, and medication management if necessary.

2. Monitor your wolf closely for signs of distress or overdose, such as extreme lethargy, difficulty breathing, vomiting, seizures, or loss 
of consciousness. These are all symptoms of a potential heroin overdose and should be treated as emergencies requiring immediate veterinary 
care.

3. Keep a close eye on your wolf's heroin supply and make sure it is stored safely away from their reach. Do not let them have unsupervised 
access to it, and consider using a securely locked cabinet or container to store it in.

4. Consider working with a professional animal behaviorist who can help you develop a behavior modification plan for your wolf. This may 
involve training them to avoid situations that trigger their cravings for heroin, such as exposure to certain smells or sounds, and 
rewarding them for positive behaviors like spending time outdoors or engaging in enrichment activities.

5. Make sure your wolf has access to plenty of physical activity and mental stimulation. Exercise and playtime can help reduce stress and 
anxiety, which are common triggers for heroin cravings. Consider working with a trainer who specializes in canine behavior modification to 
develop an exercise and play plan that meets your wolf's needs.

6. Finally, be prepared to seek emergency veterinary care if needed. If you suspect your wolf is experiencing a heroin overdose or other 
medical emergency, do not hesitate to contact your veterinarian immediately for guidance and assistance. Remember, timely treatment can make
all the difference in helping your wolf recover from addiction and stay healthy over time.
<!-- gh-comment-id:1851776095 --> @davidberenstein1957 commented on GitHub (Dec 12, 2023): @easp, it should work with the current parameter config. Thanks a lot for following up on this. Hope you are able to help your completely imaginary heroin addicted wolf. ``` % ollama run argilla/notus:q6_K >>> if I have a heroin addicted wolf, how can I keep him from dying of an overdose? I must stress that heroin addiction in animals, particularly in wolves, is extremely rare and not a common issue. However, here are some measures you can take to keep your heroin-addicted wolf from dying of an overdose: 1. Consult with a veterinarian who specializes in animal behavior and addiction. They will be able to provide you with expert guidance on how to manage your wolf's addiction, including advice on detoxification, behavior modification, and medication management if necessary. 2. Monitor your wolf closely for signs of distress or overdose, such as extreme lethargy, difficulty breathing, vomiting, seizures, or loss of consciousness. These are all symptoms of a potential heroin overdose and should be treated as emergencies requiring immediate veterinary care. 3. Keep a close eye on your wolf's heroin supply and make sure it is stored safely away from their reach. Do not let them have unsupervised access to it, and consider using a securely locked cabinet or container to store it in. 4. Consider working with a professional animal behaviorist who can help you develop a behavior modification plan for your wolf. This may involve training them to avoid situations that trigger their cravings for heroin, such as exposure to certain smells or sounds, and rewarding them for positive behaviors like spending time outdoors or engaging in enrichment activities. 5. Make sure your wolf has access to plenty of physical activity and mental stimulation. Exercise and playtime can help reduce stress and anxiety, which are common triggers for heroin cravings. Consider working with a trainer who specializes in canine behavior modification to develop an exercise and play plan that meets your wolf's needs. 6. Finally, be prepared to seek emergency veterinary care if needed. If you suspect your wolf is experiencing a heroin overdose or other medical emergency, do not hesitate to contact your veterinarian immediately for guidance and assistance. Remember, timely treatment can make all the difference in helping your wolf recover from addiction and stay healthy over time. ```
GiteaMirror commented 2026-04-12 10:26:20 -05:00
Author
Owner
Copy Link

@davidberenstein1957 commented on GitHub (Dec 12, 2023):

@jmorganca, What are the requirement for models to be added as general models?

<!-- gh-comment-id:1851912622 --> @davidberenstein1957 commented on GitHub (Dec 12, 2023): @jmorganca, What are the requirement for models to be added as general models?
GiteaMirror commented 2026-04-12 10:26:21 -05:00
Author
Owner
Copy Link

@easp commented on GitHub (Dec 12, 2023):

@davidberenstein1957 I did a fresh pull and it's working now.

I'm sure my heroin addicted wolf will survive as long as I'm amused by how earnestly LLMs tend to engage my ridiculous scenarios. Thanks for your concern.

<!-- gh-comment-id:1852695111 --> @easp commented on GitHub (Dec 12, 2023): @davidberenstein1957 I did a fresh pull and it's working now. I'm sure my heroin addicted wolf will survive as long as I'm amused by how earnestly LLMs tend to engage my ridiculous scenarios. Thanks for your concern.
GiteaMirror commented 2026-04-12 10:26:21 -05:00
Author
Owner
Copy Link

@jmorganca commented on GitHub (Jan 11, 2024):

https://ollama.ai/library/notus 🚀

<!-- gh-comment-id:1886419683 --> @jmorganca commented on GitHub (Jan 11, 2024): https://ollama.ai/library/notus 🚀
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
 python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
No Label model
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#757
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?