[GH-ISSUE #765] How to run custom fine-tuned llama2 model into ollama? #364

Closed
opened 2026-04-12 10:00:27 -05:00 by GiteaMirror · 4 comments
Owner

Originally created by @aswinjose89 on GitHub (Oct 12, 2023).
Original GitHub issue: https://github.com/ollama/ollama/issues/765

Originally created by @aswinjose89 on GitHub (Oct 12, 2023). Original GitHub issue: https://github.com/ollama/ollama/issues/765
Author
Owner

@Clivern commented on GitHub (Oct 12, 2023):

You need to create a Modelfile on a top of any model https://github.com/jmorganca/ollama/blob/main/examples/devops-engineer/Modelfile. Then load it

$ ollama create devops-engineer -f ./Modelfile

Then you can interact with it

$ ollama run devops-engineer

BTW i am using ollama as API service not the desktop app.

<!-- gh-comment-id:1759466869 --> @Clivern commented on GitHub (Oct 12, 2023): You need to create a Modelfile on a top of any model https://github.com/jmorganca/ollama/blob/main/examples/devops-engineer/Modelfile. Then load it ``` $ ollama create devops-engineer -f ./Modelfile ``` Then you can interact with it ``` $ ollama run devops-engineer ``` BTW i am using ollama as API service not the desktop app.
Author
Owner

@wertyac commented on GitHub (Oct 13, 2023):

it doesn't work. I have a own gguf file in /opt/cllama2-13b-16k/chinese-alpaca-2-13b-16k.Q4_0.gguf . And I create the Modefile in /opt/cllama2-13b-16k.
################################
FROM /opt/cllama2-13b-16k/chinese-alpaca-2-13b-16k.Q4_0.gguf

The I create my own cllama2 with:
root@144server:/opt/cllama2-13b-16k# ollama create cllama2-13b-16k -f ./Modelfile
parsing modelfile
looking for model
pulling model file
⠧ pulling manifest Error: pull model manifest: model not found

How to create???

<!-- gh-comment-id:1761005822 --> @wertyac commented on GitHub (Oct 13, 2023): it doesn't work. I have a own gguf file in /opt/cllama2-13b-16k/chinese-alpaca-2-13b-16k.Q4_0.gguf . And I create the Modefile in /opt/cllama2-13b-16k. ################################ FROM /opt/cllama2-13b-16k/chinese-alpaca-2-13b-16k.Q4_0.gguf The I create my own cllama2 with: root@144server:/opt/cllama2-13b-16k# ollama create cllama2-13b-16k -f ./Modelfile parsing modelfile looking for model pulling model file ⠧ pulling manifest Error: pull model manifest: model not found How to create???
Author
Owner

@saikatkumardey commented on GitHub (Oct 14, 2023):

This might be what you're looking for: https://github.com/jmorganca/ollama/issues/775#issuecomment-1762965343

<!-- gh-comment-id:1762965678 --> @saikatkumardey commented on GitHub (Oct 14, 2023): This might be what you're looking for: https://github.com/jmorganca/ollama/issues/775#issuecomment-1762965343
Author
Owner

@technovangelist commented on GitHub (Dec 4, 2023):

It looks like this issue has been addressed so I will go ahead and close it now. If you think there is anything we left out, reopen and we can address. Thanks for being part of this great community.

<!-- gh-comment-id:1839399270 --> @technovangelist commented on GitHub (Dec 4, 2023): It looks like this issue has been addressed so I will go ahead and close it now. If you think there is anything we left out, reopen and we can address. Thanks for being part of this great community.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#364