[GH-ISSUE #511] Support InternLM #62274

Closed
opened 2026-05-03 08:04:33 -05:00 by GiteaMirror · 6 comments
Owner

Originally created by @vansinhu on GitHub (Sep 12, 2023).
Original GitHub issue: https://github.com/ollama/ollama/issues/511

Dear ollama developer,

Greetings! I am vansinhu, a community developer and volunteer at InternLM. InternLM is a large language model similar to llama2, and we look forward to InternLM being supported in ollama. If there are any challenges or inquiries regarding support for InternLM, please feel free to join our Discord discussion at https://discord.gg/gF9ezcmtM3.

Best regards,
vansinhu

Originally created by @vansinhu on GitHub (Sep 12, 2023). Original GitHub issue: https://github.com/ollama/ollama/issues/511 Dear ollama developer, Greetings! I am vansinhu, a community developer and volunteer at InternLM. [InternLM](https://github.com/InternLM/InternLM) is a large language model similar to llama2, and we look forward to InternLM being supported in ollama. If there are any challenges or inquiries regarding support for InternLM, please feel free to join our Discord discussion at https://discord.gg/gF9ezcmtM3. Best regards, vansinhu
GiteaMirror added the model label 2026-05-03 08:04:33 -05:00
Author
Owner

@mchiang0610 commented on GitHub (Sep 30, 2023):

@vansinhu I would love to support this. Will take a look through your huggingface repos. Sorry for the delay!!

<!-- gh-comment-id:1741681392 --> @mchiang0610 commented on GitHub (Sep 30, 2023): @vansinhu I would love to support this. Will take a look through your huggingface repos. Sorry for the delay!!
Author
Owner

@mchiang0610 commented on GitHub (Sep 30, 2023):

Possible to ask you to quantize the models, and then upload it to ollama?

<!-- gh-comment-id:1741684359 --> @mchiang0610 commented on GitHub (Sep 30, 2023): Possible to ask you to quantize the models, and then upload it to ollama?
Author
Owner

@jmorganca commented on GitHub (Oct 23, 2023):

Hi @vansinhu. We'd love to support this. Ollama currently runs llama.cpp under the hood and we'd need some help getting that in https://github.com/ggerganov/llama.cpp/issues/3133. After that, this should be no problem to add

<!-- gh-comment-id:1775584320 --> @jmorganca commented on GitHub (Oct 23, 2023): Hi @vansinhu. We'd love to support this. Ollama currently runs llama.cpp under the hood and we'd need some help getting that in https://github.com/ggerganov/llama.cpp/issues/3133. After that, this should be no problem to add
Author
Owner

@RealJosephus commented on GitHub (Dec 1, 2023):

See https://github.com/ggerganov/llama.cpp/pull/4283

<!-- gh-comment-id:1836582844 --> @RealJosephus commented on GitHub (Dec 1, 2023): See https://github.com/ggerganov/llama.cpp/pull/4283
Author
Owner

@BruceMacD commented on GitHub (Mar 11, 2024):

Thanks for the request, the model is now supported, and it looks like some community members have added it to Ollama:
https://ollama.com/search?q=intern&p=1

Resolving this for now, depending on the popularity we might add it to the official library namespace.

<!-- gh-comment-id:1989276346 --> @BruceMacD commented on GitHub (Mar 11, 2024): Thanks for the request, the model is now supported, and it looks like some community members have added it to Ollama: https://ollama.com/search?q=intern&p=1 Resolving this for now, depending on the popularity we might add it to the official library namespace.
Author
Owner

@QiuZiXian commented on GitHub (Jun 24, 2024):

@BruceMacD May you give me a template example?
I follow fun-tunning,get the merge model,
then follow ollama to convert to gguf
create from mainfest is ok,
but conversion is not.
replay can't stop
image
my template refer :
{{ if .System }}<|im_start|>system
{{ .System }}<|im_end|>
{{ end }}{{ if .Prompt }}<|im_start|>user
{{ .Prompt }}<|im_end|>
{{ end }}<|im_start|>assistant
{{ .Response }}<|im_end|>

<!-- gh-comment-id:2185908929 --> @QiuZiXian commented on GitHub (Jun 24, 2024): @BruceMacD May you give me a template example? I follow [fun-tunning](https://xtuner.readthedocs.io/zh-cn/latest/get_started/quickstart.html),get the merge model, then follow [ollama](https://github.com/ollama/ollama/blob/main/docs/modelfile.md#parameter) to convert to gguf create from mainfest is ok, but conversion is not. replay can't stop ![image](https://github.com/ollama/ollama/assets/28780269/f4ec09f8-6678-4446-a952-0895f1382392) my template refer : {{ if .System }}<|im_start|>system {{ .System }}<|im_end|> {{ end }}{{ if .Prompt }}<|im_start|>user {{ .Prompt }}<|im_end|> {{ end }}<|im_start|>assistant {{ .Response }}<|im_end|>
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#62274