github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-05-07 00:22:43 -05:00
Code Issues 14.5k Packages Projects Releases 120 Wiki Activity

[GH-ISSUE #2337] Support model allenai/OLMo-7B #27112

New Issue
Closed
opened 2026-04-22 04:05:00 -05:00 by GiteaMirror · 26 comments
GiteaMirror commented 2026-04-22 04:05:00 -05:00
Owner
Copy Link

Originally created by @o-agassizii on GitHub (Feb 3, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/2337

If possible, could support for this model be added to ollama?

https://huggingface.co/allenai/OLMo-7B

Originally created by @o-agassizii on GitHub (Feb 3, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/2337 If possible, could support for this model be added to ollama? https://huggingface.co/allenai/OLMo-7B
GiteaMirror added the model label 2026-04-22 04:05:00 -05:00
GiteaMirror commented 2026-04-22 04:05:02 -05:00
Author
Owner
Copy Link

@remy415 commented on GitHub (Feb 3, 2024):

Hello, as referenced in issue #2287 the models supported are the ones llama.cpp supports. Check their forum and see if they support it.

<!-- gh-comment-id:1925354059 --> @remy415 commented on GitHub (Feb 3, 2024): Hello, as referenced in issue #2287 the models supported are the ones llama.cpp supports. Check their forum and see if they support it.
GiteaMirror commented 2026-04-22 04:05:02 -05:00
Author
Owner
Copy Link

@easp commented on GitHub (Feb 3, 2024):

Model architecture is: OlmoModelForCausalLM which appears to be novel and doesn't appear to be supported in llama.cpp and hence isn't supported in Ollama.

<!-- gh-comment-id:1925433110 --> @easp commented on GitHub (Feb 3, 2024): Model architecture is: OlmoModelForCausalLM which appears to be novel and doesn't appear to be supported in llama.cpp and hence isn't supported in Ollama.
GiteaMirror commented 2026-04-22 04:05:02 -05:00
Author
Owner
Copy Link

@olumolu commented on GitHub (Apr 17, 2024):

https://blog.allenai.org/olmo-1-7-7b-a-24-point-improvement-on-mmlu-92b43f7d269d
One of the best model to test.

Support this as soon as possible

<!-- gh-comment-id:2062080643 --> @olumolu commented on GitHub (Apr 17, 2024): https://blog.allenai.org/olmo-1-7-7b-a-24-point-improvement-on-mmlu-92b43f7d269d One of the best model to test. Support this as soon as possible
GiteaMirror commented 2026-04-22 04:05:03 -05:00
Author
Owner
Copy Link

@olumolu commented on GitHub (Apr 20, 2024):

https://github.com/ggerganov/llama.cpp/pull/6741
Now

Hello, as referenced in issue #2287 the models supported are the ones llama.cpp supports. Check their forum and see if they support it.

This is now support in llama.cpp can you new support into ollama thanks

<!-- gh-comment-id:2067622392 --> @olumolu commented on GitHub (Apr 20, 2024): https://github.com/ggerganov/llama.cpp/pull/6741 Now > Hello, as referenced in issue #2287 the models supported are the ones llama.cpp supports. Check their forum and see if they support it. This is now support in llama.cpp can you new support into ollama thanks
GiteaMirror commented 2026-04-22 04:05:03 -05:00
Author
Owner
Copy Link

@olumolu commented on GitHub (Apr 26, 2024):

When this will be available

<!-- gh-comment-id:2079968757 --> @olumolu commented on GitHub (Apr 26, 2024): When this will be available
GiteaMirror commented 2026-04-22 04:05:04 -05:00
Author
Owner
Copy Link

@Qiangong2 commented on GitHub (May 2, 2024):

I would also like to see OLMo support added

<!-- gh-comment-id:2091439255 --> @Qiangong2 commented on GitHub (May 2, 2024): I would also like to see OLMo support added
GiteaMirror commented 2026-04-22 04:05:04 -05:00
Author
Owner
Copy Link

@olumolu commented on GitHub (May 3, 2024):

What is the issue to implement this in ollama can you give a info. @easp @remy415 @dhiltgen

<!-- gh-comment-id:2093545921 --> @olumolu commented on GitHub (May 3, 2024): What is the issue to implement this in ollama can you give a info. @easp @remy415 @dhiltgen
GiteaMirror commented 2026-04-22 04:05:05 -05:00
Author
Owner
Copy Link

@olumolu commented on GitHub (May 10, 2024):

What is the issue that stoping it from getting this model as other models are available with in a couple of days.

<!-- gh-comment-id:2104572947 --> @olumolu commented on GitHub (May 10, 2024): What is the issue that stoping it from getting this model as other models are available with in a couple of days.
GiteaMirror commented 2026-04-22 04:05:05 -05:00
Author
Owner
Copy Link

@altsalt commented on GitHub (May 10, 2024):

@userforsource the initial problem was give above, and relates to this being a novel model.

Model architecture is: OlmoModelForCausalLM which appears to be novel and doesn't appear to be supported in llama.cpp and hence isn't supported in Ollama.

That said, there's clearly movement on things now, given @jmorganca closing #3778

<!-- gh-comment-id:2104848580 --> @altsalt commented on GitHub (May 10, 2024): @userforsource the initial problem was give above, and relates to this being a _novel_ model. > Model architecture is: OlmoModelForCausalLM which appears to be novel and doesn't appear to be supported in llama.cpp and hence isn't supported in Ollama. That said, there's clearly movement on things now, given @jmorganca closing #3778
GiteaMirror commented 2026-04-22 04:05:06 -05:00
Author
Owner
Copy Link

@olumolu commented on GitHub (May 10, 2024):

@userforsource the initial problem was give above, and relates to this being a novel model.

Model architecture is: OlmoModelForCausalLM which appears to be novel and doesn't appear to be supported in llama.cpp and hence isn't supported in Ollama.

That said, there's clearly movement on things now, given @jmorganca closing #3778

https://github.com/ggerganov/llama.cpp/pull/6741
Llama.cpp now supports olmo

<!-- gh-comment-id:2105011888 --> @olumolu commented on GitHub (May 10, 2024): > @userforsource the initial problem was give above, and relates to this being a _novel_ model. > > > Model architecture is: OlmoModelForCausalLM which appears to be novel and doesn't appear to be supported in llama.cpp and hence isn't supported in Ollama. > > That said, there's clearly movement on things now, given @jmorganca closing #3778 https://github.com/ggerganov/llama.cpp/pull/6741 Llama.cpp now supports olmo
GiteaMirror commented 2026-04-22 04:05:07 -05:00
Author
Owner
Copy Link

@olumolu commented on GitHub (May 21, 2024):

When we will get olmo support? Any idea what the issue.

<!-- gh-comment-id:2123225600 --> @olumolu commented on GitHub (May 21, 2024): When we will get olmo support? Any idea what the issue.
GiteaMirror commented 2026-04-22 04:05:07 -05:00
Author
Owner
Copy Link

@mosabua commented on GitHub (May 22, 2024):

Would love to play with olmo some more with Ollama

<!-- gh-comment-id:2125829881 --> @mosabua commented on GitHub (May 22, 2024): Would love to play with olmo some more with Ollama
GiteaMirror commented 2026-04-22 04:05:07 -05:00
Author
Owner
Copy Link

@mjspeck commented on GitHub (May 29, 2024):

Any updates here? Would also like to use OLMo on Ollama.

<!-- gh-comment-id:2138331939 --> @mjspeck commented on GitHub (May 29, 2024): Any updates here? Would also like to use OLMo on Ollama.
GiteaMirror commented 2026-04-22 04:05:08 -05:00
Author
Owner
Copy Link

@hodyroff commented on GitHub (Jun 24, 2024):

https://ollama.com/darkmoon/olmo seems now available ... is this "olmo" or altered in some way? It seems to not have a proper pre-prompt therefor its answers are only half-helpful ...

<!-- gh-comment-id:2186721119 --> @hodyroff commented on GitHub (Jun 24, 2024): https://ollama.com/darkmoon/olmo seems now available ... is this "olmo" or altered in some way? It seems to not have a proper pre-prompt therefor its answers are only half-helpful ...
GiteaMirror commented 2026-04-22 04:05:08 -05:00
Author
Owner
Copy Link

@olumolu commented on GitHub (Jun 24, 2024):

https://ollama.com/darkmoon/olmo seems now available ... is this "olmo" or altered in some way? It seems to not have a proper pre-prompt therefor its answers are only half-helpful ...

This is darkmoon not allenai olmo 7b

<!-- gh-comment-id:2187042380 --> @olumolu commented on GitHub (Jun 24, 2024): > https://ollama.com/darkmoon/olmo seems now available ... is this "olmo" or altered in some way? It seems to not have a proper pre-prompt therefor its answers are only half-helpful ... This is darkmoon not allenai olmo 7b
GiteaMirror commented 2026-04-22 04:05:09 -05:00
Author
Owner
Copy Link

@easp commented on GitHub (Jun 24, 2024):

@userforsource If you look at the ollama modelpage you'll see that it is a quantized version of the AllenAI model.

@hodyroff it's the base/completion model, not an instruct finetune, so, no prompt template or system prompt, if that's what you are referring to.

<!-- gh-comment-id:2187127681 --> @easp commented on GitHub (Jun 24, 2024): @userforsource If you look at the ollama modelpage you'll see that it is a quantized version of the AllenAI model. @hodyroff it's the base/completion model, not an instruct finetune, so, no prompt template or system prompt, if that's what you are referring to.
GiteaMirror commented 2026-04-22 04:05:09 -05:00
Author
Owner
Copy Link

@senconscious commented on GitHub (Jun 25, 2024):

Just pushed new 7B-instruct-q6-k OLMo model. Kinda new to LLMs. So help with pre-promt will be really appreciated

<!-- gh-comment-id:2188765454 --> @senconscious commented on GitHub (Jun 25, 2024): Just pushed new 7B-instruct-q6-k OLMo model. Kinda new to LLMs. So help with pre-promt will be really appreciated
GiteaMirror commented 2026-04-22 04:05:09 -05:00
Author
Owner
Copy Link

@altsalt commented on GitHub (Aug 7, 2024):

@jmorganca wondering if you can advise the onlookers about how to move support for this forward?

<!-- gh-comment-id:2274045994 --> @altsalt commented on GitHub (Aug 7, 2024): @jmorganca wondering if you can advise the onlookers about how to move support for this forward?
GiteaMirror commented 2026-04-22 04:05:10 -05:00
Author
Owner
Copy Link

@wonka929 commented on GitHub (Sep 5, 2024):

No news for Olmo?
There is the new Olmo MoE available
https://huggingface.co/allenai/OLMoE-1B-7B-0924

<!-- gh-comment-id:2331148741 --> @wonka929 commented on GitHub (Sep 5, 2024): No news for Olmo? There is the new Olmo MoE available https://huggingface.co/allenai/OLMoE-1B-7B-0924
GiteaMirror commented 2026-04-22 04:05:10 -05:00
Author
Owner
Copy Link

@altsalt commented on GitHub (Oct 17, 2024):

This would be pretty great to support given that it is basically the most open model out there. Figured I'd bump the issue after seeing this table: https://opening-up-chatgpt.github.io/

<!-- gh-comment-id:2420682896 --> @altsalt commented on GitHub (Oct 17, 2024): This would be pretty great to support given that it is basically the most open model out there. Figured I'd bump the issue after seeing this table: https://opening-up-chatgpt.github.io/
GiteaMirror commented 2026-04-22 04:05:10 -05:00
Author
Owner
Copy Link

@UberMetroid commented on GitHub (Dec 6, 2024):

Olmo?

<!-- gh-comment-id:2523493552 --> @UberMetroid commented on GitHub (Dec 6, 2024): Olmo?
GiteaMirror commented 2026-04-22 04:05:11 -05:00
Author
Owner
Copy Link

@UberMetroid commented on GitHub (Jan 12, 2025):

You can pull Olmo now. https://ollama.com/library/olmo2:13b

<!-- gh-comment-id:2585701212 --> @UberMetroid commented on GitHub (Jan 12, 2025): You can pull Olmo now. https://ollama.com/library/olmo2:13b
GiteaMirror commented 2026-04-22 04:05:14 -05:00
Author
Owner
Copy Link

@olumolu commented on GitHub (Jan 15, 2025):

Close this as we have olmo 2 which better so no one will going to use 1 version.

<!-- gh-comment-id:2591878815 --> @olumolu commented on GitHub (Jan 15, 2025): Close this as we have olmo 2 which better so no one will going to use 1 version.
GiteaMirror commented 2026-04-22 04:05:15 -05:00
Author
Owner
Copy Link

@azraksknfstf commented on GitHub (Mar 16, 2025):

https://allenai.org/blog/olmo2-32B --> "OLMo 2 32B: First fully open model to outperform GPT 3.5 and GPT 4o mini" released by March 13, 2025. Model Repo contains "MHKetbi/allenai_OLMo2...". Tried "allenai_OLMo2-0325-32B-Instruct:q8_0", which resulted in "Error: llama runner process has terminated: error loading model: check_tensor_dims: tensor 'blk.0.attn_k_norm.weight' has wrong shape; expected 5120, got 1024, 1, 1, 1". If you can extend the support to cover "OLMo 2 32B", it is appreciated.

<!-- gh-comment-id:2727682974 --> @azraksknfstf commented on GitHub (Mar 16, 2025): https://allenai.org/blog/olmo2-32B --> "OLMo 2 32B: First fully open model to outperform GPT 3.5 and GPT 4o mini" released by March 13, 2025. Model Repo contains "MHKetbi/allenai_OLMo2...". Tried "allenai_OLMo2-0325-32B-Instruct:q8_0", which resulted in "Error: llama runner process has terminated: error loading model: check_tensor_dims: tensor 'blk.0.attn_k_norm.weight' has wrong shape; expected 5120, got 1024, 1, 1, 1". If you can extend the support to cover "OLMo 2 32B", it is appreciated.
GiteaMirror commented 2026-04-22 04:05:17 -05:00
Author
Owner
Copy Link

@altsalt commented on GitHub (Nov 21, 2025):

(putting this here because the issue isn't closed and it is easier than opening a new one...)

OLMo 3 was released! Nudging here to check on adding support. Thanks!

<!-- gh-comment-id:3564145566 --> @altsalt commented on GitHub (Nov 21, 2025): (putting this here because the issue isn't closed and it is easier than opening a new one...) [OLMo 3](https://allenai.org/blog/olmo3) was released! Nudging here to check on adding support. Thanks!
GiteaMirror commented 2026-04-22 04:05:17 -05:00
Author
Owner
Copy Link

@rick-github commented on GitHub (Jan 8, 2026):

https://ollama.com/library/olmo-3

<!-- gh-comment-id:3722911571 --> @rick-github commented on GitHub (Jan 8, 2026): https://ollama.com/library/olmo-3
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
 python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
No Label model
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#27112
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?