[GH-ISSUE #2287] List of embedding models supported by Ollama #1317

Closed
opened 2026-04-12 11:08:55 -05:00 by GiteaMirror · 5 comments
Owner

Originally created by @bm777 on GitHub (Jan 31, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/2287

What can we do to get the list of models in Ollama for the embedding support?
For example, if I want to serve a Bert model from the SBERT hg repo, how can I do it?

Originally created by @bm777 on GitHub (Jan 31, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/2287 What can we do to get the list of models in Ollama for the embedding support? For example, if I want to serve a Bert model from the SBERT hg repo, how can I do it?
Author
Owner

@nathanpbell commented on GitHub (Jan 31, 2024):

The models available are those that can be run by llama.cpp, so I would check their repo to see which architectures they support.

<!-- gh-comment-id:1920167987 --> @nathanpbell commented on GitHub (Jan 31, 2024): The models available are those that can be run by llama.cpp, so I would check their repo to see which architectures they support.
Author
Owner

@bm777 commented on GitHub (Feb 1, 2024):

Thanks. Also, consider having a model-type filter on the Ollama website.

<!-- gh-comment-id:1920395866 --> @bm777 commented on GitHub (Feb 1, 2024): Thanks. Also, consider having a model-type filter on the Ollama website.
Author
Owner

@easp commented on GitHub (Feb 1, 2024):

Most of the embedding models use BERT architecture which Lllama.cpp doesn't yet support. Someone started to work on it, but got distracted.

https://github.com/ggerganov/llama.cpp/issues/2872

<!-- gh-comment-id:1921854315 --> @easp commented on GitHub (Feb 1, 2024): Most of the embedding models use BERT architecture which Lllama.cpp doesn't yet support. Someone started to work on it, but got distracted. https://github.com/ggerganov/llama.cpp/issues/2872
Author
Owner

@bm777 commented on GitHub (Feb 1, 2024):

Thanks @easp , that was my concern. Im gonna use candle :)

<!-- gh-comment-id:1921858035 --> @bm777 commented on GitHub (Feb 1, 2024): Thanks @easp , that was my concern. Im gonna use candle :)
Author
Owner

@jmorganca commented on GitHub (Feb 20, 2024):

Merging with https://github.com/ollama/ollama/issues/327. If you have any model requests please let me know!

<!-- gh-comment-id:1953455929 --> @jmorganca commented on GitHub (Feb 20, 2024): Merging with https://github.com/ollama/ollama/issues/327. If you have any model requests please let me know!
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#1317