[GH-ISSUE #9598] [Bug] ollama maybe treats embedding models the wrong way #6261

Closed
opened 2026-04-12 17:41:28 -05:00 by GiteaMirror · 0 comments
Owner

Originally created by @Hoshino-Yumetsuki on GitHub (Mar 8, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/9598

What is the issue?

When I try to import an embedding model fine-tuned by qwen, such as gte-Qwen2-1.5B-instruct, ollama seems to treat it as an LLM rather than an embedding model. This results in it not returning the correct embedding result during normal use.

It could also have something to do with the way I imported the model. The way I use it is to write the Modelfile directly and then run ollama create. This may be wrong because this model doesn't show the embedding tag when I upload it to the ollama repository. Unfortunately, I haven't found anything on the internet about adding embedding models to ollama. I hope this issue (or bug) will be replied to or resolved.

:D

Example repositories: Q78KG/gte-Qwen2-1.5B-instruct

Relevant log output


OS

No response

GPU

No response

CPU

No response

Ollama version

No response

Originally created by @Hoshino-Yumetsuki on GitHub (Mar 8, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/9598 ### What is the issue? When I try to import an embedding model fine-tuned by qwen, such as gte-Qwen2-1.5B-instruct, ollama seems to treat it as an LLM rather than an embedding model. This results in it not returning the correct embedding result during normal use. It could also have something to do with the way I imported the model. The way I use it is to write the Modelfile directly and then run ollama create. This may be wrong because this model doesn't show the embedding tag when I upload it to the ollama repository. Unfortunately, I haven't found anything on the internet about adding embedding models to ollama. I hope this issue (or bug) will be replied to or resolved. :D Example repositories: `Q78KG/gte-Qwen2-1.5B-instruct` ### Relevant log output ```shell ``` ### OS _No response_ ### GPU _No response_ ### CPU _No response_ ### Ollama version _No response_
GiteaMirror added the bug label 2026-04-12 17:41:28 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#6261