github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-05-06 08:02:14 -05:00
Code Issues 14.5k Packages Projects Releases 120 Wiki Activity

[GH-ISSUE #4360] bge-reranker-v2-m3、mxbai-rerank-large-v1 and other rerank models #64759

New Issue
Closed
opened 2026-05-03 18:43:16 -05:00 by GiteaMirror · 21 comments
GiteaMirror commented 2026-05-03 18:43:16 -05:00
Owner
Copy Link

Originally created by @Feng-YiJing-Dao on GitHub (May 11, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/4360

The rerank model cannot be converted to the ollama-supported format through llama.cpp, but in RAG, I hope to run a rerank model to improve the accuracy of recall.

I try to use bge-reranker-v2-m3、mxbai-rerank-large-v1，model.safetensors format，
image

image

Originally created by @Feng-YiJing-Dao on GitHub (May 11, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/4360 The rerank model cannot be converted to the ollama-supported format through llama.cpp, but in RAG, I hope to run a rerank model to improve the accuracy of recall. I try to use bge-reranker-v2-m3、mxbai-rerank-large-v1，model.safetensors format， ![image](https://github.com/ollama/ollama/assets/18107069/f5dab310-5b0e-47ce-a559-e4845d5c3b92) ![image](https://github.com/ollama/ollama/assets/18107069/ad7ffb47-b299-4f63-9818-4e635b28719e)
GiteaMirror added the model label 2026-05-03 18:43:16 -05:00
GiteaMirror commented 2026-05-03 18:43:37 -05:00
Author
Owner
Copy Link

@BradKML commented on GitHub (May 14, 2024):

Add one more to the pile, buddy. We are all on the same boat https://github.com/ollama/ollama/issues/3749

<!-- gh-comment-id:2109075917 --> @BradKML commented on GitHub (May 14, 2024): Add one more to the pile, buddy. We are all on the same boat https://github.com/ollama/ollama/issues/3749
GiteaMirror commented 2026-05-03 18:43:39 -05:00
Author
Owner
Copy Link

@ah3243 commented on GitHub (Jun 1, 2024):

more embedding models generally and a way to filter/search for them would be amazing. Currently you have to scroll the whole list and know the names.

<!-- gh-comment-id:2143416493 --> @ah3243 commented on GitHub (Jun 1, 2024): more embedding models generally and a way to filter/search for them would be amazing. Currently you have to scroll the whole list and know the names.
GiteaMirror commented 2026-05-03 18:43:40 -05:00
Author
Owner
Copy Link

@yushengliao commented on GitHub (Jun 12, 2024):

+1

<!-- gh-comment-id:2162001851 --> @yushengliao commented on GitHub (Jun 12, 2024): +1
GiteaMirror commented 2026-05-03 18:43:40 -05:00
Author
Owner
Copy Link

@TE-WoodyLi commented on GitHub (Jun 15, 2024):

+1

<!-- gh-comment-id:2169444973 --> @TE-WoodyLi commented on GitHub (Jun 15, 2024): +1
GiteaMirror commented 2026-05-03 18:43:41 -05:00
Author
Owner
Copy Link

@xsoway commented on GitHub (Jun 16, 2024):

hope ollama support rerank models

<!-- gh-comment-id:2171044087 --> @xsoway commented on GitHub (Jun 16, 2024): hope ollama support rerank models
GiteaMirror commented 2026-05-03 18:43:42 -05:00
Author
Owner
Copy Link

@BradKML commented on GitHub (Jun 17, 2024):

Again to everyone here, please stop posting "+1" since there is literally a react function

<!-- gh-comment-id:2172052998 --> @BradKML commented on GitHub (Jun 17, 2024): Again to everyone here, please stop posting "+1" since there is literally a react function
GiteaMirror commented 2026-05-03 18:43:42 -05:00
Author
Owner
Copy Link

@netandreus commented on GitHub (Jun 20, 2024):

+1 We really need this!

<!-- gh-comment-id:2180426718 --> @netandreus commented on GitHub (Jun 20, 2024): +1 We really need this!
GiteaMirror commented 2026-05-03 18:43:43 -05:00
Author
Owner
Copy Link

@rjmalagon commented on GitHub (Jun 29, 2024):

rerank and colbert too.
https://huggingface.co/mixedbread-ai/mxbai-colbert-large-v1

<!-- gh-comment-id:2198348595 --> @rjmalagon commented on GitHub (Jun 29, 2024): rerank and colbert too. https://huggingface.co/mixedbread-ai/mxbai-colbert-large-v1
GiteaMirror commented 2026-05-03 18:43:44 -05:00
Author
Owner
Copy Link

@lucasdengcn commented on GitHub (Jul 10, 2024):

+1

<!-- gh-comment-id:2219783562 --> @lucasdengcn commented on GitHub (Jul 10, 2024): +1
GiteaMirror commented 2026-05-03 18:43:44 -05:00
Author
Owner
Copy Link

@cleverpig commented on GitHub (Jul 23, 2024):

+1

<!-- gh-comment-id:2244192593 --> @cleverpig commented on GitHub (Jul 23, 2024): +1
GiteaMirror commented 2026-05-03 18:43:44 -05:00
Author
Owner
Copy Link

@unizhu commented on GitHub (Jul 23, 2024):

+1

<!-- gh-comment-id:2244842705 --> @unizhu commented on GitHub (Jul 23, 2024): +1
GiteaMirror commented 2026-05-03 18:43:45 -05:00
Author
Owner
Copy Link

@enryteam commented on GitHub (Jul 27, 2024):

+1

<!-- gh-comment-id:2254191249 --> @enryteam commented on GitHub (Jul 27, 2024): +1
GiteaMirror commented 2026-05-03 18:43:45 -05:00
Author
Owner
Copy Link

@mark-bradshaw commented on GitHub (Aug 9, 2024):

+1

<!-- gh-comment-id:2277043296 --> @mark-bradshaw commented on GitHub (Aug 9, 2024): +1
GiteaMirror commented 2026-05-03 18:43:46 -05:00
Author
Owner
Copy Link

@jmorganca commented on GitHub (Sep 2, 2024):

Merging with https://github.com/ollama/ollama/issues/3368

<!-- gh-comment-id:2325295185 --> @jmorganca commented on GitHub (Sep 2, 2024): Merging with https://github.com/ollama/ollama/issues/3368
GiteaMirror commented 2026-05-03 18:43:46 -05:00
Author
Owner
Copy Link

@miaonv commented on GitHub (Sep 11, 2024):

We really need the rerank model on ollama

<!-- gh-comment-id:2343706740 --> @miaonv commented on GitHub (Sep 11, 2024): We really need the rerank model on ollama
GiteaMirror commented 2026-05-03 18:43:47 -05:00
Author
Owner
Copy Link

@viosay commented on GitHub (Sep 14, 2024):

+1

<!-- gh-comment-id:2350928984 --> @viosay commented on GitHub (Sep 14, 2024): +1
GiteaMirror commented 2026-05-03 18:43:48 -05:00
Author
Owner
Copy Link

@zhoufengen commented on GitHub (Sep 19, 2024):

we really need this too！bge-reranker-v2-m3

<!-- gh-comment-id:2359894351 --> @zhoufengen commented on GitHub (Sep 19, 2024): we really need this too！bge-reranker-v2-m3
GiteaMirror commented 2026-05-03 18:43:49 -05:00
Author
Owner
Copy Link

@Kingtous commented on GitHub (Feb 13, 2025):

+1, bge-reranker is all we need for RAG

<!-- gh-comment-id:2655353669 --> @Kingtous commented on GitHub (Feb 13, 2025): +1, bge-reranker is all we need for RAG
GiteaMirror commented 2026-05-03 18:43:49 -05:00
Author
Owner
Copy Link

@sernddev commented on GitHub (Apr 7, 2025):

+1

<!-- gh-comment-id:2782831893 --> @sernddev commented on GitHub (Apr 7, 2025): +1
GiteaMirror commented 2026-05-03 18:43:50 -05:00
Author
Owner
Copy Link

@value-added-korea commented on GitHub (Apr 23, 2025):

+1

<!-- gh-comment-id:2822873424 --> @value-added-korea commented on GitHub (Apr 23, 2025): +1
GiteaMirror commented 2026-05-03 18:43:51 -05:00
Author
Owner
Copy Link

@deerleo commented on GitHub (Apr 29, 2025):

+1

<!-- gh-comment-id:2839659650 --> @deerleo commented on GitHub (Apr 29, 2025): +1
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
 python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
No Label model
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#64759
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?