github-starred/open-webui
2
0
Fork 0
mirror of https://github.com/open-webui/open-webui.git synced 2026-05-26 11:27:54 -05:00
Code Issues 2.4k Packages Projects Releases 129 Wiki Activity

Support for COLBERT models in RAG #1403

New Issue
Closed
opened 2025-11-11 14:44:24 -06:00 by GiteaMirror · 0 comments
GiteaMirror commented 2025-11-11 14:44:24 -06:00
Owner
Copy Link

Originally created by @rjmalagon on GitHub (Jun 29, 2024).

COLBERT models are an alternative to rerank, more complex but less resources needed, and with the correct implementation, maybe higher quality.

As I understand it, has more features than rerank models and needs more consideration to use.

https://huggingface.co/mixedbread-ai/mxbai-colbert-large-v1

I'm already trying to use colbert models similar to rerank models on open-webui. It seems to work, but I have doubt that it is correct to replace rerank with colbert directly.

Perhaps, possibly I am wrong about this, and colbert can be used just like a reranker, but I bring this as a feature request just in case.

Originally created by @rjmalagon on GitHub (Jun 29, 2024). COLBERT models are an alternative to rerank, more complex but less resources needed, and with the correct implementation, maybe higher quality. As I understand it, has more features than rerank models and needs more consideration to use. https://huggingface.co/mixedbread-ai/mxbai-colbert-large-v1 I'm already trying to use colbert models similar to rerank models on open-webui. It seems to work, but I have doubt that it is correct to replace rerank with colbert directly. Perhaps, possibly I am wrong about this, and colbert can be used just like a reranker, but I bring this as a feature request just in case.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
confirmed
confirmed issue
core
documentation
enhancement
good first issue
help wanted
non-core
pull-request
Mirrored from GitHub Pull Request
 python
question
testing wanted
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#1403
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?