github-starred/open-webui
2
0
Fork 0
mirror of https://github.com/open-webui/open-webui.git synced 2026-05-07 03:18:23 -05:00
Code Issues 1.3k Packages Projects Releases 126 Wiki Activity

[GH-ISSUE #16719] feat: support instructed reranking models like qwen3-reranker #18019

New Issue
Closed
opened 2026-04-19 23:55:06 -05:00 by GiteaMirror · 2 comments
GiteaMirror commented 2026-04-19 23:55:06 -05:00
Owner
Copy Link

Originally created by @ivanbaldo on GitHub (Aug 18, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/16719

Check Existing Issues

  • I have searched the existing issues and discussions.

Problem Description

External API and internal classic rerankers like BAAI/bge-reranker-v2-m3 work, but there are also instructed rerankers like Qwen/Qwen3-Reranker-0.6B that have good performance and would be a nice addition to OpenWebUI to be able to use them in the RAG context.
It could be expected that more instructed rerankers will be available in the future by other providers, etc.

Desired Solution you'd like

Didn't analyze carefully what's needed, but I guess something similar to RAG_EMBEDDING_CONTENT_PREFIX, RAG_EMBEDDING_PREFIX_FIELD_NAME and RAG_EMBEDDING_QUERY_PREFIX or similar, or maybe just a template would do?

Alternatives Considered

No response

Additional Context

No response

Originally created by @ivanbaldo on GitHub (Aug 18, 2025). Original GitHub issue: https://github.com/open-webui/open-webui/issues/16719 ### Check Existing Issues - [x] I have searched the existing issues and discussions. ### Problem Description External API and internal classic rerankers like `BAAI/bge-reranker-v2-m3` work, but there are also instructed rerankers like `Qwen/Qwen3-Reranker-0.6B` that have good performance and would be a nice addition to OpenWebUI to be able to use them in the RAG context. It could be expected that more instructed rerankers will be available in the future by other providers, etc. ### Desired Solution you'd like Didn't analyze carefully what's needed, but I guess something similar to `RAG_EMBEDDING_CONTENT_PREFIX`, `RAG_EMBEDDING_PREFIX_FIELD_NAME` and `RAG_EMBEDDING_QUERY_PREFIX` or similar, or maybe just a template would do? ### Alternatives Considered _No response_ ### Additional Context _No response_
GiteaMirror commented 2026-04-19 23:55:08 -05:00
Author
Owner
Copy Link

@rgaricano commented on GitHub (Aug 18, 2025):

You can use it, but this model have some issues: https://github.com/open-webui/open-webui/discussions/16027

https://huggingface.co/Qwen/Qwen3-Reranker-0.6B/discussions/8

<!-- gh-comment-id:3198564321 --> @rgaricano commented on GitHub (Aug 18, 2025): You can use it, but this model have some issues: https://github.com/open-webui/open-webui/discussions/16027 https://huggingface.co/Qwen/Qwen3-Reranker-0.6B/discussions/8
GiteaMirror commented 2026-04-19 23:55:08 -05:00
Author
Owner
Copy Link

@ivanbaldo commented on GitHub (Aug 18, 2025):

Actually I am using vLLM so I am not hitting #16027.

<!-- gh-comment-id:3198594296 --> @ivanbaldo commented on GitHub (Aug 18, 2025): Actually I am using vLLM so I am not hitting #16027.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
confirmed
confirmed issue
core
documentation
enhancement
good first issue
help wanted
non-core
pull-request
Mirrored from GitHub Pull Request
 python
question
testing wanted
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#18019
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?