I have searched the existing issues and discussions.
Problem Description
External API and internal classic rerankers like BAAI/bge-reranker-v2-m3 work, but there are also instructed rerankers like Qwen/Qwen3-Reranker-0.6B that have good performance and would be a nice addition to OpenWebUI to be able to use them in the RAG context.
It could be expected that more instructed rerankers will be available in the future by other providers, etc.
Desired Solution you'd like
Didn't analyze carefully what's needed, but I guess something similar to RAG_EMBEDDING_CONTENT_PREFIX, RAG_EMBEDDING_PREFIX_FIELD_NAME and RAG_EMBEDDING_QUERY_PREFIX or similar, or maybe just a template would do?
Alternatives Considered
No response
Additional Context
No response
Originally created by @ivanbaldo on GitHub (Aug 18, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/16719
### Check Existing Issues
- [x] I have searched the existing issues and discussions.
### Problem Description
External API and internal classic rerankers like `BAAI/bge-reranker-v2-m3` work, but there are also instructed rerankers like `Qwen/Qwen3-Reranker-0.6B` that have good performance and would be a nice addition to OpenWebUI to be able to use them in the RAG context.
It could be expected that more instructed rerankers will be available in the future by other providers, etc.
### Desired Solution you'd like
Didn't analyze carefully what's needed, but I guess something similar to `RAG_EMBEDDING_CONTENT_PREFIX`, `RAG_EMBEDDING_PREFIX_FIELD_NAME` and `RAG_EMBEDDING_QUERY_PREFIX` or similar, or maybe just a template would do?
### Alternatives Considered
_No response_
### Additional Context
_No response_
<!-- gh-comment-id:3198564321 -->
@rgaricano commented on GitHub (Aug 18, 2025):
You can use it, but this model have some issues: https://github.com/open-webui/open-webui/discussions/16027
https://huggingface.co/Qwen/Qwen3-Reranker-0.6B/discussions/8
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Originally created by @ivanbaldo on GitHub (Aug 18, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/16719
Check Existing Issues
Problem Description
External API and internal classic rerankers like
BAAI/bge-reranker-v2-m3work, but there are also instructed rerankers likeQwen/Qwen3-Reranker-0.6Bthat have good performance and would be a nice addition to OpenWebUI to be able to use them in the RAG context.It could be expected that more instructed rerankers will be available in the future by other providers, etc.
Desired Solution you'd like
Didn't analyze carefully what's needed, but I guess something similar to
RAG_EMBEDDING_CONTENT_PREFIX,RAG_EMBEDDING_PREFIX_FIELD_NAMEandRAG_EMBEDDING_QUERY_PREFIXor similar, or maybe just a template would do?Alternatives Considered
No response
Additional Context
No response
@rgaricano commented on GitHub (Aug 18, 2025):
You can use it, but this model have some issues: https://github.com/open-webui/open-webui/discussions/16027
https://huggingface.co/Qwen/Qwen3-Reranker-0.6B/discussions/8
@ivanbaldo commented on GitHub (Aug 18, 2025):
Actually I am using vLLM so I am not hitting #16027.