[GH-ISSUE #12134] feat: add support for external `RAG_RERANKING_MODEL #32008

Closed
opened 2026-04-25 05:53:36 -05:00 by GiteaMirror · 2 comments
Owner

Originally created by @btiernay on GitHub (Mar 27, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/12134

Check Existing Issues

  • I have searched the existing issues and discussions.

Problem Description

When using providers like AWS Bedrock / GCP (with LiteLLM), there are options for rerankers. Specifically, Cohere Rerank 3.5 is an excellent choice. It would be great if we could support this in Open WebUI

Desired Solution you'd like

Using the pattern established today:

RAG_RERANKING_ENGINE: "openai"
RAG_RERANKING_MODEL:  "bedrock-rerank"

Alternatives Considered

N/A

Additional Context

No response

Originally created by @btiernay on GitHub (Mar 27, 2025). Original GitHub issue: https://github.com/open-webui/open-webui/issues/12134 ### Check Existing Issues - [x] I have searched the existing issues and discussions. ### Problem Description When using providers like AWS Bedrock / GCP (with LiteLLM), there are options for rerankers. Specifically, Cohere Rerank 3.5 is an excellent choice. It would be great if we could support this in Open WebUI ### Desired Solution you'd like Using the pattern established today: ``` RAG_RERANKING_ENGINE: "openai" RAG_RERANKING_MODEL: "bedrock-rerank" ``` ### Alternatives Considered N/A ### Additional Context _No response_
Author
Owner

@tjbck commented on GitHub (Mar 28, 2025):

You clearly have not searched for existing issues.

Duplicate: https://github.com/open-webui/open-webui/issues/8478

<!-- gh-comment-id:2760011625 --> @tjbck commented on GitHub (Mar 28, 2025): You clearly have not searched for existing issues. Duplicate: https://github.com/open-webui/open-webui/issues/8478
Author
Owner

@btiernay commented on GitHub (Mar 28, 2025):

Apologies, I will do better next time.

<!-- gh-comment-id:2760051567 --> @btiernay commented on GitHub (Mar 28, 2025): Apologies, I will do better next time.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#32008