mirror of
https://github.com/open-webui/open-webui.git
synced 2026-07-27 17:04:57 -05:00
BAAI/bge-reranker-v2-minicpm-layerwise RAG Model could not use #872
No Assignees
Notifications
Due Date
No due date set.
Dependencies
No dependencies set.
Reference: github-starred/open-webui#872
Reference in New Issue
Block a user
Originally created by @flyfox666 on GitHub (May 9, 2024).
Bug Report
BAAI/bge-reranker-v2-minicpm-layerwise could not be used in RAG doucment setting
but BAAI/bge-reranker-v2-m3 is ok and no problem
Description
failed as attached
Bug Summary:
equires you to execute the configuration file in that repo on your local machine. Make sure you have read the code there to avoid malicious use, then set the option
trust_remote_code=Trueto remove this error.Steps to Reproduce:
[Outline the steps to reproduce the bug. Be as detailed as possible.]
copy the BAAI/bge-reranker-v2-minicpm-layerwise in to Reranking Model
Expected Behavior:
[Describe what you expected to happen.]
Actual Behavior:
[Describe what actually happened.]
Environment
Open WebUI Version: v0.1.124
Ollama (if applicable): 0.1.34
Operating System: wsl2 win11 docker for desktop
Browser (if applicable): chrome
Reproduction Details
Confirmation:
Logs and Screenshots
Browser Console Logs:
[Include relevant browser console logs, if applicable]
Docker Container Logs:
[Include relevant Docker container logs, if applicable]
2024-05-09 18:23:12 Traceback (most recent call last):
2024-05-09 18:23:12 File "/app/backend/apps/rag/main.py", line 298, in update_reranking_config
2024-05-09 18:23:12 update_reranking_model(app.state.RAG_RERANKING_MODEL, True)
2024-05-09 18:23:12 File "/app/backend/apps/rag/main.py", line 151, in update_reranking_model
2024-05-09 18:23:12 app.state.sentence_transformer_rf = sentence_transformers.CrossEncoder(
2024-05-09 18:23:12 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-05-09 18:23:12 File "/usr/local/lib/python3.11/site-packages/sentence_transformers/cross_encoder/CrossEncoder.py", line 66, in init
2024-05-09 18:23:12 self.config = AutoConfig.from_pretrained(model_name, trust_remote_code=trust_remote_code, revision=revision)
2024-05-09 18:23:12 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-05-09 18:23:12 File "/usr/local/lib/python3.11/site-packages/transformers/models/auto/configuration_auto.py", line 1141, in from_pretrained
2024-05-09 18:23:12 trust_remote_code = resolve_trust_remote_code(
2024-05-09 18:23:12 ^^^^^^^^^^^^^^^^^^^^^^^^^^
2024-05-09 18:23:12 File "/usr/local/lib/python3.11/site-packages/transformers/dynamic_module_utils.py", line 622, in resolve_trust_remote_code
2024-05-09 18:23:12 raise ValueError(
2024-05-09 18:23:12 ValueError: Loading /app/backend/data/cache/embedding/models/models--BAAI--bge-reranker-v2-minicpm-layerwise/snapshots/47b5332b296c4d8cb6ee2c60502cc62a0d708881 requires you to execute the configuration file in that repo on your local machine. Make sure you have read the code there to avoid malicious use, then set the option
trust_remote_code=Trueto remove this error.Screenshots (if applicable):
[Attach any relevant screenshots to help illustrate the issue]
Installation Method
[Describe the method you used to install the project, e.g., manual installation, Docker, package manager, etc.]
Additional Information
[Include any additional details that may help in understanding and reproducing the issue. This could include specific configurations, error messages, or anything else relevant to the bug.]
Note
If the bug report is incomplete or does not follow the provided instructions, it may not be addressed. Please ensure that you have followed the steps outlined in the README.md and troubleshooting.md documents, and provide all necessary information for us to reproduce and address the issue. Thank you!