Originally created by @SD-fan on GitHub (Jul 18, 2024).
Bug Report
Description
Bug Summary:
Setting the reranker to the new jinaai/jina-reranker-v2-base-multilingual model works. But once the reranker model is used, it runs forever. OI hangs and can only be revived via a docker restart.
Steps to Reproduce:
Set reranker to jinaai/jina-reranker-v2-base-multilingual
Run inference with a document reference ie. #xyz
OI hangs / CPU has 75% load / nothing happens
Expected Behavior:
jinaai/jina-reranker-v2-base-multilingual should run properly - same as BAAI/bge-reranker-v2-m3.
Actual Behavior:
see D
Environment
Open WebUI Version: 0.3.8
Ollama (if applicable): version coming with OI docker
Operating System: Win 11 & WSL docker
Browser (if applicable): FF
Originally created by @SD-fan on GitHub (Jul 18, 2024).
# Bug Report
## Description
**Bug Summary:**
Setting the reranker to the new jinaai/jina-reranker-v2-base-multilingual model works. But once the reranker model is used, it runs forever. OI hangs and can only be revived via a docker restart.
**Steps to Reproduce:**
Set reranker to jinaai/jina-reranker-v2-base-multilingual
Run inference with a document reference ie. #xyz
OI hangs / CPU has 75% load / nothing happens
**Expected Behavior:**
jinaai/jina-reranker-v2-base-multilingual should run properly - same as BAAI/bge-reranker-v2-m3.
**Actual Behavior:**
see D
## Environment
- **Open WebUI Version:** 0.3.8
- **Ollama (if applicable):** version coming with OI docker
- **Operating System:** Win 11 & WSL docker
- **Browser (if applicable):** FF
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Originally created by @SD-fan on GitHub (Jul 18, 2024).
Bug Report
Description
Bug Summary:
Setting the reranker to the new jinaai/jina-reranker-v2-base-multilingual model works. But once the reranker model is used, it runs forever. OI hangs and can only be revived via a docker restart.
Steps to Reproduce:
Set reranker to jinaai/jina-reranker-v2-base-multilingual
Run inference with a document reference ie. #xyz
OI hangs / CPU has 75% load / nothing happens
Expected Behavior:
jinaai/jina-reranker-v2-base-multilingual should run properly - same as BAAI/bge-reranker-v2-m3.
Actual Behavior:
see D
Environment
Open WebUI Version: 0.3.8
Ollama (if applicable): version coming with OI docker
Operating System: Win 11 & WSL docker
Browser (if applicable): FF