enh: offline leaderboard search #2983

Open
opened 2025-11-11 15:18:54 -06:00 by GiteaMirror · 3 comments
Owner

Originally created by @Fetnak on GitHub (Dec 10, 2024).

Bug Report


Installation Method

Docker

Environment

  • Open WebUI Version: v0.4.8

  • Ollama (if applicable): v0.4.5

  • Operating System: Arch Linux

  • Browser (if applicable): Firefox 133.0.3

Confirmation:

  • I have read and followed all the instructions provided in the README.md.
  • I am on the latest version of both Open WebUI and Ollama.
  • I have included the browser console logs.
  • I have included the Docker container logs.
  • I have provided the exact steps to reproduce the bug in the "Steps to Reproduce" section below.

Expected Behavior:

Working search in leaderboard without internet connection on client.

Actual Behavior:

The leaderboard search doesn't work if the client has no internet connection, even if the server has it. I used the leaderboard search earlier when I had internet.

Description

Bug Summary: The leaderboard search doesn't work if the device has no internet connection. As I understand it, after search browser tries to download file from https://cdn.jsdelivr.net/npm/@huggingface/transformers@3.0.0/dist/ort-wasm-simd-threaded.jsep.wasm, but fails. Even if I used the search earlier while I had internet, it still tries to download the file. It would be beneficial to cache this file on the open-webui server and download it from there if the internet is not accessible.

Reproduction Details

Steps to Reproduce:

  1. Disable internet on client.
  2. Try to use search.
Originally created by @Fetnak on GitHub (Dec 10, 2024). # Bug Report --- ## Installation Method Docker ## Environment - **Open WebUI Version:** v0.4.8 - **Ollama (if applicable):** v0.4.5 - **Operating System:** Arch Linux - **Browser (if applicable):** Firefox 133.0.3 **Confirmation:** - [x] I have read and followed all the instructions provided in the README.md. - [ ] I am on the latest version of both Open WebUI and Ollama. - [ ] I have included the browser console logs. - [ ] I have included the Docker container logs. - [x] I have provided the exact steps to reproduce the bug in the "Steps to Reproduce" section below. ## Expected Behavior: Working search in leaderboard without internet connection on client. ## Actual Behavior: The leaderboard search doesn't work if the client has no internet connection, even if the server has it. I used the leaderboard search earlier when I had internet. ## Description **Bug Summary:** The leaderboard search doesn't work if the device has no internet connection. As I understand it, after search browser tries to download file from `https://cdn.jsdelivr.net/npm/@huggingface/transformers@3.0.0/dist/ort-wasm-simd-threaded.jsep.wasm`, but fails. Even if I used the search earlier while I had internet, it still tries to download the file. It would be beneficial to cache this file on the open-webui server and download it from there if the internet is not accessible. ## Reproduction Details **Steps to Reproduce:** 1. Disable internet on client. 2. Try to use search.
GiteaMirror added the help wantednon-core labels 2025-11-11 15:18:54 -06:00
Author
Owner

@tjbck commented on GitHub (Dec 11, 2024):

Currently intended behaviour, would love to see a PR for this!

@tjbck commented on GitHub (Dec 11, 2024): Currently intended behaviour, would love to see a PR for this!
Author
Owner

@dannyl1u commented on GitHub (Feb 2, 2025):

Looks like this is a known issue on transformers.js ( see https://github.com/huggingface/transformers.js/issues/685#issuecomment-2325125036) and has been marked as a TODO (6f43f244e0/src/backends/onnx.js (L184))

@dannyl1u commented on GitHub (Feb 2, 2025): Looks like this is a known issue on transformers.js ( see https://github.com/huggingface/transformers.js/issues/685#issuecomment-2325125036) and has been marked as a TODO (https://github.com/huggingface/transformers.js/blob/6f43f244e04522545d3d939589c761fdaff057d4/src/backends/onnx.js#L184)
Author
Owner

@tjbck commented on GitHub (Feb 3, 2025):

transformer.js offline support should work just like our pyodide implementation here

@tjbck commented on GitHub (Feb 3, 2025): transformer.js offline support should work just like our pyodide implementation here
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#2983