mirror of
https://github.com/open-webui/open-webui.git
synced 2026-05-06 19:08:59 -05:00
issue: megablocks not available #4771
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @frenzybiscuit on GitHub (Apr 9, 2025).
Check Existing Issues
Installation Method
Docker
Open WebUI Version
0.6.2
Ollama Version (if applicable)
No response
Operating System
Debian 12
Browser (if applicable)
No response
Confirmation
README.md.Expected Behavior
When the docker coda image is launched the following error appears in logs:
openWebUI-1 | WARNI [transformers_modules.nomic-ai.nomic-bert-2048.e5042dce39060cc34bc223455f25cf1d26db4655.modeling_hf_nomic_bert] !!!!!!!!!!!!megablocks not available, using torch.matmul instead
Not sure if this degrades performance though or if it's important. Everything appears to work.
Actual Behavior
.
Steps to Reproduce
.
Logs & Screenshots
.
Additional Information
.
@rgaricano commented on GitHub (Apr 9, 2025):
https://huggingface.co/nomic-ai/nomic-embed-text-v2-moe/discussions/8
you need to add megablock lib:
pip install git+https://github.com/nomic-ai/megablocks.git --no-build-isolation