issue: megablocks not available #4771

Closed
opened 2025-11-11 16:02:50 -06:00 by GiteaMirror · 1 comment
Owner

Originally created by @frenzybiscuit on GitHub (Apr 9, 2025).

Check Existing Issues

  • I have searched the existing issues and discussions.
  • I am using the latest version of Open WebUI.

Installation Method

Docker

Open WebUI Version

0.6.2

Ollama Version (if applicable)

No response

Operating System

Debian 12

Browser (if applicable)

No response

Confirmation

  • I have read and followed all instructions in README.md.
  • I am using the latest version of both Open WebUI and Ollama.
  • I have included the browser console logs.
  • I have included the Docker container logs.
  • I have listed steps to reproduce the bug in detail.

Expected Behavior

When the docker coda image is launched the following error appears in logs:

openWebUI-1 | WARNI [transformers_modules.nomic-ai.nomic-bert-2048.e5042dce39060cc34bc223455f25cf1d26db4655.modeling_hf_nomic_bert] !!!!!!!!!!!!megablocks not available, using torch.matmul instead

Not sure if this degrades performance though or if it's important. Everything appears to work.

Actual Behavior

.

Steps to Reproduce

.

Logs & Screenshots

.

Additional Information

.

Originally created by @frenzybiscuit on GitHub (Apr 9, 2025). ### Check Existing Issues - [x] I have searched the existing issues and discussions. - [x] I am using the latest version of Open WebUI. ### Installation Method Docker ### Open WebUI Version 0.6.2 ### Ollama Version (if applicable) _No response_ ### Operating System Debian 12 ### Browser (if applicable) _No response_ ### Confirmation - [x] I have read and followed all instructions in `README.md`. - [x] I am using the latest version of **both** Open WebUI and Ollama. - [x] I have included the browser console logs. - [x] I have included the Docker container logs. - [x] I have listed steps to reproduce the bug in detail. ### Expected Behavior When the docker coda image is launched the following error appears in logs: openWebUI-1 | WARNI [transformers_modules.nomic-ai.nomic-bert-2048.e5042dce39060cc34bc223455f25cf1d26db4655.modeling_hf_nomic_bert] !!!!!!!!!!!!megablocks not available, using torch.matmul instead Not sure if this degrades performance though or if it's important. Everything appears to work. ### Actual Behavior . ### Steps to Reproduce . ### Logs & Screenshots . ### Additional Information .
GiteaMirror added the bug label 2025-11-11 16:02:50 -06:00
Author
Owner

@rgaricano commented on GitHub (Apr 9, 2025):

https://huggingface.co/nomic-ai/nomic-embed-text-v2-moe/discussions/8

you need to add megablock lib:
pip install git+https://github.com/nomic-ai/megablocks.git --no-build-isolation

@rgaricano commented on GitHub (Apr 9, 2025): https://huggingface.co/nomic-ai/nomic-embed-text-v2-moe/discussions/8 you need to add megablock lib: `pip install git+https://github.com/nomic-ai/megablocks.git --no-build-isolation`
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#4771