[GH-ISSUE #6654] Running 405B model with 8GB VRAM #14437

Closed
opened 2026-04-19 20:47:46 -05:00 by GiteaMirror · 0 comments
Owner

Originally created by @pascalmariany on GitHub (Nov 2, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/6654

Feature Request

Check out this method: https://youtu.be/KSltC4TXxZg?si=h0XBAtP992iAMe4V

Could this be implemented?

Originally created by @pascalmariany on GitHub (Nov 2, 2024). Original GitHub issue: https://github.com/open-webui/open-webui/issues/6654 # Feature Request Check out this method: https://youtu.be/KSltC4TXxZg?si=h0XBAtP992iAMe4V Could this be implemented?
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#14437