[GH-ISSUE #631] Multi modal support? #27680

Closed
opened 2026-04-25 02:25:13 -05:00 by GiteaMirror · 2 comments
Owner

Originally created by @prologic on GitHub (Feb 3, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/631

Are we able to add Multi modal support? Ollama now supports this and it would be great to see it added to this very lovely UI I've just come across and started using 🙏 It would be great to be able to a) answer questions asked about images added to "documents" and b) generate new images from prompts.

Originally created by @prologic on GitHub (Feb 3, 2024). Original GitHub issue: https://github.com/open-webui/open-webui/issues/631 Are we able to add Multi modal support? Ollama now supports this and it would be great to see it added to this very lovely UI I've just come across and started using 🙏 It would be great to be able to a) answer questions asked about images added to "documents" and b) generate new images from prompts.
Author
Owner

@tjbck commented on GitHub (Feb 3, 2024):

Hi, feature a) has implemented a long time ago! you should just be able to drag and drop images to your chat input, make sure to use multimodal models like llava. As for the feature b), generating images is not within the scopes of multimodal models and Ollama does not support diffusion models and only supports LLMs afaik, but we'll consider adding it in the future (maybe via stable-diffusion-webui apis). Thanks!

<!-- gh-comment-id:1925182223 --> @tjbck commented on GitHub (Feb 3, 2024): Hi, feature a) has implemented a long time ago! you should just be able to drag and drop images to your chat input, make sure to use multimodal models like llava. As for the feature b), generating images is not within the scopes of multimodal models and Ollama does not support diffusion models and only supports LLMs afaik, but we'll consider adding it in the future (maybe via stable-diffusion-webui apis). Thanks!
Author
Owner

@prologic commented on GitHub (Feb 3, 2024):

Thanks I realized the same after I posted this! Sorry 🙏

<!-- gh-comment-id:1925206978 --> @prologic commented on GitHub (Feb 3, 2024): Thanks I realized the same after I posted this! Sorry 🙏
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#27680