mirror of
https://github.com/open-webui/open-webui.git
synced 2026-11-17 15:53:59 -06:00
[GH-ISSUE #12387] feat: how to deploy the self-trained llava multimodal, like the openai compatible api #119888
Reference in New Issue
Block a user
Originally created by @nouise on GitHub (Apr 3, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/12387
Check Existing Issues
Problem Description
I want to deploy the LLaVA multimodal model on my own machine. However, Ollama seems to only support the official version. How can I package my custom multimodal large model into an OpenAI-style API and make it accessible to all users?
The current issue is an error: "str has no attribute 'get'".
Desired Solution you'd like
how to fix the bug
Alternatives Considered
No response
Additional Context
No response