mirror of
https://github.com/open-webui/open-webui.git
synced 2026-08-30 17:25:30 -05:00
[GH-ISSUE #7759] [bug] text-generation-inference backend for VLMs does not see images #53544
Reference in New Issue
Block a user
Originally created by @lucyknada on GitHub (Dec 11, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/7759
issue: sending images to tgi returns nonsense, probably because the image is not sent in a way it expects it to?
ref: https://huggingface.co/docs/text-generation-inference/main/en/basic_tutorials/visual_language_models#hugging-face-hub-python-library
comparing that to the payload openwebui sends via devtools:
it seems they might expect the markdown embed?
or are they unable to use images mid-context and force you to send "inputs" key?just guessing / mindstorming what the issue could be, thanks!