Use of Image embedding model #3924

Closed
opened 2025-11-11 15:42:39 -06:00 by GiteaMirror · 0 comments
Owner

Originally created by @rpaGuyai on GitHub (Feb 18, 2025).

I have tried switching to different text to text embedding models and it works fine but when I try using any of image embedding model, for .e.g. openai/clip-vit-large-patch14, I get error while uploading document as "400: 'NoneType' object has no attribute 'encode'.

My goal is to get the model understand images within the documents upload in RAG and even for the documents uploaded from frontend.

So I ma trying to use an image embedder to achieve this and a vision LLM model.

Please do guide me on my approach as well if I am doing it incorrectly.

Thanks

Originally created by @rpaGuyai on GitHub (Feb 18, 2025). I have tried switching to different text to text embedding models and it works fine but when I try using any of image embedding model, for .e.g. openai/clip-vit-large-patch14, I get error while uploading document as "**400: 'NoneType' object has no attribute 'encode'**. My goal is to get the model understand images within the documents upload in RAG and even for the documents uploaded from frontend. So I ma trying to use an image embedder to achieve this and a vision LLM model. Please do guide me on my approach as well if I am doing it incorrectly. Thanks
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#3924