Originally created by @rpaGuyai on GitHub (Feb 18, 2025).
I have tried switching to different text to text embedding models and it works fine but when I try using any of image embedding model, for .e.g. openai/clip-vit-large-patch14, I get error while uploading document as "400: 'NoneType' object has no attribute 'encode'.
My goal is to get the model understand images within the documents upload in RAG and even for the documents uploaded from frontend.
So I ma trying to use an image embedder to achieve this and a vision LLM model.
Please do guide me on my approach as well if I am doing it incorrectly.
Thanks
Originally created by @rpaGuyai on GitHub (Feb 18, 2025).
I have tried switching to different text to text embedding models and it works fine but when I try using any of image embedding model, for .e.g. openai/clip-vit-large-patch14, I get error while uploading document as "**400: 'NoneType' object has no attribute 'encode'**.
My goal is to get the model understand images within the documents upload in RAG and even for the documents uploaded from frontend.
So I ma trying to use an image embedder to achieve this and a vision LLM model.
Please do guide me on my approach as well if I am doing it incorrectly.
Thanks
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Originally created by @rpaGuyai on GitHub (Feb 18, 2025).
I have tried switching to different text to text embedding models and it works fine but when I try using any of image embedding model, for .e.g. openai/clip-vit-large-patch14, I get error while uploading document as "400: 'NoneType' object has no attribute 'encode'.
My goal is to get the model understand images within the documents upload in RAG and even for the documents uploaded from frontend.
So I ma trying to use an image embedder to achieve this and a vision LLM model.
Please do guide me on my approach as well if I am doing it incorrectly.
Thanks