feat: support openai embeddings for rag #277

Closed
opened 2025-11-11 14:15:04 -06:00 by GiteaMirror · 7 comments
Owner

Originally created by @peperunas on GitHub (Feb 8, 2024).

Is your feature request related to a problem? Please describe.
It would be great to have support for OpenAI's embedding models. As of now, to the best of my knowledge, only local embeddings are supported.

Link: https://platform.openai.com/docs/guides/embeddings

Originally created by @peperunas on GitHub (Feb 8, 2024). **Is your feature request related to a problem? Please describe.** It would be great to have support for OpenAI's embedding models. As of now, to the best of my knowledge, only local embeddings are supported. Link: https://platform.openai.com/docs/guides/embeddings
GiteaMirror added the enhancementgood first issuehelp wanted labels 2025-11-11 14:15:04 -06:00
Author
Owner

@justinh-rahb commented on GitHub (Feb 8, 2024):

As of now, to the best of my knowledge, only local embeddings are supported.

Believe you're correct. I'd go further and suggest to support the OpenAI API's embedding endpoint spec in general so that other compatible sources could be used.

@justinh-rahb commented on GitHub (Feb 8, 2024): > As of now, to the best of my knowledge, only local embeddings are supported. Believe you're correct. I'd go further and suggest to support the OpenAI API's embedding endpoint spec in general so that other compatible sources could be used.
Author
Owner

@tjbck commented on GitHub (Feb 8, 2024):

Hi, I'm not entirely sure why or where this is useful, as we don't utilize any embeddings api directly and only use the chat completion api which handles embedding automatically. Could you guide me through and elaborate more on its potential use cases?

@tjbck commented on GitHub (Feb 8, 2024): Hi, I'm not entirely sure why or where this is useful, as we don't utilize any embeddings api directly and only use the `chat completion` api which handles embedding automatically. Could you guide me through and elaborate more on its potential use cases?
Author
Owner

@justinh-rahb commented on GitHub (Feb 8, 2024):

@tjbck right now the RAG feature uses an internal embedding model in the container to convert text into vectors, we're proposing to be able to use API embeddings models as alternative, some of them work significantly better than the default all-MiniLM-L6-v2 used right now.

@justinh-rahb commented on GitHub (Feb 8, 2024): @tjbck right now the RAG feature uses an internal embedding model in the container to convert text into vectors, we're proposing to be able to use API embeddings models as alternative, some of them work significantly better than the default `all-MiniLM-L6-v2` used right now.
Author
Owner

@tjbck commented on GitHub (Feb 8, 2024):

@justinh-rahb makes sense if that's what OP meant, thanks for the explanation!

@tjbck commented on GitHub (Feb 8, 2024): @justinh-rahb makes sense if that's what OP meant, thanks for the explanation!
Author
Owner

@bozo32 commented on GitHub (Mar 29, 2024):

will this permit choice of index?
https://docs.llamaindex.ai/en/stable/module_guides/indexing/index_guide/
not sure, but for data sources that are somewhat internally structured (e.g. academic papers), when iterating through data sources the tree structure may perform differently.

@bozo32 commented on GitHub (Mar 29, 2024): will this permit choice of index? https://docs.llamaindex.ai/en/stable/module_guides/indexing/index_guide/ not sure, but for data sources that are somewhat internally structured (e.g. academic papers), when iterating through data sources the tree structure may perform differently.
Author
Owner

@thienedits commented on GitHub (May 18, 2024):

Is it me or does this openai embedding model not work correctly? In the Document settings, OpenAI settings don't seem to work.

@thienedits commented on GitHub (May 18, 2024): Is it me or does this openai embedding model not work correctly? In the Document settings, OpenAI settings don't seem to work.
Author
Owner

@yuzukumo commented on GitHub (Sep 7, 2024):

Is it me or does this openai embedding model not work correctly? In the Document settings, OpenAI settings don't seem to work.是我还是这个 OpenAI 嵌入模型出了问题?在文档设置中,OpenAI 设置似乎不起作用。

u need to restart the server for this setting to take effect

@yuzukumo commented on GitHub (Sep 7, 2024): > Is it me or does this openai embedding model not work correctly? In the Document settings, OpenAI settings don't seem to work.是我还是这个 OpenAI 嵌入模型出了问题?在文档设置中,OpenAI 设置似乎不起作用。 u need to restart the server for this setting to take effect
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#277