[GH-ISSUE #1276] A way to reuse ollama API with RAG app. #47167

Closed
opened 2026-04-28 03:24:06 -05:00 by GiteaMirror · 4 comments
Owner

Originally created by @sandangel on GitHub (Nov 26, 2023).
Original GitHub issue: https://github.com/ollama/ollama/issues/1276

Hi, I would like to build an RAG app, but instead of having its own API, I like to reuse the Ollama existing API so that it will work with many existing clients. Is there a way to do that?

Originally created by @sandangel on GitHub (Nov 26, 2023). Original GitHub issue: https://github.com/ollama/ollama/issues/1276 Hi, I would like to build an RAG app, but instead of having its own API, I like to reuse the Ollama existing API so that it will work with many existing clients. Is there a way to do that?
Author
Owner

@BruceMacD commented on GitHub (Nov 27, 2023):

Hi @sandangel, this could be possible if you built your API to match our spec. You can find the documentation here:
https://github.com/jmorganca/ollama/blob/main/docs/api.md

You'd have to keep an eye on Ollama releases for new API endpoints and changes though.

<!-- gh-comment-id:1828154397 --> @BruceMacD commented on GitHub (Nov 27, 2023): Hi @sandangel, this could be possible if you built your API to match our spec. You can find the documentation here: https://github.com/jmorganca/ollama/blob/main/docs/api.md You'd have to keep an eye on Ollama releases for new API endpoints and changes though.
Author
Owner

@sandangel commented on GitHub (Nov 30, 2023):

@BruceMacD Can we publish the API as an interface package and user can hook their own handler into that?

<!-- gh-comment-id:1833356397 --> @sandangel commented on GitHub (Nov 30, 2023): @BruceMacD Can we publish the API as an interface package and user can hook their own handler into that?
Author
Owner

@da-z commented on GitHub (Feb 7, 2024):

Do you guys have any plans or are open to the idea of bundling a vector store into Ollama (something like Weviate), and offering an API for the store?

cc @jimlloyd

<!-- gh-comment-id:1931848533 --> @da-z commented on GitHub (Feb 7, 2024): Do you guys have any plans or are open to the idea of bundling a vector store into Ollama (something like [Weviate](https://weaviate.io/developers/weaviate/installation/embedded)), and offering an API for the store? cc @jimlloyd
Author
Owner

@jmorganca commented on GitHub (Sep 4, 2024):

Hi there, thanks for the issue! Revisiting this – Ollama has an API to generate embeddings and works great with Weaviate and other vector stores. There isn't currently a vector store built into Ollama

<!-- gh-comment-id:2327841312 --> @jmorganca commented on GitHub (Sep 4, 2024): Hi there, thanks for the issue! Revisiting this – Ollama has an [API to generate embeddings](https://github.com/ollama/ollama/blob/main/docs/api.md#generate-embeddings) and works great with Weaviate and other vector stores. There isn't currently a vector store built into Ollama
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#47167