[GH-ISSUE #278] ollama + LlamaIndex #120

Closed
opened 2026-04-12 09:39:18 -05:00 by GiteaMirror · 4 comments
Owner

Originally created by @jowamedia on GitHub (Aug 4, 2023).
Original GitHub issue: https://github.com/ollama/ollama/issues/278

Verry nice and easy to use Ollama.

Is it planned to use it with LlamaIndex ?
It would be verry nice to index our local documents (and others) ;-)

Originally created by @jowamedia on GitHub (Aug 4, 2023). Original GitHub issue: https://github.com/ollama/ollama/issues/278 Verry nice and easy to use Ollama. Is it planned to use it with LlamaIndex ? It would be verry nice to index our local documents (and others) ;-)
GiteaMirror added the feature requesthelp wanted labels 2026-04-12 09:39:18 -05:00
Author
Owner

@sqpollen commented on GitHub (Aug 29, 2023):

Using Langchain LLM alongside LLamaIndex worked for me but I couldnt get streaming working which was a requirement.

https://gpt-index.readthedocs.io/en/latest/examples/llm/langchain.html
https://python.langchain.com/docs/integrations/llms/ollama

<!-- gh-comment-id:1698290415 --> @sqpollen commented on GitHub (Aug 29, 2023): Using Langchain LLM alongside LLamaIndex worked for me but I couldnt get streaming working which was a requirement. https://gpt-index.readthedocs.io/en/latest/examples/llm/langchain.html https://python.langchain.com/docs/integrations/llms/ollama
Author
Owner

@Satyam7166-tech commented on GitHub (Sep 15, 2023):

@sqpollen , pls update if you find a way to indiuce streaming.

<!-- gh-comment-id:1720928465 --> @Satyam7166-tech commented on GitHub (Sep 15, 2023): @sqpollen , pls update if you find a way to indiuce streaming.
Author
Owner

@mchiang0610 commented on GitHub (Sep 22, 2023):

The python parts are officially out!! https://gpt-index.readthedocs.io/en/latest/examples/llm/ollama.html

Closing this issue. Please feel free to join our discord to discuss more or if you run into more issues!

<!-- gh-comment-id:1730766298 --> @mchiang0610 commented on GitHub (Sep 22, 2023): The python parts are officially out!! https://gpt-index.readthedocs.io/en/latest/examples/llm/ollama.html Closing this issue. Please feel free to join our discord to discuss more or if you run into more issues!
Author
Owner

@jamesbraza commented on GitHub (Sep 22, 2023):

from langchain.embeddings import OllamaEmbeddings
from llama_index import ServiceContext
from llama_index.llms.ollama import Ollama

service_context = ServiceContext.from_defaults(
    llm=Ollama(model="llama2:13b"),
    embed_model=OllamaEmbeddings(model="llama2:13b"),
)

Nice work! A full Ollama stack 🦙

<!-- gh-comment-id:1730776415 --> @jamesbraza commented on GitHub (Sep 22, 2023): ```python from langchain.embeddings import OllamaEmbeddings from llama_index import ServiceContext from llama_index.llms.ollama import Ollama service_context = ServiceContext.from_defaults( llm=Ollama(model="llama2:13b"), embed_model=OllamaEmbeddings(model="llama2:13b"), ) ``` Nice work! A full Ollama stack 🦙
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#120