github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-05-06 16:11:34 -05:00
Code Issues 14.5k Packages Projects Releases 120 Wiki Activity

[GH-ISSUE #3919] trying to use llama3 with ollama embeddings getting error model 'llama2' not found #28189

New Issue
Closed
opened 2026-04-22 06:03:51 -05:00 by GiteaMirror · 4 comments
GiteaMirror commented 2026-04-22 06:03:51 -05:00
Owner
Copy Link

Originally created by @SatouKuzuma1 on GitHub (Apr 25, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/3919

What is the issue?

im using this code

from langchain_community.llms import Ollama
from langchain_community.embeddings import OllamaEmbeddings
from langchain_community.document_loaders import PyPDFLoader
from langchain_community.vectorstores import Chroma

MODEL = 'llama3'

model = Ollama(model=MODEL)
embeddings = OllamaEmbeddings()

loader = PyPDFLoader('der-admi.pdf')
documents = loader.load_and_split()
documents


vectorstore = Chroma.from_documents(documents, embedding=embeddings)

and im getting the following error

---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
Cell In[6], [line 2](vscode-notebook-cell:?execution_count=6&line=2)
      [1](vscode-notebook-cell:?execution_count=6&line=1) from langchain_community.vectorstores import Chroma
----> [2](vscode-notebook-cell:?execution_count=6&line=2) vectorstore = Chroma.from_documents(documents, embedding=embeddings)

File [~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:778](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:778), in Chroma.from_documents(cls, documents, embedding, ids, collection_name, persist_directory, client_settings, client, collection_metadata, **kwargs)
    [776](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:776) texts = [doc.page_content for doc in documents]
    [777](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:777) metadatas = [doc.metadata for doc in documents]
--> [778](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:778) return cls.from_texts(
    [779](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:779)     texts=texts,
    [780](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:780)     embedding=embedding,
    [781](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:781)     metadatas=metadatas,
    [782](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:782)     ids=ids,
    [783](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:783)     collection_name=collection_name,
    [784](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:784)     persist_directory=persist_directory,
    [785](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:785)     client_settings=client_settings,
    [786](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:786)     client=client,
    [787](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:787)     collection_metadata=collection_metadata,
    [788](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:788)     **kwargs,
    [789](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:789) )

File [~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:736](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:736), in Chroma.from_texts(cls, texts, embedding, metadatas, ids, collection_name, persist_directory, client_settings, client, collection_metadata, **kwargs)
    [728](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:728)     from chromadb.utils.batch_utils import create_batches
    [730](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:730)     for batch in create_batches(
    [731](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:731)         api=chroma_collection._client,
    [732](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:732)         ids=ids,
    [733](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:733)         metadatas=metadatas,
    [734](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:734)         documents=texts,
    [735](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:735)     ):
--> [736](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:736)         chroma_collection.add_texts(
    [737](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:737)             texts=batch[3] if batch[3] else [],
    [738](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:738)             metadatas=batch[2] if batch[2] else None,
    [739](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:739)             ids=batch[0],
    [740](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:740)         )
    [741](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:741) else:
    [742](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:742)     chroma_collection.add_texts(texts=texts, metadatas=metadatas, ids=ids)

File [~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:275](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:275), in Chroma.add_texts(self, texts, metadatas, ids, **kwargs)
    [273](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:273) texts = list(texts)
    [274](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:274) if self._embedding_function is not None:
--> [275](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:275)     embeddings = self._embedding_function.embed_documents(texts)
    [276](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:276) if metadatas:
    [277](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:277)     # fill metadatas with empty dicts if somebody
    [278](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:278)     # did not specify metadata for all texts
    [279](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:279)     length_diff = len(texts) - len(metadatas)

File [~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:211](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:211), in OllamaEmbeddings.embed_documents(self, texts)
    [202](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:202) """Embed documents using an Ollama deployed embedding model.
    [203](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:203) 
    [204](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:204) Args:
   (...)
    [208](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:208)     List of embeddings, one for each text.
    [209](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:209) """
    [210](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:210) instruction_pairs = [f"{self.embed_instruction}{text}" for text in texts]
--> [211](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:211) embeddings = self._embed(instruction_pairs)
    [212](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:212) return embeddings

File [~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:199](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:199), in OllamaEmbeddings._embed(self, input)
    [197](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:197) else:
    [198](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:198)     iter_ = input
--> [199](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:199) return [self._process_emb_response(prompt) for prompt in iter_]

File [~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:199](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:199), in <listcomp>(.0)
    [197](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:197) else:
    [198](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:198)     iter_ = input
--> [199](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:199) return [self._process_emb_response(prompt) for prompt in iter_]

File [~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:173](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:173), in OllamaEmbeddings._process_emb_response(self, input)
    [170](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:170)     raise ValueError(f"Error raised by inference endpoint: {e}")
    [172](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:172) if res.status_code != 200:
--> [173](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:173)     raise ValueError(
    [174](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:174)         "Error raised by inference API HTTP code: %s, %s"
    [175](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:175)         % (res.status_code, res.text)
    [176](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:176)     )
    [177](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:177) try:
    [178](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:178)     t = res.json()

ValueError: Error raised by inference API HTTP code: 404, {"error":"model 'llama2' not found, try pulling it first"}

I have installed llama3 and is running

 ollama list 
NAME            ID              SIZE    MODIFIED       
llama3:latest   a6990ed6be41    4.7 GB  10 minutes ago
mistral:latest  61e88e884507    4.1 GB  13 hours ago

I don't understand why is asking for llama2 in the embeddings.

OS

macOS

GPU

AMD

CPU

Intel

Ollama version

ollama version is 0.1.32

Originally created by @SatouKuzuma1 on GitHub (Apr 25, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/3919 ### What is the issue? im using this code ``` from langchain_community.llms import Ollama from langchain_community.embeddings import OllamaEmbeddings from langchain_community.document_loaders import PyPDFLoader from langchain_community.vectorstores import Chroma MODEL = 'llama3' model = Ollama(model=MODEL) embeddings = OllamaEmbeddings() loader = PyPDFLoader('der-admi.pdf') documents = loader.load_and_split() documents vectorstore = Chroma.from_documents(documents, embedding=embeddings) ``` and im getting the following error ``` --------------------------------------------------------------------------- ValueError Traceback (most recent call last) Cell In[6], [line 2](vscode-notebook-cell:?execution_count=6&line=2) [1](vscode-notebook-cell:?execution_count=6&line=1) from langchain_community.vectorstores import Chroma ----> [2](vscode-notebook-cell:?execution_count=6&line=2) vectorstore = Chroma.from_documents(documents, embedding=embeddings) File [~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:778](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:778), in Chroma.from_documents(cls, documents, embedding, ids, collection_name, persist_directory, client_settings, client, collection_metadata, **kwargs) [776](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:776) texts = [doc.page_content for doc in documents] [777](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:777) metadatas = [doc.metadata for doc in documents] --> [778](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:778) return cls.from_texts( [779](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:779) texts=texts, [780](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:780) embedding=embedding, [781](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:781) metadatas=metadatas, [782](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:782) ids=ids, [783](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:783) collection_name=collection_name, [784](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:784) persist_directory=persist_directory, [785](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:785) client_settings=client_settings, [786](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:786) client=client, [787](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:787) collection_metadata=collection_metadata, [788](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:788) **kwargs, [789](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:789) ) File [~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:736](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:736), in Chroma.from_texts(cls, texts, embedding, metadatas, ids, collection_name, persist_directory, client_settings, client, collection_metadata, **kwargs) [728](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:728) from chromadb.utils.batch_utils import create_batches [730](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:730) for batch in create_batches( [731](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:731) api=chroma_collection._client, [732](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:732) ids=ids, [733](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:733) metadatas=metadatas, [734](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:734) documents=texts, [735](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:735) ): --> [736](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:736) chroma_collection.add_texts( [737](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:737) texts=batch[3] if batch[3] else [], [738](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:738) metadatas=batch[2] if batch[2] else None, [739](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:739) ids=batch[0], [740](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:740) ) [741](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:741) else: [742](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:742) chroma_collection.add_texts(texts=texts, metadatas=metadatas, ids=ids) File [~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:275](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:275), in Chroma.add_texts(self, texts, metadatas, ids, **kwargs) [273](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:273) texts = list(texts) [274](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:274) if self._embedding_function is not None: --> [275](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:275) embeddings = self._embedding_function.embed_documents(texts) [276](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:276) if metadatas: [277](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:277) # fill metadatas with empty dicts if somebody [278](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:278) # did not specify metadata for all texts [279](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/vectorstores/chroma.py:279) length_diff = len(texts) - len(metadatas) File [~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:211](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:211), in OllamaEmbeddings.embed_documents(self, texts) [202](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:202) """Embed documents using an Ollama deployed embedding model. [203](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:203) [204](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:204) Args: (...) [208](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:208) List of embeddings, one for each text. [209](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:209) """ [210](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:210) instruction_pairs = [f"{self.embed_instruction}{text}" for text in texts] --> [211](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:211) embeddings = self._embed(instruction_pairs) [212](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:212) return embeddings File [~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:199](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:199), in OllamaEmbeddings._embed(self, input) [197](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:197) else: [198](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:198) iter_ = input --> [199](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:199) return [self._process_emb_response(prompt) for prompt in iter_] File [~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:199](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:199), in <listcomp>(.0) [197](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:197) else: [198](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:198) iter_ = input --> [199](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:199) return [self._process_emb_response(prompt) for prompt in iter_] File [~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:173](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:173), in OllamaEmbeddings._process_emb_response(self, input) [170](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:170) raise ValueError(f"Error raised by inference endpoint: {e}") [172](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:172) if res.status_code != 200: --> [173](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:173) raise ValueError( [174](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:174) "Error raised by inference API HTTP code: %s, %s" [175](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:175) % (res.status_code, res.text) [176](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:176) ) [177](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:177) try: [178](https://file+.vscode-resource.vscode-cdn.net/Users/ruben/Desktop/Python/pdf/local-model/~/Desktop/Python/pdf/local-model/.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py:178) t = res.json() ValueError: Error raised by inference API HTTP code: 404, {"error":"model 'llama2' not found, try pulling it first"} ``` I have installed llama3 and is running ``` ollama list NAME ID SIZE MODIFIED llama3:latest a6990ed6be41 4.7 GB 10 minutes ago mistral:latest 61e88e884507 4.1 GB 13 hours ago ``` I don't understand why is asking for llama2 in the embeddings. ### OS macOS ### GPU AMD ### CPU Intel ### Ollama version ollama version is 0.1.32
GiteaMirror added the bug label 2026-04-22 06:03:51 -05:00
GiteaMirror commented 2026-04-22 06:03:53 -05:00
Author
Owner
Copy Link

@dcasota commented on GitHub (Apr 25, 2024):

Hi,

In .venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py see line beginning with model: str = "llama2". After changing it, your code doesn't produce an error anymore (tested with python 3.11 and issue fix https://github.com/ollama/ollama/issues/2572#issuecomment-2070514858).
Accordingly to https://ollama.com/blog/embedding-models, there are limitations though.

<!-- gh-comment-id:2078254855 --> @dcasota commented on GitHub (Apr 25, 2024): Hi, In `.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py` see line beginning with ` model: str = "llama2"`. After changing it, your code doesn't produce an error anymore (tested with python 3.11 and issue fix https://github.com/ollama/ollama/issues/2572#issuecomment-2070514858). Accordingly to https://ollama.com/blog/embedding-models, there are limitations though.
GiteaMirror commented 2026-04-22 06:03:54 -05:00
Author
Owner
Copy Link

@B0end commented on GitHub (Apr 29, 2024):

Change
embeddings = OllamaEmbeddings()
for
embeddings = OllamaEmbeddings(model="llama3")

<!-- gh-comment-id:2083798474 --> @B0end commented on GitHub (Apr 29, 2024): Change embeddings = OllamaEmbeddings() for embeddings = OllamaEmbeddings(model="llama3")
GiteaMirror commented 2026-04-22 06:03:55 -05:00
Author
Owner
Copy Link

@SatouKuzuma1 commented on GitHub (Apr 30, 2024):

yes, that solved the problem.

<!-- gh-comment-id:2084442924 --> @SatouKuzuma1 commented on GitHub (Apr 30, 2024): yes, that solved the problem.
GiteaMirror commented 2026-04-22 06:03:57 -05:00
Author
Owner
Copy Link

@m-hefnawy commented on GitHub (May 11, 2024):

model="llama3"

Thanks, It worked for me.

<!-- gh-comment-id:2105997879 --> @m-hefnawy commented on GitHub (May 11, 2024): > model="llama3" Thanks, It worked for me.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
 python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
No Label bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#28189
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?