issue: hybrid search "Cannot handle batch sizes > 1 if no padding token is defined." with qdrant #4974

New Issue

2025-11-11T16:08:33-06:00

GiteaMirror commented

2025-11-11 16:08:33 -06:00

Originally created by @DC1LEX on GitHub (Apr 27, 2025).

Check Existing Issues

I have searched the existing issues and discussions.
I am using the latest version of Open WebUI.

Installation Method

Other

Open WebUI Version

0.6.5

Ollama Version (if applicable)

0.6.6

Operating System

Ubuntu 24.04

Browser (if applicable)

Chrome 134.0.6998.88

Confirmation

I have read and followed all instructions in README.md.
I am using the latest version of both Open WebUI and Ollama.
I have included the browser console logs.
I have included the Docker container logs.
I have listed steps to reproduce the bug in detail.

Expected Behavior

Get re-ranked search results

Actual Behavior

With enabled hybrid search I get error messages from open-webui as below. However, a result is generated but I guess this is w/o reranking.

2025-04-27 14:37:45.944 | ERROR | open_webui.retrieval.utils:query_doc_with_hybrid_search:174 - Error querying doc file-8a95ee53-75a9-4676-9886-35c8fb849862 with hybrid search: Cannot handle batch sizes > 1 if no padding token is defined. - {}

Steps to Reproduce

Create a knowledge base
Create a custom model with the knowledge base
switch on Hybrid Search, parameters below
Ask a question with the custom model and observe open-webui logs

Logs & Screenshots

2025-04-27 14:36:36.402 | INFO | uvicorn.protocols.http.httptools_impl:send:476 - 192.168.100.53:54300 - "GET /api/v1/chats/ecde0c2f-249a-4f75-b900-7f3a035e92b7/tags HTTP/1.1" 200 - {}
2025-04-27 14:36:36.418 | INFO | uvicorn.protocols.http.httptools_impl:send:476 - 192.168.100.53:54300 - "GET /api/v1/users/user/settings HTTP/1.1" 200 - {}
Task IDs for chat ecde0c2f-249a-4f75-b900-7f3a035e92b7: []
2025-04-27 14:36:36.455 | INFO | uvicorn.protocols.http.httptools_impl:send:476 - 192.168.100.53:54300 - "GET /api/tasks/chat/ecde0c2f-249a-4f75-b900-7f3a035e92b7 HTTP/1.1" 200 - {}
2025-04-27 14:36:36.572 | INFO | uvicorn.protocols.http.httptools_impl:send:476 - 192.168.100.53:54300 - "GET /ollama/api/version HTTP/1.1" 200 - {}
2025-04-27 14:36:55.034 | INFO | uvicorn.protocols.http.httptools_impl:send:476 - 192.168.100.53:57748 - "POST /api/v1/chats/ecde0c2f-249a-4f75-b900-7f3a035e92b7 HTTP/1.1" 200 - {}
2025-04-27 14:36:55.226 | INFO | uvicorn.protocols.http.httptools_impl:send:476 - 192.168.100.53:57748 - "GET /api/v1/chats/?page=1 HTTP/1.1" 200 - {}
2025-04-27 14:37:10.866 | INFO | httpx._client:_send_single_request:1025 - HTTP Request: POST http://localhost:6333/collections/open-webui_file-8a95ee53-75a9-4676-9886-35c8fb849862/points/query "HTTP/1.1 200 OK" - {}
2025-04-27 14:37:10.880 | INFO | open_webui.retrieval.utils:query_collection_with_hybrid_search:310 - Starting hybrid search for 2 queries in 1 collections... - {}
2025-04-27 14:37:12.838 | INFO | httpx._client:_send_single_request:1025 - HTTP Request: POST http://localhost:6333/collections/open-webui_file-8a95ee53-75a9-4676-9886-35c8fb849862/points/query "HTTP/1.1 200 OK" - {}
Batches: 0%| | 0/2 [00:00<?, ?it/s]2025-04-27 14:37:12.863 | INFO | httpx._client:_send_single_request:1025 - HTTP Request: POST http://localhost:6333/collections/open-webui_file-8a95ee53-75a9-4676-9886-35c8fb849862/points/query "HTTP/1.1 200 OK" - {}
Batches: 0%| | 0/2 [00:33<?, ?it/s]
2025-04-27 14:37:45.944 | ERROR | open_webui.retrieval.utils:query_doc_with_hybrid_search:174 - Error querying doc file-8a95ee53-75a9-4676-9886-35c8fb849862 with hybrid search: Cannot handle batch sizes > 1 if no padding token is defined. - {}
Traceback (most recent call last):

File "/usr/lib/python3.12/threading.py", line 1030, in _bootstrap
self._bootstrap_inner()
│ └ <function Thread._bootstrap_inner at 0x7890475aad40>
└ <Thread(ThreadPoolExecutor-28_1, started 132552130000576)>
File "/usr/lib/python3.12/threading.py", line 1073, in _bootstrap_inner
self.run()
│ └ <function Thread.run at 0x7890475aaa20>
└ <Thread(ThreadPoolExecutor-28_1, started 132552130000576)>
File "/usr/lib/python3.12/threading.py", line 1010, in run
self._target(*self._args, **self._kwargs)
│ │ │ │ │ └ {}
│ │ │ │ └ <Thread(ThreadPoolExecutor-28_1, started 132552130000576)>
│ │ │ └ (<weakref at 0x788e4b6be1b0; to 'ThreadPoolExecutor' at 0x788e4b78ff20>, <_queue.SimpleQueue object at 0x788e3cf5fdd0>, None,...
│ │ └ <Thread(ThreadPoolExecutor-28_1, started 132552130000576)>
│ └ <function _worker at 0x788f6cf92de0>
└ <Thread(ThreadPoolExecutor-28_1, started 132552130000576)>
File "/usr/lib/python3.12/concurrent/futures/thread.py", line 92, in _worker
work_item.run()
│ └ <function _WorkItem.run at 0x788f6cf92f20>
└ <concurrent.futures.thread._WorkItem object at 0x788e3cf11e50>
File "/usr/lib/python3.12/concurrent/futures/thread.py", line 58, in run
result = self.fn(*self.args, **self.kwargs)
│ │ │ │ │ └ {}
│ │ │ │ └ <concurrent.futures.thread._WorkItem object at 0x788e3cf11e50>
│ │ │ └ ('file-8a95ee53-75a9-4676-9886-35c8fb849862', 'Cybersecurity standards in software development processes')
│ │ └ <concurrent.futures.thread._WorkItem object at 0x788e3cf11e50>
│ └ <function query_collection_with_hybrid_search..process_query at 0x788e483785e0>
└ <concurrent.futures.thread._WorkItem object at 0x788e3cf11e50>
File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/open_webui/retrieval/utils.py", line 316, in process_query
result = query_doc_with_hybrid_search(
└ <function query_doc_with_hybrid_search at 0x788efefadee0>

File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/open_webui/retrieval/utils.py", line 148, in query_doc_with_hybrid_search
result = compression_retriever.invoke(query)
│ │ └ 'Cybersecurity standards in software development processes'
│ └ <function BaseRetriever.invoke at 0x788eff37a200>
└ ContextualCompressionRetriever(base_compressor=RerankCompressor(embedding_function=<function chat_completion_files_handler.<l...
File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/langchain_core/retrievers.py", line 259, in invoke
result = self._get_relevant_documents(
│ └ <function ContextualCompressionRetriever._get_relevant_documents at 0x788eff379b20>
└ ContextualCompressionRetriever(base_compressor=RerankCompressor(embedding_function=<function chat_completion_files_handler.<l...
File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/langchain/retrievers/contextual_compression.py", line 48, in _get_relevant_documents
compressed_docs = self.base_compressor.compress_documents(
│ │ └ <function RerankCompressor.compress_documents at 0x788efefaf1a0>
│ └ RerankCompressor(embedding_function=<function chat_completion_files_handler.... at 0x788e4837...
└ ContextualCompressionRetriever(base_compressor=RerankCompressor(embedding_function=<function chat_completion_files_handler.<l...
File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/open_webui/retrieval/utils.py", line 785, in compress_documents
scores = self.reranking_function.predict(
│ │ └ <function CrossEncoder.predict at 0x788e5e134860>
│ └ <sentence_transformers.cross_encoder.CrossEncoder.CrossEncoder object at 0x788e48205700>
└ RerankCompressor(embedding_function=<function chat_completion_files_handler.... at 0x788e4837...
File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/sentence_transformers/cross_encoder/CrossEncoder.py", line 444, in predict
model_predictions = self.model(**features, return_dict=True)
│ │ └ {'input_ids': tensor([[ 56715, 652, 17039, ..., 151643, 151643, 151643],
│ │ [ 56715, 652, 17039, ..., 151643, ...
│ └ Qwen2ForSequenceClassification(
│ (model): Qwen2Model(
│ (embed_tokens): Embedding(151936, 1536)
│ (layers): ModuleList(
│ ...
└ <sentence_transformers.cross_encoder.CrossEncoder.CrossEncoder object at 0x788e48205700>
File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1739, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
│ │ │ └ {'input_ids': tensor([[ 56715, 652, 17039, ..., 151643, 151643, 151643],
│ │ │ [ 56715, 652, 17039, ..., 151643, ...
│ │ └ ()
│ └ <function Module._call_impl at 0x788f80fdb920>
└ Qwen2ForSequenceClassification(
(model): Qwen2Model(
(embed_tokens): Embedding(151936, 1536)
(layers): ModuleList(
...
File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1750, in _call_impl
return forward_call(*args, **kwargs)
│ │ └ {'input_ids': tensor([[ 56715, 652, 17039, ..., 151643, 151643, 151643],
│ │ [ 56715, 652, 17039, ..., 151643, ...
│ └ ()
└ <bound method Qwen2ForSequenceClassification.forward of Qwen2ForSequenceClassification(
(model): Qwen2Model(
(embed_tok...
File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/transformers/models/qwen2/modeling_qwen2.py", line 965, in forward
raise ValueError("Cannot handle batch sizes > 1 if no padding token is defined.")

ValueError: Cannot handle batch sizes > 1 if no padding token is defined.
2025-04-27 14:37:45.953 | ERROR | open_webui.retrieval.utils:process_query:328 - Error when querying the collection with hybrid_search: Cannot handle batch sizes > 1 if no padding token is defined. - {}
Traceback (most recent call last):

File "/usr/lib/python3.12/threading.py", line 1030, in _bootstrap
self._bootstrap_inner()
│ └ <function Thread._bootstrap_inner at 0x7890475aad40>
└ <Thread(ThreadPoolExecutor-28_1, started 132552130000576)>
File "/usr/lib/python3.12/threading.py", line 1073, in _bootstrap_inner
self.run()
│ └ <function Thread.run at 0x7890475aaa20>
└ <Thread(ThreadPoolExecutor-28_1, started 132552130000576)>
File "/usr/lib/python3.12/threading.py", line 1010, in run
self._target(*self._args, **self._kwargs)
│ │ │ │ │ └ {}
│ │ │ │ └ <Thread(ThreadPoolExecutor-28_1, started 132552130000576)>
│ │ │ └ (<weakref at 0x788e4b6be1b0; to 'ThreadPoolExecutor' at 0x788e4b78ff20>, <_queue.SimpleQueue object at 0x788e3cf5fdd0>, None,...
│ │ └ <Thread(ThreadPoolExecutor-28_1, started 132552130000576)>
│ └ <function _worker at 0x788f6cf92de0>
└ <Thread(ThreadPoolExecutor-28_1, started 132552130000576)>
File "/usr/lib/python3.12/concurrent/futures/thread.py", line 92, in _worker
work_item.run()
│ └ <function _WorkItem.run at 0x788f6cf92f20>
└ <concurrent.futures.thread._WorkItem object at 0x788e3cf11e50>
File "/usr/lib/python3.12/concurrent/futures/thread.py", line 58, in run
result = self.fn(*self.args, **self.kwargs)
│ │ │ │ │ └ {}
│ │ │ │ └ <concurrent.futures.thread._WorkItem object at 0x788e3cf11e50>
│ │ │ └ ('file-8a95ee53-75a9-4676-9886-35c8fb849862', 'Cybersecurity standards in software development processes')
│ │ └ <concurrent.futures.thread._WorkItem object at 0x788e3cf11e50>
│ └ <function query_collection_with_hybrid_search..process_query at 0x788e483785e0>
└ <concurrent.futures.thread._WorkItem object at 0x788e3cf11e50>

File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/open_webui/retrieval/utils.py", line 316, in process_query
result = query_doc_with_hybrid_search(
└ <function query_doc_with_hybrid_search at 0x788efefadee0>
File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/open_webui/retrieval/utils.py", line 175, in query_doc_with_hybrid_search
raise e
File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/open_webui/retrieval/utils.py", line 148, in query_doc_with_hybrid_search
result = compression_retriever.invoke(query)
│ │ └ 'Cybersecurity standards in software development processes'
│ └ <function BaseRetriever.invoke at 0x788eff37a200>
└ ContextualCompressionRetriever(base_compressor=RerankCompressor(embedding_function=<function chat_completion_files_handler.<l...
File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/langchain_core/retrievers.py", line 259, in invoke
result = self._get_relevant_documents(
│ └ <function ContextualCompressionRetriever._get_relevant_documents at 0x788eff379b20>
└ ContextualCompressionRetriever(base_compressor=RerankCompressor(embedding_function=<function chat_completion_files_handler.<l...
File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/langchain/retrievers/contextual_compression.py", line 48, in _get_relevant_documents
compressed_docs = self.base_compressor.compress_documents(
│ │ └ <function RerankCompressor.compress_documents at 0x788efefaf1a0>
│ └ RerankCompressor(embedding_function=<function chat_completion_files_handler.... at 0x788e4837...
└ ContextualCompressionRetriever(base_compressor=RerankCompressor(embedding_function=<function chat_completion_files_handler.<l...
File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/open_webui/retrieval/utils.py", line 785, in compress_documents
scores = self.reranking_function.predict(
│ │ └ <function CrossEncoder.predict at 0x788e5e134860>
│ └ <sentence_transformers.cross_encoder.CrossEncoder.CrossEncoder object at 0x788e48205700>
└ RerankCompressor(embedding_function=<function chat_completion_files_handler.... at 0x788e4837...
File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/sentence_transformers/cross_encoder/CrossEncoder.py", line 444, in predict
model_predictions = self.model(**features, return_dict=True)
│ │ └ {'input_ids': tensor([[ 56715, 652, 17039, ..., 151643, 151643, 151643],
│ │ [ 56715, 652, 17039, ..., 151643, ...
│ └ Qwen2ForSequenceClassification(
│ (model): Qwen2Model(
│ (embed_tokens): Embedding(151936, 1536)
│ (layers): ModuleList(
│ ...
└ <sentence_transformers.cross_encoder.CrossEncoder.CrossEncoder object at 0x788e48205700>
File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1739, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
│ │ │ └ {'input_ids': tensor([[ 56715, 652, 17039, ..., 151643, 151643, 151643],
│ │ │ [ 56715, 652, 17039, ..., 151643, ...
│ │ └ ()
│ └ <function Module._call_impl at 0x788f80fdb920>
└ Qwen2ForSequenceClassification(
(model): Qwen2Model(
(embed_tokens): Embedding(151936, 1536)
(layers): ModuleList(
...
File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1750, in _call_impl
return forward_call(*args, **kwargs)
│ │ └ {'input_ids': tensor([[ 56715, 652, 17039, ..., 151643, 151643, 151643],
│ │ [ 56715, 652, 17039, ..., 151643, ...
│ └ ()
└ <bound method Qwen2ForSequenceClassification.forward of Qwen2ForSequenceClassification(
(model): Qwen2Model(
(embed_tok...
File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/transformers/models/qwen2/modeling_qwen2.py", line 965, in forward
raise ValueError("Cannot handle batch sizes > 1 if no padding token is defined.")

ValueError: Cannot handle batch sizes > 1 if no padding token is defined.
Batches: 0%| | 0/2 [00:40<?, ?it/s]
2025-04-27 14:37:53.295 | ERROR | open_webui.retrieval.utils:query_doc_with_hybrid_search:174 - Error querying doc file-8a95ee53-75a9-4676-9886-35c8fb849862 with hybrid search: Cannot handle batch sizes > 1 if no padding token is defined. - {}
Traceback (most recent call last):

File "/usr/lib/python3.12/threading.py", line 1030, in _bootstrap
self._bootstrap_inner()
│ └ <function Thread._bootstrap_inner at 0x7890475aad40>
└ <Thread(ThreadPoolExecutor-28_0, started 132551873763008)>
File "/usr/lib/python3.12/threading.py", line 1073, in _bootstrap_inner
self.run()
│ └ <function Thread.run at 0x7890475aaa20>
└ <Thread(ThreadPoolExecutor-28_0, started 132551873763008)>
File "/usr/lib/python3.12/threading.py", line 1010, in run
self._target(*self._args, **self._kwargs)
│ │ │ │ │ └ {}
│ │ │ │ └ <Thread(ThreadPoolExecutor-28_0, started 132551873763008)>
│ │ │ └ (<weakref at 0x788e4b6bec50; to 'ThreadPoolExecutor' at 0x788e4b78ff20>, <_queue.SimpleQueue object at 0x788e3cf5fdd0>, None,...
│ │ └ <Thread(ThreadPoolExecutor-28_0, started 132551873763008)>
│ └ <function _worker at 0x788f6cf92de0>
└ <Thread(ThreadPoolExecutor-28_0, started 132551873763008)>
File "/usr/lib/python3.12/concurrent/futures/thread.py", line 92, in _worker
work_item.run()
│ └ <function _WorkItem.run at 0x788f6cf92f20>
└ <concurrent.futures.thread._WorkItem object at 0x788e481103b0>
File "/usr/lib/python3.12/concurrent/futures/thread.py", line 58, in run
result = self.fn(*self.args, **self.kwargs)
│ │ │ │ │ └ {}
│ │ │ │ └ <concurrent.futures.thread._WorkItem object at 0x788e481103b0>
│ │ │ └ ('file-8a95ee53-75a9-4676-9886-35c8fb849862', 'BSI-TR-03185 secure software lifecycle requirements')
│ │ └ <concurrent.futures.thread._WorkItem object at 0x788e481103b0>
│ └ <function query_collection_with_hybrid_search..process_query at 0x788e483785e0>
└ <concurrent.futures.thread._WorkItem object at 0x788e481103b0>
File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/open_webui/retrieval/utils.py", line 316, in process_query
result = query_doc_with_hybrid_search(
└ <function query_doc_with_hybrid_search at 0x788efefadee0>

File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/open_webui/retrieval/utils.py", line 148, in query_doc_with_hybrid_search
result = compression_retriever.invoke(query)
│ │ └ 'BSI-TR-03185 secure software lifecycle requirements'
│ └ <function BaseRetriever.invoke at 0x788eff37a200>
└ ContextualCompressionRetriever(base_compressor=RerankCompressor(embedding_function=<function chat_completion_files_handler.<l...
File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/langchain_core/retrievers.py", line 259, in invoke
result = self._get_relevant_documents(
│ └ <function ContextualCompressionRetriever._get_relevant_documents at 0x788eff379b20>
└ ContextualCompressionRetriever(base_compressor=RerankCompressor(embedding_function=<function chat_completion_files_handler.<l...
File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/langchain/retrievers/contextual_compression.py", line 48, in _get_relevant_documents
compressed_docs = self.base_compressor.compress_documents(
│ │ └ <function RerankCompressor.compress_documents at 0x788efefaf1a0>
│ └ RerankCompressor(embedding_function=<function chat_completion_files_handler.... at 0x788e4837...
└ ContextualCompressionRetriever(base_compressor=RerankCompressor(embedding_function=<function chat_completion_files_handler.<l...
File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/open_webui/retrieval/utils.py", line 785, in compress_documents
scores = self.reranking_function.predict(
│ │ └ <function CrossEncoder.predict at 0x788e5e134860>
│ └ <sentence_transformers.cross_encoder.CrossEncoder.CrossEncoder object at 0x788e48205700>
└ RerankCompressor(embedding_function=<function chat_completion_files_handler.... at 0x788e4837...
File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/sentence_transformers/cross_encoder/CrossEncoder.py", line 444, in predict
model_predictions = self.model(**features, return_dict=True)
│ │ └ {'input_ids': tensor([[ 7347, 40, 12, ..., 151643, 151643, 151643],
│ │ [ 7347, 40, 12, ..., 151643, ...
│ └ Qwen2ForSequenceClassification(
│ (model): Qwen2Model(
│ (embed_tokens): Embedding(151936, 1536)
│ (layers): ModuleList(
│ ...
└ <sentence_transformers.cross_encoder.CrossEncoder.CrossEncoder object at 0x788e48205700>
File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1739, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
│ │ │ └ {'input_ids': tensor([[ 7347, 40, 12, ..., 151643, 151643, 151643],
│ │ │ [ 7347, 40, 12, ..., 151643, ...
│ │ └ ()
│ └ <function Module._call_impl at 0x788f80fdb920>
└ Qwen2ForSequenceClassification(
(model): Qwen2Model(
(embed_tokens): Embedding(151936, 1536)
(layers): ModuleList(
...
File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1750, in _call_impl
return forward_call(*args, **kwargs)
│ │ └ {'input_ids': tensor([[ 7347, 40, 12, ..., 151643, 151643, 151643],
│ │ [ 7347, 40, 12, ..., 151643, ...
│ └ ()
└ <bound method Qwen2ForSequenceClassification.forward of Qwen2ForSequenceClassification(
(model): Qwen2Model(
(embed_tok...
File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/transformers/models/qwen2/modeling_qwen2.py", line 965, in forward
raise ValueError("Cannot handle batch sizes > 1 if no padding token is defined.")

ValueError: Cannot handle batch sizes > 1 if no padding token is defined.
2025-04-27 14:37:53.303 | ERROR | open_webui.retrieval.utils:process_query:328 - Error when querying the collection with hybrid_search: Cannot handle batch sizes > 1 if no padding token is defined. - {}
Traceback (most recent call last):

File "/usr/lib/python3.12/threading.py", line 1030, in _bootstrap
self._bootstrap_inner()
│ └ <function Thread._bootstrap_inner at 0x7890475aad40>
└ <Thread(ThreadPoolExecutor-28_0, started 132551873763008)>
File "/usr/lib/python3.12/threading.py", line 1073, in _bootstrap_inner
self.run()
│ └ <function Thread.run at 0x7890475aaa20>
└ <Thread(ThreadPoolExecutor-28_0, started 132551873763008)>
File "/usr/lib/python3.12/threading.py", line 1010, in run
self._target(*self._args, **self._kwargs)
│ │ │ │ │ └ {}
│ │ │ │ └ <Thread(ThreadPoolExecutor-28_0, started 132551873763008)>
│ │ │ └ (<weakref at 0x788e4b6bec50; to 'ThreadPoolExecutor' at 0x788e4b78ff20>, <_queue.SimpleQueue object at 0x788e3cf5fdd0>, None,...
│ │ └ <Thread(ThreadPoolExecutor-28_0, started 132551873763008)>
│ └ <function _worker at 0x788f6cf92de0>
└ <Thread(ThreadPoolExecutor-28_0, started 132551873763008)>
File "/usr/lib/python3.12/concurrent/futures/thread.py", line 92, in _worker
work_item.run()
│ └ <function _WorkItem.run at 0x788f6cf92f20>
└ <concurrent.futures.thread._WorkItem object at 0x788e481103b0>
File "/usr/lib/python3.12/concurrent/futures/thread.py", line 58, in run
result = self.fn(*self.args, **self.kwargs)
│ │ │ │ │ └ {}
│ │ │ │ └ <concurrent.futures.thread._WorkItem object at 0x788e481103b0>
│ │ │ └ ('file-8a95ee53-75a9-4676-9886-35c8fb849862', 'BSI-TR-03185 secure software lifecycle requirements')
│ │ └ <concurrent.futures.thread._WorkItem object at 0x788e481103b0>
│ └ <function query_collection_with_hybrid_search..process_query at 0x788e483785e0>
└ <concurrent.futures.thread._WorkItem object at 0x788e481103b0>

File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/open_webui/retrieval/utils.py", line 316, in process_query
result = query_doc_with_hybrid_search(
└ <function query_doc_with_hybrid_search at 0x788efefadee0>
File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/open_webui/retrieval/utils.py", line 175, in query_doc_with_hybrid_search
raise e
File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/open_webui/retrieval/utils.py", line 148, in query_doc_with_hybrid_search
result = compression_retriever.invoke(query)
│ │ └ 'BSI-TR-03185 secure software lifecycle requirements'
│ └ <function BaseRetriever.invoke at 0x788eff37a200>
└ ContextualCompressionRetriever(base_compressor=RerankCompressor(embedding_function=<function chat_completion_files_handler.<l...
File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/langchain_core/retrievers.py", line 259, in invoke
result = self._get_relevant_documents(
│ └ <function ContextualCompressionRetriever._get_relevant_documents at 0x788eff379b20>
└ ContextualCompressionRetriever(base_compressor=RerankCompressor(embedding_function=<function chat_completion_files_handler.<l...
File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/langchain/retrievers/contextual_compression.py", line 48, in _get_relevant_documents
compressed_docs = self.base_compressor.compress_documents(
│ │ └ <function RerankCompressor.compress_documents at 0x788efefaf1a0>
│ └ RerankCompressor(embedding_function=<function chat_completion_files_handler.... at 0x788e4837...
└ ContextualCompressionRetriever(base_compressor=RerankCompressor(embedding_function=<function chat_completion_files_handler.<l...
File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/open_webui/retrieval/utils.py", line 785, in compress_documents
scores = self.reranking_function.predict(
│ │ └ <function CrossEncoder.predict at 0x788e5e134860>
│ └ <sentence_transformers.cross_encoder.CrossEncoder.CrossEncoder object at 0x788e48205700>
└ RerankCompressor(embedding_function=<function chat_completion_files_handler.... at 0x788e4837...
File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/sentence_transformers/cross_encoder/CrossEncoder.py", line 444, in predict
model_predictions = self.model(**features, return_dict=True)
│ │ └ {'input_ids': tensor([[ 7347, 40, 12, ..., 151643, 151643, 151643],
│ │ [ 7347, 40, 12, ..., 151643, ...
│ └ Qwen2ForSequenceClassification(
│ (model): Qwen2Model(
│ (embed_tokens): Embedding(151936, 1536)
│ (layers): ModuleList(
│ ...
└ <sentence_transformers.cross_encoder.CrossEncoder.CrossEncoder object at 0x788e48205700>
File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1739, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
│ │ │ └ {'input_ids': tensor([[ 7347, 40, 12, ..., 151643, 151643, 151643],
│ │ │ [ 7347, 40, 12, ..., 151643, ...
│ │ └ ()
│ └ <function Module._call_impl at 0x788f80fdb920>
└ Qwen2ForSequenceClassification(
(model): Qwen2Model(
(embed_tokens): Embedding(151936, 1536)
(layers): ModuleList(
...
File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1750, in _call_impl
return forward_call(*args, **kwargs)
│ │ └ {'input_ids': tensor([[ 7347, 40, 12, ..., 151643, 151643, 151643],
│ │ [ 7347, 40, 12, ..., 151643, ...
│ └ ()
└ <bound method Qwen2ForSequenceClassification.forward of Qwen2ForSequenceClassification(
(model): Qwen2Model(
(embed_tok...
File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/transformers/models/qwen2/modeling_qwen2.py", line 965, in forward
raise ValueError("Cannot handle batch sizes > 1 if no padding token is defined.")

ValueError: Cannot handle batch sizes > 1 if no padding token is defined.
2025-04-27 14:37:53.361 | INFO | httpx._client:_send_single_request:1025 - HTTP Request: POST http://localhost:6333/collections/open-webui_file-8a95ee53-75a9-4676-9886-35c8fb849862/points/query "HTTP/1.1 200 OK" - {}
2025-04-27 14:37:53.363 | INFO | open_webui.retrieval.utils:query_doc:88 - query_doc:result '5e129bf9-e087-46bc-b7cf-25d56323af13', 'f63ad7cf-e43a-49bf-bb6c-3d167e2442bc', '07341a3d-f953-4e5d-8242-b01e37886d89', '16535749-fb51-4522-ae0a-f46c5f0e8ae6', 'a50f6ba4-a501-428c-908a-ae1e3af2434e', '1c8966b0-24cd-4792-a4a5-1eb5ed13ba14', '96e63748-8ef1-41ff-a767-9495a58b79fa', '00938917-9c45-4a55-9190-09dfc2a100f8', 'ebe55e7e-1440-46de-8705-093ad593f01d', '3a4eb803-9184-4288-a3fd-27bcf38d91f2', '499ec042-2da6-4d61-b36c-9aa3853c029d', '049e5d96-0f81-473b-b3fc-58babe107db2', 'b693a881-6f71-4803-a519-c0812ef43232', '203580ff-4493-490b-8b5f-d0422461e42b', 'e9a0eb96-b380-490e-9024-9f205a23c458', 'cd19ed36-3a95-40eb-a04f-cc371ad8fea8', 'a4355ec7-b1b2-49ff-b735-cea3c76d7499', '6d129687-e919-4a67-94ba-a516544eccfc', '6a3a5501-517c-4811-b9ca-31b02542d637', '8953a660-4db6-401a-b0f9-f966cb214ccf', '5ba22d63-15fd-42af-a153-836ce30b3d79', '1ff55a63-ab7f-406b-acdf-b91167b8b9ef', 'fc2c4282-70aa-4073-bb2c-d3e4b63f8206', 'd76a5833-8ccb-45e4-9902-0d9adae5a585', '3f403023-4ee5-4499-a27d-b849098e50c7' {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 0, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 26636, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 40401, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 29718, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 112467, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 209048, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 27660, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 225084, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 132860, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 125401, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 127690, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 153547, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 169291, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 106311, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 41416, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 176979, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 33338, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 134076, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 38373, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 130955, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 174585, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 34536, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 37359, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 193600, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 54346, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'} - {}
2025-04-27 14:37:53.411 | INFO | httpx._client:_send_single_request:1025 - HTTP Request: POST http://localhost:6333/collections/open-webui_file-8a95ee53-75a9-4676-9886-35c8fb849862/points/query "HTTP/1.1 200 OK" - {}
2025-04-27 14:37:53.412 | INFO | open_webui.retrieval.utils:query_doc:88 - query_doc:result 'f63ad7cf-e43a-49bf-bb6c-3d167e2442bc', '40b1523c-4fc1-47f2-bbc4-10100ddd2e91', '96e63748-8ef1-41ff-a767-9495a58b79fa', '203580ff-4493-490b-8b5f-d0422461e42b', 'ceb91c6d-990e-4a5e-b630-22b673ecd2d3', '16535749-fb51-4522-ae0a-f46c5f0e8ae6', '8953a660-4db6-401a-b0f9-f966cb214ccf', '46147603-725c-405e-8081-9cfb0372e8b2', '7444b1d9-6571-4e7c-8e4a-337f7e83b768', 'b375f0c5-1434-4411-a265-633ded05bfa7', '7728edc6-e371-4046-8825-b3bf754e9872', 'ebe55e7e-1440-46de-8705-093ad593f01d', '499ec042-2da6-4d61-b36c-9aa3853c029d', 'bc94ece1-2cda-4fea-9c70-b221c04d763d', 'a50f6ba4-a501-428c-908a-ae1e3af2434e', '6d129687-e919-4a67-94ba-a516544eccfc', '1ca2f834-b804-48d2-beda-2beec62badbf', 'de6377a2-a29f-445f-a820-f539bc132f26', 'b693a881-6f71-4803-a519-c0812ef43232', 'a24910b2-8ae6-48c5-aa48-926742672ec5', '46219fbe-ecc2-4372-841e-6595c36623b0', '71475eb9-36b2-4f96-8407-a5cab723296b', '00938917-9c45-4a55-9190-09dfc2a100f8', '2f04be2a-c60d-4825-8782-c0cfb71cb3fa', '25ded639-0385-4076-9ac0-209709dc6bc6' {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 26636, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 107253, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 27660, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 106311, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 130003, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 29718, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 130955, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 114748, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 118992, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 110187, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 53117, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 132860, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 127690, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 138796, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 112467, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 134076, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 51889, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 109427, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 169291, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 161709, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 104013, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 205603, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 225084, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 131907, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 30675, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'} - {}

Additional Information

re-ranking model: mixedbread-ai/mxbai-rerank-large-v2
TOP-K: 25
TOP-K Reranker: 5
Relevance threshold: 0.4

Embedding Engine: ollama
Embedding Model: nomic-embed-text-v1.5

Embedding Database: qdrant 1.13.5

Originally created by @DC1LEX on GitHub (Apr 27, 2025). ### Check Existing Issues - [x] I have searched the existing issues and discussions. - [x] I am using the latest version of Open WebUI. ### Installation Method Other ### Open WebUI Version 0.6.5 ### Ollama Version (if applicable) 0.6.6 ### Operating System Ubuntu 24.04 ### Browser (if applicable) Chrome 134.0.6998.88 ### Confirmation - [x] I have read and followed all instructions in `README.md`. - [x] I am using the latest version of **both** Open WebUI and Ollama. - [x] I have included the browser console logs. - [x] I have included the Docker container logs. - [x] I have listed steps to reproduce the bug in detail. ### Expected Behavior Get re-ranked search results ### Actual Behavior With enabled hybrid search I get error messages from open-webui as below. However, a result is generated but I guess this is w/o reranking. 2025-04-27 14:37:45.944 | ERROR | open_webui.retrieval.utils:query_doc_with_hybrid_search:174 - Error querying doc file-8a95ee53-75a9-4676-9886-35c8fb849862 with hybrid search: Cannot handle batch sizes > 1 if no padding token is defined. - {} ### Steps to Reproduce 1. Create a knowledge base 2. Create a custom model with the knowledge base 3. switch on Hybrid Search, parameters below 4. Ask a question with the custom model and observe open-webui logs ### Logs & Screenshots 2025-04-27 14:36:36.402 | INFO | uvicorn.protocols.http.httptools_impl:send:476 - 192.168.100.53:54300 - "GET /api/v1/chats/ecde0c2f-249a-4f75-b900-7f3a035e92b7/tags HTTP/1.1" 200 - {} 2025-04-27 14:36:36.418 | INFO | uvicorn.protocols.http.httptools_impl:send:476 - 192.168.100.53:54300 - "GET /api/v1/users/user/settings HTTP/1.1" 200 - {} Task IDs for chat ecde0c2f-249a-4f75-b900-7f3a035e92b7: [] 2025-04-27 14:36:36.455 | INFO | uvicorn.protocols.http.httptools_impl:send:476 - 192.168.100.53:54300 - "GET /api/tasks/chat/ecde0c2f-249a-4f75-b900-7f3a035e92b7 HTTP/1.1" 200 - {} 2025-04-27 14:36:36.572 | INFO | uvicorn.protocols.http.httptools_impl:send:476 - 192.168.100.53:54300 - "GET /ollama/api/version HTTP/1.1" 200 - {} 2025-04-27 14:36:55.034 | INFO | uvicorn.protocols.http.httptools_impl:send:476 - 192.168.100.53:57748 - "POST /api/v1/chats/ecde0c2f-249a-4f75-b900-7f3a035e92b7 HTTP/1.1" 200 - {} 2025-04-27 14:36:55.226 | INFO | uvicorn.protocols.http.httptools_impl:send:476 - 192.168.100.53:57748 - "GET /api/v1/chats/?page=1 HTTP/1.1" 200 - {} 2025-04-27 14:37:10.866 | INFO | httpx._client:_send_single_request:1025 - HTTP Request: POST http://localhost:6333/collections/open-webui_file-8a95ee53-75a9-4676-9886-35c8fb849862/points/query "HTTP/1.1 200 OK" - {} 2025-04-27 14:37:10.880 | INFO | open_webui.retrieval.utils:query_collection_with_hybrid_search:310 - Starting hybrid search for 2 queries in 1 collections... - {} 2025-04-27 14:37:12.838 | INFO | httpx._client:_send_single_request:1025 - HTTP Request: POST http://localhost:6333/collections/open-webui_file-8a95ee53-75a9-4676-9886-35c8fb849862/points/query "HTTP/1.1 200 OK" - {} Batches: 0%| | 0/2 [00:00<?, ?it/s]2025-04-27 14:37:12.863 | INFO | httpx._client:_send_single_request:1025 - HTTP Request: POST http://localhost:6333/collections/open-webui_file-8a95ee53-75a9-4676-9886-35c8fb849862/points/query "HTTP/1.1 200 OK" - {} Batches: 0%| | 0/2 [00:33<?, ?it/s] 2025-04-27 14:37:45.944 | ERROR | open_webui.retrieval.utils:query_doc_with_hybrid_search:174 - Error querying doc file-8a95ee53-75a9-4676-9886-35c8fb849862 with hybrid search: Cannot handle batch sizes > 1 if no padding token is defined. - {} Traceback (most recent call last): File "/usr/lib/python3.12/threading.py", line 1030, in _bootstrap self._bootstrap_inner() │ └ <function Thread._bootstrap_inner at 0x7890475aad40> └ <Thread(ThreadPoolExecutor-28_1, started 132552130000576)> File "/usr/lib/python3.12/threading.py", line 1073, in _bootstrap_inner self.run() │ └ <function Thread.run at 0x7890475aaa20> └ <Thread(ThreadPoolExecutor-28_1, started 132552130000576)> File "/usr/lib/python3.12/threading.py", line 1010, in run self._target(*self._args, **self._kwargs) │ │ │ │ │ └ {} │ │ │ │ └ <Thread(ThreadPoolExecutor-28_1, started 132552130000576)> │ │ │ └ (<weakref at 0x788e4b6be1b0; to 'ThreadPoolExecutor' at 0x788e4b78ff20>, <_queue.SimpleQueue object at 0x788e3cf5fdd0>, None,... │ │ └ <Thread(ThreadPoolExecutor-28_1, started 132552130000576)> │ └ <function _worker at 0x788f6cf92de0> └ <Thread(ThreadPoolExecutor-28_1, started 132552130000576)> File "/usr/lib/python3.12/concurrent/futures/thread.py", line 92, in _worker work_item.run() │ └ <function _WorkItem.run at 0x788f6cf92f20> └ <concurrent.futures.thread._WorkItem object at 0x788e3cf11e50> File "/usr/lib/python3.12/concurrent/futures/thread.py", line 58, in run result = self.fn(*self.args, **self.kwargs) │ │ │ │ │ └ {} │ │ │ │ └ <concurrent.futures.thread._WorkItem object at 0x788e3cf11e50> │ │ │ └ ('file-8a95ee53-75a9-4676-9886-35c8fb849862', 'Cybersecurity standards in software development processes') │ │ └ <concurrent.futures.thread._WorkItem object at 0x788e3cf11e50> │ └ <function query_collection_with_hybrid_search.<locals>.process_query at 0x788e483785e0> └ <concurrent.futures.thread._WorkItem object at 0x788e3cf11e50> File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/open_webui/retrieval/utils.py", line 316, in process_query result = query_doc_with_hybrid_search( └ <function query_doc_with_hybrid_search at 0x788efefadee0> > File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/open_webui/retrieval/utils.py", line 148, in query_doc_with_hybrid_search result = compression_retriever.invoke(query) │ │ └ 'Cybersecurity standards in software development processes' │ └ <function BaseRetriever.invoke at 0x788eff37a200> └ ContextualCompressionRetriever(base_compressor=RerankCompressor(embedding_function=<function chat_completion_files_handler.<l... File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/langchain_core/retrievers.py", line 259, in invoke result = self._get_relevant_documents( │ └ <function ContextualCompressionRetriever._get_relevant_documents at 0x788eff379b20> └ ContextualCompressionRetriever(base_compressor=RerankCompressor(embedding_function=<function chat_completion_files_handler.<l... File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/langchain/retrievers/contextual_compression.py", line 48, in _get_relevant_documents compressed_docs = self.base_compressor.compress_documents( │ │ └ <function RerankCompressor.compress_documents at 0x788efefaf1a0> │ └ RerankCompressor(embedding_function=<function chat_completion_files_handler.<locals>.<lambda>.<locals>.<lambda> at 0x788e4837... └ ContextualCompressionRetriever(base_compressor=RerankCompressor(embedding_function=<function chat_completion_files_handler.<l... File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/open_webui/retrieval/utils.py", line 785, in compress_documents scores = self.reranking_function.predict( │ │ └ <function CrossEncoder.predict at 0x788e5e134860> │ └ <sentence_transformers.cross_encoder.CrossEncoder.CrossEncoder object at 0x788e48205700> └ RerankCompressor(embedding_function=<function chat_completion_files_handler.<locals>.<lambda>.<locals>.<lambda> at 0x788e4837... File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/sentence_transformers/cross_encoder/CrossEncoder.py", line 444, in predict model_predictions = self.model(**features, return_dict=True) │ │ └ {'input_ids': tensor([[ 56715, 652, 17039, ..., 151643, 151643, 151643], │ │ [ 56715, 652, 17039, ..., 151643, ... │ └ Qwen2ForSequenceClassification( │ (model): Qwen2Model( │ (embed_tokens): Embedding(151936, 1536) │ (layers): ModuleList( │ ... └ <sentence_transformers.cross_encoder.CrossEncoder.CrossEncoder object at 0x788e48205700> File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1739, in _wrapped_call_impl return self._call_impl(*args, **kwargs) │ │ │ └ {'input_ids': tensor([[ 56715, 652, 17039, ..., 151643, 151643, 151643], │ │ │ [ 56715, 652, 17039, ..., 151643, ... │ │ └ () │ └ <function Module._call_impl at 0x788f80fdb920> └ Qwen2ForSequenceClassification( (model): Qwen2Model( (embed_tokens): Embedding(151936, 1536) (layers): ModuleList( ... File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1750, in _call_impl return forward_call(*args, **kwargs) │ │ └ {'input_ids': tensor([[ 56715, 652, 17039, ..., 151643, 151643, 151643], │ │ [ 56715, 652, 17039, ..., 151643, ... │ └ () └ <bound method Qwen2ForSequenceClassification.forward of Qwen2ForSequenceClassification( (model): Qwen2Model( (embed_tok... File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/transformers/models/qwen2/modeling_qwen2.py", line 965, in forward raise ValueError("Cannot handle batch sizes > 1 if no padding token is defined.") ValueError: Cannot handle batch sizes > 1 if no padding token is defined. 2025-04-27 14:37:45.953 | ERROR | open_webui.retrieval.utils:process_query:328 - Error when querying the collection with hybrid_search: Cannot handle batch sizes > 1 if no padding token is defined. - {} Traceback (most recent call last): File "/usr/lib/python3.12/threading.py", line 1030, in _bootstrap self._bootstrap_inner() │ └ <function Thread._bootstrap_inner at 0x7890475aad40> └ <Thread(ThreadPoolExecutor-28_1, started 132552130000576)> File "/usr/lib/python3.12/threading.py", line 1073, in _bootstrap_inner self.run() │ └ <function Thread.run at 0x7890475aaa20> └ <Thread(ThreadPoolExecutor-28_1, started 132552130000576)> File "/usr/lib/python3.12/threading.py", line 1010, in run self._target(*self._args, **self._kwargs) │ │ │ │ │ └ {} │ │ │ │ └ <Thread(ThreadPoolExecutor-28_1, started 132552130000576)> │ │ │ └ (<weakref at 0x788e4b6be1b0; to 'ThreadPoolExecutor' at 0x788e4b78ff20>, <_queue.SimpleQueue object at 0x788e3cf5fdd0>, None,... │ │ └ <Thread(ThreadPoolExecutor-28_1, started 132552130000576)> │ └ <function _worker at 0x788f6cf92de0> └ <Thread(ThreadPoolExecutor-28_1, started 132552130000576)> File "/usr/lib/python3.12/concurrent/futures/thread.py", line 92, in _worker work_item.run() │ └ <function _WorkItem.run at 0x788f6cf92f20> └ <concurrent.futures.thread._WorkItem object at 0x788e3cf11e50> File "/usr/lib/python3.12/concurrent/futures/thread.py", line 58, in run result = self.fn(*self.args, **self.kwargs) │ │ │ │ │ └ {} │ │ │ │ └ <concurrent.futures.thread._WorkItem object at 0x788e3cf11e50> │ │ │ └ ('file-8a95ee53-75a9-4676-9886-35c8fb849862', 'Cybersecurity standards in software development processes') │ │ └ <concurrent.futures.thread._WorkItem object at 0x788e3cf11e50> │ └ <function query_collection_with_hybrid_search.<locals>.process_query at 0x788e483785e0> └ <concurrent.futures.thread._WorkItem object at 0x788e3cf11e50> > File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/open_webui/retrieval/utils.py", line 316, in process_query result = query_doc_with_hybrid_search( └ <function query_doc_with_hybrid_search at 0x788efefadee0> File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/open_webui/retrieval/utils.py", line 175, in query_doc_with_hybrid_search raise e File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/open_webui/retrieval/utils.py", line 148, in query_doc_with_hybrid_search result = compression_retriever.invoke(query) │ │ └ 'Cybersecurity standards in software development processes' │ └ <function BaseRetriever.invoke at 0x788eff37a200> └ ContextualCompressionRetriever(base_compressor=RerankCompressor(embedding_function=<function chat_completion_files_handler.<l... File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/langchain_core/retrievers.py", line 259, in invoke result = self._get_relevant_documents( │ └ <function ContextualCompressionRetriever._get_relevant_documents at 0x788eff379b20> └ ContextualCompressionRetriever(base_compressor=RerankCompressor(embedding_function=<function chat_completion_files_handler.<l... File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/langchain/retrievers/contextual_compression.py", line 48, in _get_relevant_documents compressed_docs = self.base_compressor.compress_documents( │ │ └ <function RerankCompressor.compress_documents at 0x788efefaf1a0> │ └ RerankCompressor(embedding_function=<function chat_completion_files_handler.<locals>.<lambda>.<locals>.<lambda> at 0x788e4837... └ ContextualCompressionRetriever(base_compressor=RerankCompressor(embedding_function=<function chat_completion_files_handler.<l... File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/open_webui/retrieval/utils.py", line 785, in compress_documents scores = self.reranking_function.predict( │ │ └ <function CrossEncoder.predict at 0x788e5e134860> │ └ <sentence_transformers.cross_encoder.CrossEncoder.CrossEncoder object at 0x788e48205700> └ RerankCompressor(embedding_function=<function chat_completion_files_handler.<locals>.<lambda>.<locals>.<lambda> at 0x788e4837... File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/sentence_transformers/cross_encoder/CrossEncoder.py", line 444, in predict model_predictions = self.model(**features, return_dict=True) │ │ └ {'input_ids': tensor([[ 56715, 652, 17039, ..., 151643, 151643, 151643], │ │ [ 56715, 652, 17039, ..., 151643, ... │ └ Qwen2ForSequenceClassification( │ (model): Qwen2Model( │ (embed_tokens): Embedding(151936, 1536) │ (layers): ModuleList( │ ... └ <sentence_transformers.cross_encoder.CrossEncoder.CrossEncoder object at 0x788e48205700> File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1739, in _wrapped_call_impl return self._call_impl(*args, **kwargs) │ │ │ └ {'input_ids': tensor([[ 56715, 652, 17039, ..., 151643, 151643, 151643], │ │ │ [ 56715, 652, 17039, ..., 151643, ... │ │ └ () │ └ <function Module._call_impl at 0x788f80fdb920> └ Qwen2ForSequenceClassification( (model): Qwen2Model( (embed_tokens): Embedding(151936, 1536) (layers): ModuleList( ... File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1750, in _call_impl return forward_call(*args, **kwargs) │ │ └ {'input_ids': tensor([[ 56715, 652, 17039, ..., 151643, 151643, 151643], │ │ [ 56715, 652, 17039, ..., 151643, ... │ └ () └ <bound method Qwen2ForSequenceClassification.forward of Qwen2ForSequenceClassification( (model): Qwen2Model( (embed_tok... File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/transformers/models/qwen2/modeling_qwen2.py", line 965, in forward raise ValueError("Cannot handle batch sizes > 1 if no padding token is defined.") ValueError: Cannot handle batch sizes > 1 if no padding token is defined. Batches: 0%| | 0/2 [00:40<?, ?it/s] 2025-04-27 14:37:53.295 | ERROR | open_webui.retrieval.utils:query_doc_with_hybrid_search:174 - Error querying doc file-8a95ee53-75a9-4676-9886-35c8fb849862 with hybrid search: Cannot handle batch sizes > 1 if no padding token is defined. - {} Traceback (most recent call last): File "/usr/lib/python3.12/threading.py", line 1030, in _bootstrap self._bootstrap_inner() │ └ <function Thread._bootstrap_inner at 0x7890475aad40> └ <Thread(ThreadPoolExecutor-28_0, started 132551873763008)> File "/usr/lib/python3.12/threading.py", line 1073, in _bootstrap_inner self.run() │ └ <function Thread.run at 0x7890475aaa20> └ <Thread(ThreadPoolExecutor-28_0, started 132551873763008)> File "/usr/lib/python3.12/threading.py", line 1010, in run self._target(*self._args, **self._kwargs) │ │ │ │ │ └ {} │ │ │ │ └ <Thread(ThreadPoolExecutor-28_0, started 132551873763008)> │ │ │ └ (<weakref at 0x788e4b6bec50; to 'ThreadPoolExecutor' at 0x788e4b78ff20>, <_queue.SimpleQueue object at 0x788e3cf5fdd0>, None,... │ │ └ <Thread(ThreadPoolExecutor-28_0, started 132551873763008)> │ └ <function _worker at 0x788f6cf92de0> └ <Thread(ThreadPoolExecutor-28_0, started 132551873763008)> File "/usr/lib/python3.12/concurrent/futures/thread.py", line 92, in _worker work_item.run() │ └ <function _WorkItem.run at 0x788f6cf92f20> └ <concurrent.futures.thread._WorkItem object at 0x788e481103b0> File "/usr/lib/python3.12/concurrent/futures/thread.py", line 58, in run result = self.fn(*self.args, **self.kwargs) │ │ │ │ │ └ {} │ │ │ │ └ <concurrent.futures.thread._WorkItem object at 0x788e481103b0> │ │ │ └ ('file-8a95ee53-75a9-4676-9886-35c8fb849862', 'BSI-TR-03185 secure software lifecycle requirements') │ │ └ <concurrent.futures.thread._WorkItem object at 0x788e481103b0> │ └ <function query_collection_with_hybrid_search.<locals>.process_query at 0x788e483785e0> └ <concurrent.futures.thread._WorkItem object at 0x788e481103b0> File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/open_webui/retrieval/utils.py", line 316, in process_query result = query_doc_with_hybrid_search( └ <function query_doc_with_hybrid_search at 0x788efefadee0> > File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/open_webui/retrieval/utils.py", line 148, in query_doc_with_hybrid_search result = compression_retriever.invoke(query) │ │ └ 'BSI-TR-03185 secure software lifecycle requirements' │ └ <function BaseRetriever.invoke at 0x788eff37a200> └ ContextualCompressionRetriever(base_compressor=RerankCompressor(embedding_function=<function chat_completion_files_handler.<l... File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/langchain_core/retrievers.py", line 259, in invoke result = self._get_relevant_documents( │ └ <function ContextualCompressionRetriever._get_relevant_documents at 0x788eff379b20> └ ContextualCompressionRetriever(base_compressor=RerankCompressor(embedding_function=<function chat_completion_files_handler.<l... File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/langchain/retrievers/contextual_compression.py", line 48, in _get_relevant_documents compressed_docs = self.base_compressor.compress_documents( │ │ └ <function RerankCompressor.compress_documents at 0x788efefaf1a0> │ └ RerankCompressor(embedding_function=<function chat_completion_files_handler.<locals>.<lambda>.<locals>.<lambda> at 0x788e4837... └ ContextualCompressionRetriever(base_compressor=RerankCompressor(embedding_function=<function chat_completion_files_handler.<l... File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/open_webui/retrieval/utils.py", line 785, in compress_documents scores = self.reranking_function.predict( │ │ └ <function CrossEncoder.predict at 0x788e5e134860> │ └ <sentence_transformers.cross_encoder.CrossEncoder.CrossEncoder object at 0x788e48205700> └ RerankCompressor(embedding_function=<function chat_completion_files_handler.<locals>.<lambda>.<locals>.<lambda> at 0x788e4837... File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/sentence_transformers/cross_encoder/CrossEncoder.py", line 444, in predict model_predictions = self.model(**features, return_dict=True) │ │ └ {'input_ids': tensor([[ 7347, 40, 12, ..., 151643, 151643, 151643], │ │ [ 7347, 40, 12, ..., 151643, ... │ └ Qwen2ForSequenceClassification( │ (model): Qwen2Model( │ (embed_tokens): Embedding(151936, 1536) │ (layers): ModuleList( │ ... └ <sentence_transformers.cross_encoder.CrossEncoder.CrossEncoder object at 0x788e48205700> File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1739, in _wrapped_call_impl return self._call_impl(*args, **kwargs) │ │ │ └ {'input_ids': tensor([[ 7347, 40, 12, ..., 151643, 151643, 151643], │ │ │ [ 7347, 40, 12, ..., 151643, ... │ │ └ () │ └ <function Module._call_impl at 0x788f80fdb920> └ Qwen2ForSequenceClassification( (model): Qwen2Model( (embed_tokens): Embedding(151936, 1536) (layers): ModuleList( ... File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1750, in _call_impl return forward_call(*args, **kwargs) │ │ └ {'input_ids': tensor([[ 7347, 40, 12, ..., 151643, 151643, 151643], │ │ [ 7347, 40, 12, ..., 151643, ... │ └ () └ <bound method Qwen2ForSequenceClassification.forward of Qwen2ForSequenceClassification( (model): Qwen2Model( (embed_tok... File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/transformers/models/qwen2/modeling_qwen2.py", line 965, in forward raise ValueError("Cannot handle batch sizes > 1 if no padding token is defined.") ValueError: Cannot handle batch sizes > 1 if no padding token is defined. 2025-04-27 14:37:53.303 | ERROR | open_webui.retrieval.utils:process_query:328 - Error when querying the collection with hybrid_search: Cannot handle batch sizes > 1 if no padding token is defined. - {} Traceback (most recent call last): File "/usr/lib/python3.12/threading.py", line 1030, in _bootstrap self._bootstrap_inner() │ └ <function Thread._bootstrap_inner at 0x7890475aad40> └ <Thread(ThreadPoolExecutor-28_0, started 132551873763008)> File "/usr/lib/python3.12/threading.py", line 1073, in _bootstrap_inner self.run() │ └ <function Thread.run at 0x7890475aaa20> └ <Thread(ThreadPoolExecutor-28_0, started 132551873763008)> File "/usr/lib/python3.12/threading.py", line 1010, in run self._target(*self._args, **self._kwargs) │ │ │ │ │ └ {} │ │ │ │ └ <Thread(ThreadPoolExecutor-28_0, started 132551873763008)> │ │ │ └ (<weakref at 0x788e4b6bec50; to 'ThreadPoolExecutor' at 0x788e4b78ff20>, <_queue.SimpleQueue object at 0x788e3cf5fdd0>, None,... │ │ └ <Thread(ThreadPoolExecutor-28_0, started 132551873763008)> │ └ <function _worker at 0x788f6cf92de0> └ <Thread(ThreadPoolExecutor-28_0, started 132551873763008)> File "/usr/lib/python3.12/concurrent/futures/thread.py", line 92, in _worker work_item.run() │ └ <function _WorkItem.run at 0x788f6cf92f20> └ <concurrent.futures.thread._WorkItem object at 0x788e481103b0> File "/usr/lib/python3.12/concurrent/futures/thread.py", line 58, in run result = self.fn(*self.args, **self.kwargs) │ │ │ │ │ └ {} │ │ │ │ └ <concurrent.futures.thread._WorkItem object at 0x788e481103b0> │ │ │ └ ('file-8a95ee53-75a9-4676-9886-35c8fb849862', 'BSI-TR-03185 secure software lifecycle requirements') │ │ └ <concurrent.futures.thread._WorkItem object at 0x788e481103b0> │ └ <function query_collection_with_hybrid_search.<locals>.process_query at 0x788e483785e0> └ <concurrent.futures.thread._WorkItem object at 0x788e481103b0> > File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/open_webui/retrieval/utils.py", line 316, in process_query result = query_doc_with_hybrid_search( └ <function query_doc_with_hybrid_search at 0x788efefadee0> File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/open_webui/retrieval/utils.py", line 175, in query_doc_with_hybrid_search raise e File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/open_webui/retrieval/utils.py", line 148, in query_doc_with_hybrid_search result = compression_retriever.invoke(query) │ │ └ 'BSI-TR-03185 secure software lifecycle requirements' │ └ <function BaseRetriever.invoke at 0x788eff37a200> └ ContextualCompressionRetriever(base_compressor=RerankCompressor(embedding_function=<function chat_completion_files_handler.<l... File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/langchain_core/retrievers.py", line 259, in invoke result = self._get_relevant_documents( │ └ <function ContextualCompressionRetriever._get_relevant_documents at 0x788eff379b20> └ ContextualCompressionRetriever(base_compressor=RerankCompressor(embedding_function=<function chat_completion_files_handler.<l... File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/langchain/retrievers/contextual_compression.py", line 48, in _get_relevant_documents compressed_docs = self.base_compressor.compress_documents( │ │ └ <function RerankCompressor.compress_documents at 0x788efefaf1a0> │ └ RerankCompressor(embedding_function=<function chat_completion_files_handler.<locals>.<lambda>.<locals>.<lambda> at 0x788e4837... └ ContextualCompressionRetriever(base_compressor=RerankCompressor(embedding_function=<function chat_completion_files_handler.<l... File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/open_webui/retrieval/utils.py", line 785, in compress_documents scores = self.reranking_function.predict( │ │ └ <function CrossEncoder.predict at 0x788e5e134860> │ └ <sentence_transformers.cross_encoder.CrossEncoder.CrossEncoder object at 0x788e48205700> └ RerankCompressor(embedding_function=<function chat_completion_files_handler.<locals>.<lambda>.<locals>.<lambda> at 0x788e4837... File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/sentence_transformers/cross_encoder/CrossEncoder.py", line 444, in predict model_predictions = self.model(**features, return_dict=True) │ │ └ {'input_ids': tensor([[ 7347, 40, 12, ..., 151643, 151643, 151643], │ │ [ 7347, 40, 12, ..., 151643, ... │ └ Qwen2ForSequenceClassification( │ (model): Qwen2Model( │ (embed_tokens): Embedding(151936, 1536) │ (layers): ModuleList( │ ... └ <sentence_transformers.cross_encoder.CrossEncoder.CrossEncoder object at 0x788e48205700> File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1739, in _wrapped_call_impl return self._call_impl(*args, **kwargs) │ │ │ └ {'input_ids': tensor([[ 7347, 40, 12, ..., 151643, 151643, 151643], │ │ │ [ 7347, 40, 12, ..., 151643, ... │ │ └ () │ └ <function Module._call_impl at 0x788f80fdb920> └ Qwen2ForSequenceClassification( (model): Qwen2Model( (embed_tokens): Embedding(151936, 1536) (layers): ModuleList( ... File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1750, in _call_impl return forward_call(*args, **kwargs) │ │ └ {'input_ids': tensor([[ 7347, 40, 12, ..., 151643, 151643, 151643], │ │ [ 7347, 40, 12, ..., 151643, ... │ └ () └ <bound method Qwen2ForSequenceClassification.forward of Qwen2ForSequenceClassification( (model): Qwen2Model( (embed_tok... File "/home/lex/.local/share/pipx/venvs/open-webui/lib/python3.12/site-packages/transformers/models/qwen2/modeling_qwen2.py", line 965, in forward raise ValueError("Cannot handle batch sizes > 1 if no padding token is defined.") ValueError: Cannot handle batch sizes > 1 if no padding token is defined. 2025-04-27 14:37:53.361 | INFO | httpx._client:_send_single_request:1025 - HTTP Request: POST http://localhost:6333/collections/open-webui_file-8a95ee53-75a9-4676-9886-35c8fb849862/points/query "HTTP/1.1 200 OK" - {} 2025-04-27 14:37:53.363 | INFO | open_webui.retrieval.utils:query_doc:88 - query_doc:result [['5e129bf9-e087-46bc-b7cf-25d56323af13', 'f63ad7cf-e43a-49bf-bb6c-3d167e2442bc', '07341a3d-f953-4e5d-8242-b01e37886d89', '16535749-fb51-4522-ae0a-f46c5f0e8ae6', 'a50f6ba4-a501-428c-908a-ae1e3af2434e', '1c8966b0-24cd-4792-a4a5-1eb5ed13ba14', '96e63748-8ef1-41ff-a767-9495a58b79fa', '00938917-9c45-4a55-9190-09dfc2a100f8', 'ebe55e7e-1440-46de-8705-093ad593f01d', '3a4eb803-9184-4288-a3fd-27bcf38d91f2', '499ec042-2da6-4d61-b36c-9aa3853c029d', '049e5d96-0f81-473b-b3fc-58babe107db2', 'b693a881-6f71-4803-a519-c0812ef43232', '203580ff-4493-490b-8b5f-d0422461e42b', 'e9a0eb96-b380-490e-9024-9f205a23c458', 'cd19ed36-3a95-40eb-a04f-cc371ad8fea8', 'a4355ec7-b1b2-49ff-b735-cea3c76d7499', '6d129687-e919-4a67-94ba-a516544eccfc', '6a3a5501-517c-4811-b9ca-31b02542d637', '8953a660-4db6-401a-b0f9-f966cb214ccf', '5ba22d63-15fd-42af-a153-836ce30b3d79', '1ff55a63-ab7f-406b-acdf-b91167b8b9ef', 'fc2c4282-70aa-4073-bb2c-d3e4b63f8206', 'd76a5833-8ccb-45e4-9902-0d9adae5a585', '3f403023-4ee5-4499-a27d-b849098e50c7']] [[{'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 0, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 26636, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 40401, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 29718, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 112467, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 209048, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 27660, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 225084, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 132860, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 125401, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 127690, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 153547, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 169291, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 106311, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 41416, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 176979, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 33338, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 134076, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 38373, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 130955, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 174585, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 34536, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 37359, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 193600, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 54346, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}]] - {} 2025-04-27 14:37:53.411 | INFO | httpx._client:_send_single_request:1025 - HTTP Request: POST http://localhost:6333/collections/open-webui_file-8a95ee53-75a9-4676-9886-35c8fb849862/points/query "HTTP/1.1 200 OK" - {} 2025-04-27 14:37:53.412 | INFO | open_webui.retrieval.utils:query_doc:88 - query_doc:result [['f63ad7cf-e43a-49bf-bb6c-3d167e2442bc', '40b1523c-4fc1-47f2-bbc4-10100ddd2e91', '96e63748-8ef1-41ff-a767-9495a58b79fa', '203580ff-4493-490b-8b5f-d0422461e42b', 'ceb91c6d-990e-4a5e-b630-22b673ecd2d3', '16535749-fb51-4522-ae0a-f46c5f0e8ae6', '8953a660-4db6-401a-b0f9-f966cb214ccf', '46147603-725c-405e-8081-9cfb0372e8b2', '7444b1d9-6571-4e7c-8e4a-337f7e83b768', 'b375f0c5-1434-4411-a265-633ded05bfa7', '7728edc6-e371-4046-8825-b3bf754e9872', 'ebe55e7e-1440-46de-8705-093ad593f01d', '499ec042-2da6-4d61-b36c-9aa3853c029d', 'bc94ece1-2cda-4fea-9c70-b221c04d763d', 'a50f6ba4-a501-428c-908a-ae1e3af2434e', '6d129687-e919-4a67-94ba-a516544eccfc', '1ca2f834-b804-48d2-beda-2beec62badbf', 'de6377a2-a29f-445f-a820-f539bc132f26', 'b693a881-6f71-4803-a519-c0812ef43232', 'a24910b2-8ae6-48c5-aa48-926742672ec5', '46219fbe-ecc2-4372-841e-6595c36623b0', '71475eb9-36b2-4f96-8407-a5cab723296b', '00938917-9c45-4a55-9190-09dfc2a100f8', '2f04be2a-c60d-4825-8782-c0cfb71cb3fa', '25ded639-0385-4076-9ac0-209709dc6bc6']] [[{'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 26636, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 107253, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 27660, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 106311, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 130003, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 29718, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 130955, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 114748, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 118992, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 110187, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 53117, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 132860, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 127690, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 138796, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 112467, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 134076, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 51889, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 109427, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 169291, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 161709, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 104013, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 205603, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 225084, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 131907, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}, {'Content-Type': 'application/pdf', 'name': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'created_by': 'fcb69968-41b2-41ca-ba30-1929ec9dc72c', 'file_id': '8a95ee53-75a9-4676-9886-35c8fb849862', 'source': 'BSI-TR-03185 Secure SW Lifecycle.pdf', 'start_index': 30675, 'hash': 'ba9e7b97eed89c2284f9a03f2ea591917bc7e9affbd972968a80144051869ef1', 'embedding_config': '{"engine": "ollama", "model": "nomic-embed-text-v1.5-multimodal"}'}]] - {} ### Additional Information re-ranking model: mixedbread-ai/mxbai-rerank-large-v2 TOP-K: 25 TOP-K Reranker: 5 Relevance threshold: 0.4 Embedding Engine: ollama Embedding Model: nomic-embed-text-v1.5 Embedding Database: qdrant 1.13.5

GiteaMirror added the bug label 2025-11-11 16:08:33 -06:00

GiteaMirror closed this issue

2025-11-11 16:08:34 -06:00

GiteaMirror referenced this issue

2025-11-11 17:55:34 -06:00

[PR #4974] [MERGED] feat: Add support for SearchApi as alternative to WebSearch #8399

GiteaMirror referenced this issue

2026-04-20 03:36:22 -05:00

[PR #4974] [MERGED] feat: Add support for SearchApi as alternative to WebSearch #21603

GiteaMirror referenced this issue

2026-04-25 10:48:00 -05:00

[PR #4974] [MERGED] feat: Add support for SearchApi as alternative to WebSearch #37233