mirror of
https://github.com/open-webui/open-webui.git
synced 2026-11-14 05:02:01 -06:00
[GH-ISSUE #18115] issue: ERROR_MESSAGES.DUPLICATE_CONTENT error for different files #138224
Reference in New Issue
Block a user
Originally created by @hasanbozok on GitHub (Oct 7, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/18115
Check Existing Issues
Installation Method
Docker
Open WebUI Version
v0.6.32
Ollama Version (if applicable)
No response
Operating System
Ubuntu 24.04.3
Browser (if applicable)
No response
Confirmation
README.md.Expected Behavior
store vectors to milvusdb
Actual Behavior
Latest version of open-webui (v0.6.32) is running on official docker image.
milvus is running with milvus provided docker-compose file. I can only upload 1 document. After 1 succesful upload, for every other document, owui logs error below.
Steps to Reproduce
1- create knowledge base
2- upload 2 pdf files or
3- upload 1 file than upload another file
Logs & Screenshots
Gives below error for different files while uploading them into newly created knowledge base.
Traceback (most recent call last):
File "/usr/local/lib/python3.11/threading.py", line 1002, in _bootstrap
self._bootstrap_inner()
│ └ <function Thread._bootstrap_inner at 0x7c3c0e0909a0>
└ <WorkerThread(AnyIO worker thread, started 136593462507200)>
File "/usr/local/lib/python3.11/threading.py", line 1045, in _bootstrap_inner
self.run()
│ └ <function WorkerThread.run at 0x7c3b67fcd6c0>
└ <WorkerThread(AnyIO worker thread, started 136593462507200)>
File "/usr/local/lib/python3.11/site-packages/anyio/_backends/_asyncio.py", line 976, in run
result = context.run(func, *args)
│ │ │ └ ()
│ │ └ functools.partial(<function add_file_to_knowledge_by_id at 0x7c3b748c3ba0>, user=UserModel(id='54c8dc24-1d55-417b-9f2b-11ac44...
│ └ <method 'run' of '_contextvars.Context' objects>
└ <_contextvars.Context object at 0x7c3b24e21000>
File "/app/backend/open_webui/routers/knowledge.py", line 398, in add_file_to_knowledge_by_id
process_file(
└ <function process_file at 0x7c3b749f6b60>
File "/app/backend/open_webui/routers/retrieval.py", line 1581, in process_file
result = save_docs_to_vector_db(
└ <function save_docs_to_vector_db at 0x7c3b749f5d00>
File "/app/backend/open_webui/routers/retrieval.py", line 1245, in save_docs_to_vector_db
raise ValueError(ERROR_MESSAGES.DUPLICATE_CONTENT)
│ └ <ERROR_MESSAGES.DUPLICATE_CONTENT: 'Duplicate content detected. Please provide unique content to proceed.'>
└ <enum 'ERROR_MESSAGES'>
ValueError: Duplicate content detected. Please provide unique content to proceed.
Additional Information
Document flow:
Select files to upload -> extract with Apache Tika -> Calculate embeddings with gemma-embedding-300m running on vllm -> store vectors to milvus -> owui error
@tjbck commented on GitHub (Oct 7, 2025):
Unable to reproduce.