issue: False duplicate when using milvus as vectordb #6724

New Issue

GiteaMirror · 2025-11-11T17:04:18-06:00

GiteaMirror commented

2025-11-11 17:04:18 -06:00

Originally created by @julien-oss on GitHub (Oct 21, 2025).

Check Existing Issues

I have searched for any existing and/or related issues.
I have searched for any existing and/or related discussions.
I am using the latest version of Open WebUI.

Installation Method

Docker

Open WebUI Version

v0.6.34

Ollama Version (if applicable)

No response

Operating System

Ubuntu24.04

Browser (if applicable)

No response

Confirmation

I have read and followed all instructions in README.md.
I am using the latest version of both Open WebUI and Ollama.
I have included the browser console logs.
I have included the Docker container logs.
I have provided every relevant configuration, setting, and environment variable used in my setup.
I have clearly listed every relevant configuration, custom setting, environment variable, and command-line option that influences my setup (such as Docker Compose overrides, .env values, browser settings, authentication configurations, etc).
I have documented step-by-step reproduction instructions that are precise, sequential, and leave nothing to interpretation. My steps:
Start with the initial platform/version/OS and dependencies used,
Specify exact install/launch/configure commands,
List URLs visited, user input (incl. example values/emails/passwords if needed),
Describe all options and toggles enabled or changed,
Include any files or environmental changes,
Identify the expected and actual result at each stage,
Ensure any reasonably skilled user can follow and hit the same issue.

Expected Behavior

I create a new knowledge base, upload a document, and then another completely different document. Both are added to the knowledge base and vector db.

Actual Behavior

I create a new knowledge base, upload a document, and then another completely different document. Only the first one is being added, every time I try to upload a second document, it get falsely flagged as duplicated content.

Steps to Reproduce

Install milvus docker container using the official installation script standalone_embed.sh
Install openwebui docker container with milvusdb environment variable VECTOR_DB=milvus MILVUS_URI=*** MILVUS_TOKEN=*** MILVUS_DB=default
Log in to openwebui and create a new knowledge base
Add a file
File get successfully added
Add a completely different file
File get falsely flagged as duplicate content and don't get added to the knowledge base

Logs & Screenshots

Openwebui logs :

2025-10-21 06:52:22.314 | INFO     | open_webui.routers.retrieval:save_docs_to_vector_db:1300 - save_docs_to_vector_db: document Example1.pdf file-1cef0489-e432-48b5-b378-929f26ba137c
2025-10-21 06:52:22.326 | WARNING  | open_webui.retrieval.vector.dbs.milvus:query:206 - Query attempted on non-existent collection: open_webui_file_1cef0489_e432_48b5_b378_929f26ba137c
2025-10-21 06:52:22.326 | INFO     | open_webui.routers.retrieval:save_docs_to_vector_db:1326 - Using token text splitter: cl100k_base
2025-10-21 06:52:22.496 | INFO     | open_webui.routers.retrieval:save_docs_to_vector_db:1416 - generating embeddings for file-1cef0489-e432-48b5-b378-929f26ba137c
2025-10-21 06:52:22.522 | INFO     | open_webui.routers.retrieval:save_docs_to_vector_db:1452 - embeddings generated 1 for 1 items
2025-10-21 06:52:22.523 | INFO     | open_webui.routers.retrieval:save_docs_to_vector_db:1464 - adding to collection file-1cef0489-e432-48b5-b378-929f26ba137c
2025-10-21 06:52:22.525 | INFO     | open_webui.retrieval.vector.dbs.milvus:insert:268 - Collection open_webui_file_1cef0489_e432_48b5_b378_929f26ba137c does not exist. Creating now.
2025-10-21 06:52:22.526 | INFO     | open_webui.retrieval.vector.dbs.milvus:_create_collection:124 - Using Milvus index type: HNSW, metric type: COSINE
2025-10-21 06:52:22.526 | INFO     | open_webui.retrieval.vector.dbs.milvus:_create_collection:132 - HNSW params: {'M': 16, 'efConstruction': 100}
2025-10-21 06:52:23.676 | INFO     | open_webui.retrieval.vector.dbs.milvus:_create_collection:165 - Successfully created collection 'open_webui_file_1cef0489_e432_48b5_b378_929f26ba137c' with index type 'HNSW' and metric 'COSINE'.
2025-10-21 06:52:23.676 | INFO     | open_webui.retrieval.vector.dbs.milvus:insert:282 - Inserting 1 items into collection open_webui_file_1cef0489_e432_48b5_b378_929f26ba137c.
2025-10-21 06:52:23.692 | INFO     | open_webui.routers.retrieval:save_docs_to_vector_db:1470 - added 1 items to collection file-1cef0489-e432-48b5-b378-929f26ba137c
2025-10-21 06:52:23.692 | INFO     | open_webui.routers.retrieval:process_file:1668 - added 1 items to collection file-1cef0489-e432-48b5-b378-929f26ba137c
2025-10-21 06:52:23.909 | INFO     | open_webui.retrieval.vector.dbs.milvus:query:222 - Querying collection open_webui_file_1cef0489_e432_48b5_b378_929f26ba137c with filter: 'metadata["file_id"] == "1cef0489-e432-48b5-b378-929f26ba137c"', limit: -1
2025-10-21 06:52:24.007 | INFO     | open_webui.retrieval.vector.dbs.milvus:query:243 - Total results from query: 1
2025-10-21 06:52:24.011 | INFO     | open_webui.routers.retrieval:save_docs_to_vector_db:1300 - save_docs_to_vector_db: document Example1.pdf 45ca70fe-c9be-4d16-869e-5a88167dcf3d
2025-10-21 06:52:24.019 | WARNING  | open_webui.retrieval.vector.dbs.milvus:query:206 - Query attempted on non-existent collection: open_webui_45ca70fe_c9be_4d16_869e_5a88167dcf3d
2025-10-21 06:52:24.020 | INFO     | open_webui.routers.retrieval:save_docs_to_vector_db:1326 - Using token text splitter: cl100k_base
2025-10-21 06:52:24.022 | INFO     | open_webui.routers.retrieval:save_docs_to_vector_db:1416 - generating embeddings for 45ca70fe-c9be-4d16-869e-5a88167dcf3d
2025-10-21 06:52:24.042 | INFO     | open_webui.routers.retrieval:save_docs_to_vector_db:1452 - embeddings generated 1 for 1 items
2025-10-21 06:52:24.042 | INFO     | open_webui.routers.retrieval:save_docs_to_vector_db:1464 - adding to collection 45ca70fe-c9be-4d16-869e-5a88167dcf3d
2025-10-21 06:52:24.045 | INFO     | open_webui.retrieval.vector.dbs.milvus:insert:268 - Collection open_webui_45ca70fe_c9be_4d16_869e_5a88167dcf3d does not exist. Creating now.
2025-10-21 06:52:24.045 | INFO     | open_webui.retrieval.vector.dbs.milvus:_create_collection:124 - Using Milvus index type: HNSW, metric type: COSINE
2025-10-21 06:52:24.045 | INFO     | open_webui.retrieval.vector.dbs.milvus:_create_collection:132 - HNSW params: {'M': 16, 'efConstruction': 100}
2025-10-21 06:52:25.383 | INFO     | open_webui.retrieval.vector.dbs.milvus:_create_collection:165 - Successfully created collection 'open_webui_45ca70fe_c9be_4d16_869e_5a88167dcf3d' with index type 'HNSW' and metric 'COSINE'.
2025-10-21 06:52:25.384 | INFO     | open_webui.retrieval.vector.dbs.milvus:insert:282 - Inserting 1 items into collection open_webui_45ca70fe_c9be_4d16_869e_5a88167dcf3d.
2025-10-21 06:52:25.391 | INFO     | open_webui.routers.retrieval:save_docs_to_vector_db:1470 - added 1 items to collection 45ca70fe-c9be-4d16-869e-5a88167dcf3d
2025-10-21 06:52:25.392 | INFO     | open_webui.routers.retrieval:process_file:1668 - added 1 items to collection 45ca70fe-c9be-4d16-869e-5a88167dcf3d
2025-10-21 06:52:25.403 | INFO     | uvicorn.protocols.http.httptools_impl:send:476 - 192.168.220.94:0 - "POST /api/v1/knowledge/45ca70fe-c9be-4d16-869e-5a88167dcf3d/file/add HTTP/1.1" 200
2025-10-21 06:52:32.762 | INFO     | open_webui.routers.files:upload_file_handler:164 - file.content_type: application/pdf
2025-10-21 06:52:32.769 | INFO     | uvicorn.protocols.http.httptools_impl:send:476 - 192.168.220.94:0 - "POST /api/v1/files/ HTTP/1.1" 200
2025-10-21 06:52:32.802 | INFO     | uvicorn.protocols.http.httptools_impl:send:476 - 192.168.220.94:0 - "GET /api/v1/files/2300e9cc-ef9d-4c0e-85e7-f9e581df1d5a/process/status?stream=true HTTP/1.1" 200
2025-10-21 06:52:38.255 | INFO     | uvicorn.protocols.http.httptools_impl:send:476 - 192.168.220.94:0 - "GET /_app/version.json HTTP/1.1" 304
2025-10-21 06:52:47.814 | INFO     | open_webui.routers.retrieval:save_docs_to_vector_db:1300 - save_docs_to_vector_db: document Example2.pdf file-2300e9cc-ef9d-4c0e-85e7-f9e581df1d5a
2025-10-21 06:52:47.821 | WARNING  | open_webui.retrieval.vector.dbs.milvus:query:206 - Query attempted on non-existent collection: open_webui_file_2300e9cc_ef9d_4c0e_85e7_f9e581df1d5a
2025-10-21 06:52:47.821 | INFO     | open_webui.routers.retrieval:save_docs_to_vector_db:1326 - Using token text splitter: cl100k_base
2025-10-21 06:52:47.826 | INFO     | open_webui.routers.retrieval:save_docs_to_vector_db:1416 - generating embeddings for file-2300e9cc-ef9d-4c0e-85e7-f9e581df1d5a
2025-10-21 06:52:47.876 | INFO     | open_webui.routers.retrieval:save_docs_to_vector_db:1452 - embeddings generated 2 for 2 items
2025-10-21 06:52:47.877 | INFO     | open_webui.routers.retrieval:save_docs_to_vector_db:1464 - adding to collection file-2300e9cc-ef9d-4c0e-85e7-f9e581df1d5a
2025-10-21 06:52:47.879 | INFO     | open_webui.retrieval.vector.dbs.milvus:insert:268 - Collection open_webui_file_2300e9cc_ef9d_4c0e_85e7_f9e581df1d5a does not exist. Creating now.
2025-10-21 06:52:47.880 | INFO     | open_webui.retrieval.vector.dbs.milvus:_create_collection:124 - Using Milvus index type: HNSW, metric type: COSINE
2025-10-21 06:52:47.880 | INFO     | open_webui.retrieval.vector.dbs.milvus:_create_collection:132 - HNSW params: {'M': 16, 'efConstruction': 100}
2025-10-21 06:52:49.421 | INFO     | open_webui.retrieval.vector.dbs.milvus:_create_collection:165 - Successfully created collection 'open_webui_file_2300e9cc_ef9d_4c0e_85e7_f9e581df1d5a' with index type 'HNSW' and metric 'COSINE'.
2025-10-21 06:52:49.421 | INFO     | open_webui.retrieval.vector.dbs.milvus:insert:282 - Inserting 2 items into collection open_webui_file_2300e9cc_ef9d_4c0e_85e7_f9e581df1d5a.
2025-10-21 06:52:49.429 | INFO     | open_webui.routers.retrieval:save_docs_to_vector_db:1470 - added 2 items to collection file-2300e9cc-ef9d-4c0e-85e7-f9e581df1d5a
2025-10-21 06:52:49.429 | INFO     | open_webui.routers.retrieval:process_file:1668 - added 1 items to collection file-2300e9cc-ef9d-4c0e-85e7-f9e581df1d5a
2025-10-21 06:52:49.908 | INFO     | open_webui.retrieval.vector.dbs.milvus:query:222 - Querying collection open_webui_file_2300e9cc_ef9d_4c0e_85e7_f9e581df1d5a with filter: 'metadata["file_id"] == "2300e9cc-ef9d-4c0e-85e7-f9e581df1d5a"', limit: -1
2025-10-21 06:52:50.007 | INFO     | open_webui.retrieval.vector.dbs.milvus:query:243 - Total results from query: 2
2025-10-21 06:52:50.012 | INFO     | open_webui.routers.retrieval:save_docs_to_vector_db:1300 - save_docs_to_vector_db: document Example2.pdf 45ca70fe-c9be-4d16-869e-5a88167dcf3d
2025-10-21 06:52:50.026 | INFO     | open_webui.retrieval.vector.dbs.milvus:query:222 - Querying collection open_webui_45ca70fe_c9be_4d16_869e_5a88167dcf3d with filter: 'metadata["hash"] == "d7aca43d47a0d3ece7e53de1d781351626ec6394e881b38a0eb49f8323714838"', limit: -1
2025-10-21 06:52:50.206 | INFO     | open_webui.retrieval.vector.dbs.milvus:query:243 - Total results from query: 1
2025-10-21 06:52:50.206 | INFO     | open_webui.routers.retrieval:save_docs_to_vector_db:1314 - Document with hash d7aca43d47a0d3ece7e53de1d781351626ec6394e881b38a0eb49f8323714838 already exists
2025-10-21 06:52:50.206 | ERROR    | open_webui.routers.retrieval:process_file:1695 - Duplicate content detected. Please provide unique content to proceed.
Traceback (most recent call last):

  File "/usr/local/lib/python3.11/threading.py", line 1002, in _bootstrap
    self._bootstrap_inner()
    │    └ <function Thread._bootstrap_inner at 0x74e817bec9a0>
    └ <WorkerThread(AnyIO worker thread, started 128522576185024)>
  File "/usr/local/lib/python3.11/threading.py", line 1045, in _bootstrap_inner
    self.run()
    │    └ <function WorkerThread.run at 0x74e4044e9f80>
    └ <WorkerThread(AnyIO worker thread, started 128522576185024)>
  File "/usr/local/lib/python3.11/site-packages/anyio/_backends/_asyncio.py", line 976, in run
    result = context.run(func, *args)
             │       │   │      └ ()
             │       │   └ functools.partial(<function add_file_to_knowledge_by_id at 0x74e40661dda0>, user=UserModel(id='369dfe54-64a0-43d5-a9df-6d8524...
             │       └ <method 'run' of '_contextvars.Context' objects>
             └ <_contextvars.Context object at 0x74e404088900>

  File "/app/backend/open_webui/routers/knowledge.py", line 398, in add_file_to_knowledge_by_id
    process_file(
    └ <function process_file at 0x74e40657d940>

> File "/app/backend/open_webui/routers/retrieval.py", line 1692, in process_file
    raise e
          └ ValueError(<ERROR_MESSAGES.DUPLICATE_CONTENT: 'Duplicate content detected. Please provide unique content to proceed.'>)

  File "/app/backend/open_webui/routers/retrieval.py", line 1656, in process_file
    result = save_docs_to_vector_db(
             └ <function save_docs_to_vector_db at 0x74e40657cae0>

  File "/app/backend/open_webui/routers/retrieval.py", line 1315, in save_docs_to_vector_db
    raise ValueError(ERROR_MESSAGES.DUPLICATE_CONTENT)
                     │              └ <ERROR_MESSAGES.DUPLICATE_CONTENT: 'Duplicate content detected. Please provide unique content to proceed.'>
                     └ <enum 'ERROR_MESSAGES'>

ValueError: Duplicate content detected. Please provide unique content to proceed.
2025-10-21 06:52:50.215 | INFO     | uvicorn.protocols.http.httptools_impl:send:476 - 192.168.220.94:0 - "POST /api/v1/knowledge/45ca70fe-c9be-4d16-869e-5a88167dcf3d/file/add HTTP/1.1" 400

Milvus logs :

[2025/10/21 06:52:48.803 +00:00] [INFO] [segments/collection.go:112] ["new collection created"] [collectionID=461643160539521273] [schema="name:\"open_webui_file_2300e9cc_ef9d_4c0e_85e7_f9e581df1d5a\" fields:{fieldID:100 name:\"id\" is_primary_key:true data_type:VarChar type_params:{key:\"max_length\" value:\"65535\"}} fields:{fieldID:101 name:\"vector\" description:\"vector\" data_type:FloatVector type_params:{key:\"dim\" value:\"1024\"}} fields:{fieldID:102 name:\"data\" description:\"data\" data_type:JSON} fields:{fieldID:103 name:\"metadata\" description:\"metadata\" data_type:JSON} fields:{fieldID:104 name:\"$meta\" description:\"dynamic schema\" data_type:JSON is_dynamic:true} fields:{name:\"RowID\" description:\"row id\" data_type:Int64} fields:{fieldID:1 name:\"Timestamp\" description:\"time stamp\" data_type:Int64} enable_dynamic_field:true properties:{key:\"collection.timezone\" value:\"UTC\"}"] []
[2025/10/21 06:52:48.803 +00:00] [INFO] [delegator/delegator.go:1166] ["Init delete cache with list delete buffer"] [traceID=42479141a8136552017e5066fc480c8e] [collectionID=461643160539521273] [replicaID=461643160542773251] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [version=1761029568801863354] [startTs=461643335037616132] [sizePerBlock=1048576] [startTime=2025/10/21 06:52:47.862 +00:00]
[2025/10/21 06:52:48.803 +00:00] [INFO] [delegator/delegator.go:1171] ["shard delegator setup l0 forward policy"] [traceID=42479141a8136552017e5066fc480c8e] [collectionID=461643160539521273] [replicaID=461643160542773251] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [version=1761029568801863354] [startTs=461643335037616132] [policy=FilterByBF]
[2025/10/21 06:52:48.803 +00:00] [INFO] [delegator/distribution.go:316] ["channel distribution serviceable changed"] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [serviceable=true] [loadedRatio=1] [loadedSealedRowCount=0] [totalSealedRowCount=0] [unloadedSealedSegmentNum=0] [totalSealedSegmentNum=0] [action=NewDistribution]
[2025/10/21 06:52:48.803 +00:00] [INFO] [delegator/delegator.go:1221] ["finish build new shardDelegator"] [traceID=42479141a8136552017e5066fc480c8e] [collectionID=461643160539521273] [replicaID=461643160542773251] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [version=1761029568801863354] [startTs=461643335037616132]
[2025/10/21 06:52:48.803 +00:00] [INFO] [pipeline/manager.go:68] ["start create pipeine"] [collectionID=461643160539521273] [channel=by-dev-rootcoord-dml_2_461643160539521273v0]
[2025/10/21 06:52:48.803 +00:00] [INFO] [delegator/delegator_data.go:534] ["loading l0 segments..."] [traceID=42479141a8136552017e5066fc480c8e] [collectionID=461643160539521273] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [replicaID=461643160542773251] [segmentIDs="[]"]
[2025/10/21 06:52:48.803 +00:00] [INFO] [segments/segment_loader.go:261] ["no segment to load"] [traceID=42479141a8136552017e5066fc480c8e] [collectionID=461643160539521273] [segmentType=Sealed]
[2025/10/21 06:52:48.803 +00:00] [INFO] [delegator/delegator_data.go:555] ["load l0 segments done"] [traceID=42479141a8136552017e5066fc480c8e] [collectionID=461643160539521273] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [replicaID=461643160542773251] [segmentIDs="[]"]
[2025/10/21 06:52:48.803 +00:00] [INFO] [delegator/delegator_data.go:353] ["loading growing segments..."] [traceID=42479141a8136552017e5066fc480c8e] [collectionID=461643160539521273] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [replicaID=461643160542773251] [segmentIDs="[]"]
[2025/10/21 06:52:48.803 +00:00] [INFO] [segments/segment_loader.go:261] ["no segment to load"] [traceID=42479141a8136552017e5066fc480c8e] [collectionID=461643160539521273] [segmentType=Growing]
[2025/10/21 06:52:48.803 +00:00] [INFO] [delegator/delegator_data.go:376] ["load growing segments done"] [traceID=42479141a8136552017e5066fc480c8e] [collectionID=461643160539521273] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [replicaID=461643160542773251] [segmentIDs="[]"]
[2025/10/21 06:52:48.803 +00:00] [INFO] [delegator/delegator_data.go:342] ["add growing segments to delegator"] [collectionID=461643160539521273] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [replicaID=461643160542773251] [segmentIDs="[]"]
[2025/10/21 06:52:48.803 +00:00] [INFO] [querynodev2/services.go:362] ["channel seek position is smaller than delete checkpoint, use seek position to seek"] [traceID=42479141a8136552017e5066fc480c8e] [collectionID=461643160539521273] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [currentNodeID=1] [seekPosition=2025/10/21 06:52:47.862 +00:00] [deleteCheckpoint=2025/10/21 06:52:47.862 +00:00]
[2025/10/21 06:52:48.803 +00:00] [INFO] [msgdispatcher/manager.go:71] ["create new dispatcherManager"] [role=querynode] [nodeID=1] [pchannel=by-dev-rootcoord-dml_2]
[2025/10/21 06:52:48.803 +00:00] [INFO] [msgdispatcher/manager.go:91] ["target register done"] [traceID=42479141a8136552017e5066fc480c8e] [vchannel=by-dev-rootcoord-dml_2_461643160539521273v0]
[2025/10/21 06:52:48.803 +00:00] [INFO] [msgdispatcher/client.go:113] ["register done"] [traceID=42479141a8136552017e5066fc480c8e] [role=querynode] [nodeID=1] [vchannel=by-dev-rootcoord-dml_2_461643160539521273v0] [dur=60.467µs]
[2025/10/21 06:52:48.804 +00:00] [INFO] [pipeline/stream_pipeline.go:111] ["stream pipeline seeks from position with msgDispatcher"] [traceID=42479141a8136552017e5066fc480c8e] [pchannel=by-dev-rootcoord-dml_2_461643160539521273v0] [vchannel=by-dev-rootcoord-dml_2_461643160539521273v0] [checkpointTs=2025/10/21 06:52:47.862 +00:00] [tsLag=942.002642ms] [elapse=86.32µs]
[2025/10/21 06:52:48.804 +00:00] [INFO] [querynodev2/services.go:388] ["watch dml channel success"] [traceID=42479141a8136552017e5066fc480c8e] [collectionID=461643160539521273] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [currentNodeID=1]
[2025/10/21 06:52:48.804 +00:00] [INFO] [msgdispatcher/manager.go:130] ["dispatcherManager is running..."] [role=querynode] [nodeID=1] [pchannel=by-dev-rootcoord-dml_2]
[2025/10/21 06:52:48.804 +00:00] [INFO] [task/executor.go:490] ["subscribe channel done"] [taskID=1761028902221] [collectionID=461643160539521273] [replicaID=461643160542773251] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [node=1] [source=channel_checker] [taskID=1761028902221] ["time taken"=2.621716ms]
[2025/10/21 06:52:48.820 +00:00] [INFO] [observers/collection_observer.go:314] ["observe collection done"] [collectionID=461643160539521273] [dur=17.002µs]
[2025/10/21 06:52:48.820 +00:00] [INFO] [observers/collection_observer.go:319] ["observe all collections done"] [num=1] [dur=70.131µs]
[2025/10/21 06:52:48.820 +00:00] [INFO] [balance/utils.go:120] ["create channel task"] [collection=461643160539521273] [replica=461643160542773251] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [from=-1] [to=1]
[2025/10/21 06:52:48.904 +00:00] [INFO] [msgdispatcher/manager.go:266] ["start to build dispatchers"] [role=querynode] [nodeID=1] [pchannel=by-dev-rootcoord-dml_2] [numTargets=1] [vchannels="[by-dev-rootcoord-dml_2_461643160539521273v0]"]
[2025/10/21 06:52:48.904 +00:00] [INFO] [msgdispatcher/dispatcher.go:100] ["creating dispatcher..."] [pchannel=by-dev-rootcoord-dml_2] [id=1] [subName=by-dev-rootcoord-dml_2-1-1761029568904522155] [pullbackEndTs=461643335037616132]
[2025/10/21 06:52:48.904 +00:00] [INFO] [msgdispatcher/dispatcher.go:122] ["as consumer done"] [pchannel=by-dev-rootcoord-dml_2] [id=1] [subName=by-dev-rootcoord-dml_2-1-1761029568904522155] [position="channel_name:\"by-dev-rootcoord-dml_2\" msgID:\"\\x03\\x00`>\\x02\\x16h\\x06\" timestamp:461643335037616132"]
[2025/10/21 06:52:48.904 +00:00] [INFO] [streaming/msgstream_adaptor.go:99] ["delegator msgstream adaptor seeks from position with scanner"] [channel=by-dev-rootcoord-dml_2] [startFromMessageID=461643160697700355] [timestamp=461643335037616132]
[2025/10/21 06:52:48.904 +00:00] [INFO] [msgdispatcher/dispatcher.go:129] ["seek successfully"] [pchannel=by-dev-rootcoord-dml_2] [id=1] [subName=by-dev-rootcoord-dml_2-1-1761029568904522155] [posTs=461643335037616132] [posTime=2025/10/21 06:52:47.862 +00:00] [tsLag=1.042672032s]
[2025/10/21 06:52:48.904 +00:00] [INFO] [msgdispatcher/dispatcher.go:169] ["add new target"] [vchannel=by-dev-rootcoord-dml_2_461643160539521273v0] [id=1] [ts=461643335037616132]
[2025/10/21 06:52:48.904 +00:00] [INFO] [msgdispatcher/dispatcher.go:233] ["handle signal done"] [pchannel=by-dev-rootcoord-dml_2] [id=1] [signal=start]
[2025/10/21 06:52:48.904 +00:00] [INFO] [msgdispatcher/manager.go:296] ["build dispatcher done"] [role=querynode] [nodeID=1] [pchannel=by-dev-rootcoord-dml_2] [id=1] [numVchannels=1] [pullbackBeginTs=461643335037616132] [pullbackEndTs=461643335037616132] [lag=0s] [pullbackBeginTime=2025/10/21 06:52:47.862 +00:00] [pullbackEndTime=2025/10/21 06:52:47.862 +00:00] [buildDur=373.913µs] [pullbackDur=1.018µs] [vchannels="[by-dev-rootcoord-dml_2_461643160539521273v0]"]
[2025/10/21 06:52:48.904 +00:00] [INFO] [handler/handler_client_impl.go:223] ["create handler success"] [pchannel=by-dev-rootcoord-dml_2] [vchannel=] [handler=consumer] [assignment=by-dev-rootcoord-dml_2:rw@2>1@172.17.0.2:22222] [isLocal=true]
[2025/10/21 06:52:48.904 +00:00] [INFO] [msgdispatcher/dispatcher.go:238] ["begin to work"] [pchannel=by-dev-rootcoord-dml_2] [id=1]
[2025/10/21 06:52:48.904 +00:00] [INFO] [msgdispatcher/dispatcher.go:243] ["stop working"] [pchannel=by-dev-rootcoord-dml_2] [id=1]
[2025/10/21 06:52:48.904 +00:00] [INFO] [msgdispatcher/dispatcher.go:233] ["handle signal done"] [pchannel=by-dev-rootcoord-dml_2] [id=1] [signal=pause]
[2025/10/21 06:52:48.904 +00:00] [INFO] [adaptor/scanner_adaptor.go:146] ["scanner start background task"] [module=streamingnode] [component=scanner] [name=by-dev-rootcoord-dml_2/2/2] [channel=by-dev-rootcoord-dml_2]
[2025/10/21 06:52:48.904 +00:00] [INFO] [consumer/consumer_impl.go:164] ["resume on new consumer at new start message id"] [pchannel=by-dev-rootcoord-dml_2] [initialDeliverPolicy="start_from:{id:\"3i9iuca67toj\" WAL_name:RocksMQ}"] [deliverPolicy="start_from:{id:\"3i9iuca67toj\" WAL_name:RocksMQ}"]
[2025/10/21 06:52:48.904 +00:00] [INFO] [msgdispatcher/dispatcher.go:238] ["begin to work"] [pchannel=by-dev-rootcoord-dml_2] [id=1]
[2025/10/21 06:52:48.904 +00:00] [INFO] [msgdispatcher/dispatcher.go:233] ["handle signal done"] [pchannel=by-dev-rootcoord-dml_2] [id=1] [signal=resume]
[2025/10/21 06:52:48.904 +00:00] [INFO] [adaptor/scanner_adaptor.go:188] ["start produce loop of scanner at model"] [module=streamingnode] [component=scanner] [name=by-dev-rootcoord-dml_2/2/2] [channel=by-dev-rootcoord-dml_2] [model=catchup]
[2025/10/21 06:52:48.904 +00:00] [INFO] [msgdispatcher/manager.go:326] ["add main dispatcher"] [role=querynode] [nodeID=1] [pchannel=by-dev-rootcoord-dml_2] [id=1]
[2025/10/21 06:52:48.905 +00:00] [INFO] [adaptor/scanner_switchable.go:156] ["scanner consuming was interrpted because catup done"] [module=streamingnode] [component=scanner] [name=by-dev-rootcoord-dml_2/2/2] [channel=by-dev-rootcoord-dml_2] [timetick=461643335063830532] [messageID=461643160697700356] [lastConfirmedMessageID=461643160697700353]
[2025/10/21 06:52:48.905 +00:00] [INFO] [msgdispatcher/dispatcher.go:308] ["dispatcher pullback done"] [pchannel=by-dev-rootcoord-dml_2] [id=1] [pullbackEndTs=461643335037616132] [pullbackTime=2025/10/21 06:52:47.862 +00:00]
[2025/10/21 06:52:48.905 +00:00] [INFO] [client/client_impl.go:175] ["Consumer MsgMutex closed"] [topic=by-dev-rootcoord-dml_2] [groupName=by-dev-rootcoord-dml_2/2/2]
[2025/10/21 06:52:48.905 +00:00] [INFO] [adaptor/scanner_adaptor.go:195] ["switch scanner model"] [module=streamingnode] [component=scanner] [name=by-dev-rootcoord-dml_2/2/2] [channel=by-dev-rootcoord-dml_2] [model=tailing]
[2025/10/21 06:52:48.906 +00:00] [INFO] [server/rocksmq_impl.go:397] ["init the latest message id done"] [module=rocksmq] [topicName=by-dev-rootcoord-dml_2] [msgID=461643160697700356]
[2025/10/21 06:52:49.020 +00:00] [WARN] [observers/collection_observer.go:388] ["failed to manual check current target, skip update load status"] [collectionID=461643160539521273] [partitionID=461643160539521274]
[2025/10/21 06:52:49.021 +00:00] [INFO] [observers/collection_observer.go:314] ["observe collection done"] [collectionID=461643160539521273] [dur=74.11µs]
[2025/10/21 06:52:49.021 +00:00] [INFO] [observers/collection_observer.go:319] ["observe all collections done"] [num=1] [dur=100.648µs]
[2025/10/21 06:52:49.021 +00:00] [INFO] [observers/target_observer.go:526] ["Update readable segment version"] [collectionID=461643160539521273] [channelName=by-dev-rootcoord-dml_2_461643160539521273v0] [nodeID=1] [oldVersion=1761029568406301109] [newVersion=1761029568406301109]
[2025/10/21 06:52:49.021 +00:00] [INFO] [querynodev2/services.go:1393] ["sync action"] [traceID=02ecb84dee6fb7e153686e59b114cc6b] [collectionID=461643160539521273] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [currentNodeID=1] [Action=UpdateVersion] [TargetVersion=1761029568406301109] [checkPoint=2025/10/21 06:52:47.862 +00:00] [deleteCP=2025/10/21 06:52:47.862 +00:00] [partitions="[461643160539521274]"]
[2025/10/21 06:52:49.022 +00:00] [INFO] [delegator/distribution.go:316] ["channel distribution serviceable changed"] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [serviceable=true] [loadedRatio=1] [loadedSealedRowCount=0] [totalSealedRowCount=0] [unloadedSealedSegmentNum=0] [totalSealedSegmentNum=0] [action=SyncTargetVersion]
[2025/10/21 06:52:49.022 +00:00] [INFO] [delegator/distribution.go:463] ["Update channel query view"] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [partitions="[461643160539521274]"] [oldVersion=1761029568406301109] [newVersion=1761029568406301109] [serviceable=true] [loadedRatio=1] [growingSegmentNum=0] [sealedSegmentNum=0]
[2025/10/21 06:52:49.022 +00:00] [INFO] [observers/target_observer.go:562] ["observer trigger update current target"] [collectionID=461643160539521273]
[2025/10/21 06:52:49.022 +00:00] [INFO] [datacoord/services.go:1055] ["get recovery info request received"] [collectionID=461643160539521273] [partitionIDs="[]"]
[2025/10/21 06:52:49.022 +00:00] [INFO] [datacoord/handler.go:209] [GetQueryVChanPositions] [collectionID=461643160539521273] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [numOfSegments=0] ["result flushed"=0] ["result growing"=0] ["result L0"=0] ["partition stats"={}]
[2025/10/21 06:52:49.022 +00:00] [INFO] [datacoord/handler.go:471] ["channel seek position set from channel checkpoint meta"] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [posTs=461643335037616132] [posTime=2025/10/21 06:52:47.862 +00:00]
[2025/10/21 06:52:49.022 +00:00] [INFO] [datacoord/services.go:1070] ["datacoord append channelInfo in GetRecoveryInfo"] [collectionID=461643160539521273] [partitionIDs="[]"] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] ["# of unflushed segments"=0] ["# of flushed segments"=0] ["# of dropped segments"=0] ["# of indexed segments"=0] ["# of l0 segments"=0] ["# of check point"=2025/10/21 06:52:47.862 +00:00] ["# of delete check point"=2025/10/21 06:52:47.862 +00:00]
[2025/10/21 06:52:49.221 +00:00] [INFO] [observers/collection_observer.go:401] ["partition load status updated"] [collectionID=461643160539521273] [partitionID=461643160539521274] [partitionLoadPercentage=100] [subChannelCount=1] [loadSegmentCount=0]
[2025/10/21 06:52:49.221 +00:00] [INFO] [observers/collection_observer.go:417] ["collection load status updated"] [collectionID=461643160539521273] [collectionLoadPercentage=100]
[2025/10/21 06:52:49.221 +00:00] [INFO] [proxy/impl.go:125] ["received request to invalidate collection meta cache"] [traceID=25973f7c364b553986915f7e3aae5626] [module=Proxy] [role=proxy] [db=] [collectionName=] [collectionID=461643160539521273] [msgType=LoadCollection] [partitionName=]
[2025/10/21 06:52:49.222 +00:00] [INFO] [proxy/meta_cache.go:1100] ["deprecate shard cache for collection"] [collectionName=open_webui_file_2300e9cc_ef9d_4c0e_85e7_f9e581df1d5a]
[2025/10/21 06:52:49.222 +00:00] [INFO] [proxy/impl.go:155] ["complete to invalidate collection meta cache"] [traceID=25973f7c364b553986915f7e3aae5626] [module=Proxy] [role=proxy] [db=] [collectionName=] [collectionID=461643160539521273] [msgType=LoadCollection] [partitionName=] [type=LoadCollection]
[2025/10/21 06:52:49.222 +00:00] [INFO] [proxy/impl.go:209] ["complete to invalidate collection meta cache"] [traceID=25973f7c364b553986915f7e3aae5626] [module=Proxy] [role=proxy] [db=] [collectionName=] [collectionID=461643160539521273] [msgType=LoadCollection] [partitionName=]
[2025/10/21 06:52:49.222 +00:00] [INFO] [observers/collection_observer.go:306] ["Load task finish"] [traceID=42479141a8136552017e5066fc480c8e] [collectionID=461643160539521273] [partitionIDs="[]"] [loadType=LoadCollection]
[2025/10/21 06:52:49.222 +00:00] [INFO] [observers/collection_observer.go:314] ["observe collection done"] [collectionID=461643160539521273] [dur=1.827883ms]
[2025/10/21 06:52:49.222 +00:00] [INFO] [observers/collection_observer.go:319] ["observe all collections done"] [num=1] [dur=1.852068ms]
[2025/10/21 06:52:49.222 +00:00] [INFO] [balance/score_based_balancer.go:644] ["node channel workload status"] [collectionID=461643160539521273] [replicaID=461643160542773251] [nodes="[\"{NodeID: 1, AssignedScore: 23.000000, CurrentScore: 23.000000, Priority: 0}\"]"]
[2025/10/21 06:52:49.222 +00:00] [INFO] [balance/score_based_balancer.go:575] ["node segment workload status"] [collectionID=461643160539521273] [replicaID=461643160542773251] [nodes="[\"{NodeID: 1, AssignedScore: 0.000000, CurrentScore: 0.000000, Priority: 0}\"]"]
[2025/10/21 06:52:49.302 +00:00] [INFO] [task/scheduler.go:1027] ["task removed"] [taskID=1761028902221] [collectionID=461643160539521273] [replicaID=461643160542773251] [status=succeeded] [channel=by-dev-rootcoord-dml_2_461643160539521273v0]
[2025/10/21 06:52:49.302 +00:00] [INFO] [observers/leader_cache_observer.go:79] ["receive event, trigger leader cache update"] [event=461643160539521273]
[2025/10/21 06:52:49.303 +00:00] [INFO] [task/scheduler.go:820] ["processed tasks"] [nodeID=1] [toProcessNum=0] [committedNum=0] [toRemoveNum=1] [promoteDur=3.52µs] [preprocessDUr=8.81µs] [processDUr=4.999µs] [totalDur=123.188µs]
[2025/10/21 06:52:49.303 +00:00] [INFO] [task/scheduler.go:830] ["process tasks related to node done"] [nodeID=1] [processingTaskNum=0] [waitingTaskNum=0] [segmentTaskNum=0] [channelTaskNum=0]
[2025/10/21 06:52:49.303 +00:00] [INFO] [proxy/impl.go:227] ["received request to invalidate shard leader cache"] [traceID=b10fccc002acfc70d047c6e94a52cc1f] [module=Proxy] [role=proxy] [collectionIDs="[461643160539521273]"]
[2025/10/21 06:52:49.303 +00:00] [INFO] [proxy/meta_cache.go:1114] ["Invalidate shard cache for collections"] [collectionIDs="[461643160539521273]"]
[2025/10/21 06:52:49.303 +00:00] [INFO] [proxy/impl.go:232] ["complete to invalidate shard leader cache"] [traceID=b10fccc002acfc70d047c6e94a52cc1f] [module=Proxy] [role=proxy] [collectionIDs="[461643160539521273]"]
[2025/10/21 06:52:49.419 +00:00] [INFO] [proxy/meta_cache.go:529] ["meta update success"] [clientRequestUnixmsec=1761029569417] [traceID=676a75e73c31239fd487e4a3b417431d] [database=default] [collectionName=open_webui_file_2300e9cc_ef9d_4c0e_85e7_f9e581df1d5a] ["actual collection Name"=open_webui_file_2300e9cc_ef9d_4c0e_85e7_f9e581df1d5a] [collectionID=461643160539521273] [partition="[_default]"] [currentVersion=461643335037617133] [version=461643335443939330] [aliases="[]"]
[2025/10/21 06:52:49.428 +00:00] [INFO] [shards/segment_alloc_worker.go:95] ["append create segment message"] [module=streamingnode] [component=shard-manager] [pchannel=by-dev-rootcoord-dml_2:rw@2] [vchannel=by-dev-rootcoord-dml_2_461643160539521273v0] [collectionID=461643160539521273] [partitionID=461643160539521274] [message="{type=CreateSegment,vchannel=by-dev-rootcoord-dml_2_461643160539521273v0,timetick=461643335430832146,size=0,collectionID=461643160539521273,segmentID=461643160538520110,lv=2}"] [messageID=461643160697700358] [timetick=461643335430832146]
[2025/10/21 06:52:49.599 +00:00] [INFO] [recovery/recovery_storage_impl.go:366] ["create segment"] [module=streamingnode] [nodeID=1] [component=recovery-storage] [channel=by-dev-rootcoord-dml_2:rw@2] [state=working] [message="{type=CreateSegment,vchannel=by-dev-rootcoord-dml_2_461643160539521273v0,timetick=461643335430832146,messageID=461643160697700358,lastConfirmed=461643160697700355,size=0,collectionID=461643160539521273,segmentID=461643160538520110,lv=2}"]
[2025/10/21 06:52:49.600 +00:00] [INFO] [pipeline/flow_graph_dd_node.go:243] ["receive create segment message"] [vchannel=ddNode-by-dev-rootcoord-dml_2_461643160539521273v0] [msgType=407] [timetick=461643335430832146]
[2025/10/21 06:52:49.600 +00:00] [INFO] [datacoord/meta.go:557] ["meta update: adding segment - Start"] [traceID=74b23e351259fa8bcfc7ceda1c386821] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [segmentID=461643160538520110]
I20251021 06:52:49.600895    76 IndexConfigGenerator.cpp:79] [SERVER][VecIndexConfig][CGO_DYN][]VecIndexConfig: origin_index_type=HNSW, index_type=IVF_FLAT_CC, metric_type=COSINE, config={"metric_type":"COSINE","nlist":"128","refine_type":0,"ssize":"48","sub_dim":4}
I20251021 06:52:49.601094    76 index_factory.cc:55] [KNOWHERE][Create][CGO_DYN] use key IVF_FLAT_CC_fp32 to create knowhere index IVF_FLAT_CC with version 8
[2025/10/21 06:52:49.601 +00:00] [INFO] [segments/segment.go:378] ["create segment done"] [collectionID=461643160539521273] [partitionID=461643160539521274] [segmentID=461643160538520110] [segmentType=Growing] [level=L1]
[2025/10/21 06:52:49.601 +00:00] [INFO] [datacoord/meta.go:573] ["meta update: adding segment - complete"] [traceID=74b23e351259fa8bcfc7ceda1c386821] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [segmentID=461643160538520110]
[2025/10/21 06:52:49.601 +00:00] [INFO] [datacoord/segment_manager.go:438] ["datacoord: estimateTotalRows: "] [CollectionID=461643160539521273] [SegmentID=461643160538520110] [Channel=by-dev-rootcoord-dml_2_461643160539521273v0] [IsCreatedByStreaming=true]
[2025/10/21 06:52:49.601 +00:00] [INFO] [flusherimpl/msg_handler_impl.go:87] ["alloc growing segment at datacoord"] [collectionID=461643160539521273] [partitionID=461643160539521274] [segmentID=461643160538520110]
[2025/10/21 06:52:49.601 +00:00] [INFO] [writebuffer/write_buffer.go:518] ["add growing segment"] [segmentID=461643160538520110] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] ["storage version"=2]
[2025/10/21 06:52:49.601 +00:00] [INFO] [flusherimpl/msg_handler_impl.go:55] ["create new growing segment"]
[2025/10/21 06:52:49.601 +00:00] [INFO] [pipeline/flow_graph_dd_node.go:247] ["handle create segment message success"] [vchannel=ddNode-by-dev-rootcoord-dml_2_461643160539521273v0] [msgType=407] [timetick=461643335430832146]
[2025/10/21 06:52:49.602 +00:00] [INFO] [delegator/delegator_data.go:342] ["add growing segments to delegator"] [collectionID=461643160539521273] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [replicaID=461643160542773251] [segmentIDs="[461643160538520110]"]
[2025/10/21 06:52:49.602 +00:00] [INFO] [delegator/delegator_data.go:173] ["insert into growing segment"] [collectionID=461643160539521273] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [replicaID=461643160542773251] [collectionID=461643160539521273] [segmentID=461643160538520110] [rowCount=2] [maxTimestamp=461643335430832147]
[2025/10/21 06:52:49.899 +00:00] [INFO] [proxy/impl.go:5897] ["connect received"] [traceID=2186dc8423ac182ca30f204fdd69f97b] [sdk_type=Python] [sdk_version=2.6.2] [local_time="2025-10-21 06:52:49.899041"] [user=] [host=8b5a629ad17b] [db=default]
[2025/10/21 06:52:49.900 +00:00] [INFO] [rootcoord/root_coord.go:914] ["received request to list databases"] [traceID=2186dc8423ac182ca30f204fdd69f97b] [msgID=0]
[2025/10/21 06:52:49.900 +00:00] [INFO] [rootcoord/root_coord.go:940] ["done to list databases"] [traceID=2186dc8423ac182ca30f204fdd69f97b] [msgID=0] ["num of databases"=1]
[2025/10/21 06:52:49.901 +00:00] [INFO] [connection/manager.go:106] ["client register"] [traceID=2186dc8423ac182ca30f204fdd69f97b] [sdk_type=Python] [sdk_version=2.6.2] [local_time="2025-10-21 06:52:49.899041"] [user=] [host=8b5a629ad17b] [identifier=461643335561904130] [last_active_time=2025/10/21 06:52:49.901 +00:00]
[2025/10/21 06:52:49.905 +00:00] [INFO] [proxy/impl.go:715] ["LoadCollection received"] [clientRequestUnixmsec=1761029569904] [traceID=8c934ae5ec3ef6fbd7a3b9f3e7b29260] [role=proxy] [db=default] [collection=open_webui_file_2300e9cc_ef9d_4c0e_85e7_f9e581df1d5a] [refreshMode=false]
[2025/10/21 06:52:49.906 +00:00] [INFO] [proxy/task.go:2106] ["send LoadCollectionRequest to query coordinator"] [clientRequestUnixmsec=1761029569904] [traceID=8c934ae5ec3ef6fbd7a3b9f3e7b29260] [role=proxy] [collectionID=461643160539521273] [schema="name:\"open_webui_file_2300e9cc_ef9d_4c0e_85e7_f9e581df1d5a\" fields:{fieldID:100 name:\"id\" is_primary_key:true data_type:VarChar type_params:{key:\"max_length\" value:\"65535\"}} fields:{fieldID:101 name:\"vector\" description:\"vector\" data_type:FloatVector type_params:{key:\"dim\" value:\"1024\"}} fields:{fieldID:102 name:\"data\" description:\"data\" data_type:JSON} fields:{fieldID:103 name:\"metadata\" description:\"metadata\" data_type:JSON} fields:{fieldID:104 name:\"$meta\" description:\"dynamic schema\" data_type:JSON is_dynamic:true} enable_dynamic_field:true properties:{key:\"collection.timezone\" value:\"UTC\"}"] [priority=0]
[2025/10/21 06:52:49.906 +00:00] [INFO] [querycoordv2/services.go:204] ["load collection request received"] [traceID=8c934ae5ec3ef6fbd7a3b9f3e7b29260] [collectionID=461643160539521273] [replicaNumber=0] [resourceGroups="[]"] [refreshMode=false] [schema="name:\"open_webui_file_2300e9cc_ef9d_4c0e_85e7_f9e581df1d5a\" fields:{fieldID:100 name:\"id\" is_primary_key:true data_type:VarChar type_params:{key:\"max_length\" value:\"65535\"}} fields:{fieldID:101 name:\"vector\" description:\"vector\" data_type:FloatVector type_params:{key:\"dim\" value:\"1024\"}} fields:{fieldID:102 name:\"data\" description:\"data\" data_type:JSON} fields:{fieldID:103 name:\"metadata\" description:\"metadata\" data_type:JSON} fields:{fieldID:104 name:\"$meta\" description:\"dynamic schema\" data_type:JSON is_dynamic:true} enable_dynamic_field:true properties:{key:\"collection.timezone\" value:\"UTC\"}"] [fieldIndexes="[461643160539521278]"]
[2025/10/21 06:52:49.906 +00:00] [INFO] [rootcoord/root_coord.go:2998] ["received request to describe database "] [traceID=8c934ae5ec3ef6fbd7a3b9f3e7b29260] [dbName=default]
[2025/10/21 06:52:49.906 +00:00] [INFO] [rootcoord/root_coord.go:3022] ["done to describe database"] [traceID=8c934ae5ec3ef6fbd7a3b9f3e7b29260] [dbName=default] [ts=461643335561904133]
[2025/10/21 06:52:49.906 +00:00] [INFO] [querycoordv2/services.go:247] ["request doesn't indicate the number of replicas, set it to 1"] [traceID=8c934ae5ec3ef6fbd7a3b9f3e7b29260] [collectionID=461643160539521273] [replicaNumber=0] [resourceGroups="[]"] [refreshMode=false]
[2025/10/21 06:52:49.907 +00:00] [INFO] [querycoordv2/services.go:252] ["request doesn't indicate the resource groups, set it to __default_resource_group"] [traceID=8c934ae5ec3ef6fbd7a3b9f3e7b29260] [collectionID=461643160539521273] [replicaNumber=0] [resourceGroups="[]"] [refreshMode=false]
[2025/10/21 06:52:49.907 +00:00] [INFO] [job/scheduler.go:150] ["start to pre-execute job"] [traceID=8c934ae5ec3ef6fbd7a3b9f3e7b29260] [collectionID=461643160539521273]
[2025/10/21 06:52:49.907 +00:00] [INFO] [job/scheduler.go:158] ["start to execute job"] [traceID=8c934ae5ec3ef6fbd7a3b9f3e7b29260] [collectionID=461643160539521273]
[2025/10/21 06:52:49.907 +00:00] [INFO] [meta/failed_load_cache.go:107] ["FailedLoadCache removes cache"] [collectionID=461643160539521273]
[2025/10/21 06:52:49.907 +00:00] [INFO] [job/scheduler.go:144] ["start to post-execute job"] [traceID=8c934ae5ec3ef6fbd7a3b9f3e7b29260] [collectionID=461643160539521273]
[2025/10/21 06:52:49.907 +00:00] [INFO] [job/scheduler.go:146] ["job finished"] [traceID=8c934ae5ec3ef6fbd7a3b9f3e7b29260] [collectionID=461643160539521273]
[2025/10/21 06:52:49.912 +00:00] [WARN] [proxy/util.go:1281] ["no channel ts found, use beginTs instead"]
[2025/10/21 06:52:50.015 +00:00] [INFO] [proxy/impl.go:5897] ["connect received"] [traceID=8b99be003f3327c9a72b3e64e46169e9] [sdk_type=Python] [sdk_version=2.6.2] [local_time="2025-10-21 06:52:50.014479"] [user=] [host=8b5a629ad17b] [db=default]
[2025/10/21 06:52:50.015 +00:00] [INFO] [rootcoord/root_coord.go:914] ["received request to list databases"] [traceID=8b99be003f3327c9a72b3e64e46169e9] [msgID=0]
[2025/10/21 06:52:50.015 +00:00] [INFO] [rootcoord/root_coord.go:940] ["done to list databases"] [traceID=8b99be003f3327c9a72b3e64e46169e9] [msgID=0] ["num of databases"=1]
[2025/10/21 06:52:50.016 +00:00] [INFO] [connection/manager.go:106] ["client register"] [traceID=8b99be003f3327c9a72b3e64e46169e9] [sdk_type=Python] [sdk_version=2.6.2] [local_time="2025-10-21 06:52:50.014479"] [user=] [host=8b5a629ad17b] [identifier=461643335600963586] [last_active_time=2025/10/21 06:52:50.016 +00:00]
[2025/10/21 06:52:50.021 +00:00] [INFO] [proxy/impl.go:715] ["LoadCollection received"] [clientRequestUnixmsec=1761029570021] [traceID=3d0775fd870ae62887a6f49d0b81912d] [role=proxy] [db=default] [collection=open_webui_45ca70fe_c9be_4d16_869e_5a88167dcf3d] [refreshMode=false]
[2025/10/21 06:52:50.023 +00:00] [INFO] [proxy/task.go:2106] ["send LoadCollectionRequest to query coordinator"] [clientRequestUnixmsec=1761029570021] [traceID=3d0775fd870ae62887a6f49d0b81912d] [role=proxy] [collectionID=461643160539521121] [schema="name:\"open_webui_45ca70fe_c9be_4d16_869e_5a88167dcf3d\" fields:{fieldID:100 name:\"id\" is_primary_key:true data_type:VarChar type_params:{key:\"max_length\" value:\"65535\"}} fields:{fieldID:101 name:\"vector\" description:\"vector\" data_type:FloatVector type_params:{key:\"dim\" value:\"1024\"}} fields:{fieldID:102 name:\"data\" description:\"data\" data_type:JSON} fields:{fieldID:103 name:\"metadata\" description:\"metadata\" data_type:JSON} fields:{fieldID:104 name:\"$meta\" description:\"dynamic schema\" data_type:JSON is_dynamic:true} enable_dynamic_field:true properties:{key:\"collection.timezone\" value:\"UTC\"}"] [priority=0]
[2025/10/21 06:52:50.023 +00:00] [INFO] [querycoordv2/services.go:204] ["load collection request received"] [traceID=3d0775fd870ae62887a6f49d0b81912d] [collectionID=461643160539521121] [replicaNumber=0] [resourceGroups="[]"] [refreshMode=false] [schema="name:\"open_webui_45ca70fe_c9be_4d16_869e_5a88167dcf3d\" fields:{fieldID:100 name:\"id\" is_primary_key:true data_type:VarChar type_params:{key:\"max_length\" value:\"65535\"}} fields:{fieldID:101 name:\"vector\" description:\"vector\" data_type:FloatVector type_params:{key:\"dim\" value:\"1024\"}} fields:{fieldID:102 name:\"data\" description:\"data\" data_type:JSON} fields:{fieldID:103 name:\"metadata\" description:\"metadata\" data_type:JSON} fields:{fieldID:104 name:\"$meta\" description:\"dynamic schema\" data_type:JSON is_dynamic:true} enable_dynamic_field:true properties:{key:\"collection.timezone\" value:\"UTC\"}"] [fieldIndexes="[461643160539521126]"]
[2025/10/21 06:52:50.024 +00:00] [INFO] [rootcoord/root_coord.go:2998] ["received request to describe database "] [traceID=3d0775fd870ae62887a6f49d0b81912d] [dbName=default]
[2025/10/21 06:52:50.024 +00:00] [INFO] [rootcoord/root_coord.go:3022] ["done to describe database"] [traceID=3d0775fd870ae62887a6f49d0b81912d] [dbName=default] [ts=461643335600963589]
[2025/10/21 06:52:50.024 +00:00] [INFO] [querycoordv2/services.go:247] ["request doesn't indicate the number of replicas, set it to 1"] [traceID=3d0775fd870ae62887a6f49d0b81912d] [collectionID=461643160539521121] [replicaNumber=0] [resourceGroups="[]"] [refreshMode=false]
[2025/10/21 06:52:50.024 +00:00] [INFO] [querycoordv2/services.go:252] ["request doesn't indicate the resource groups, set it to __default_resource_group"] [traceID=3d0775fd870ae62887a6f49d0b81912d] [collectionID=461643160539521121] [replicaNumber=0] [resourceGroups="[]"] [refreshMode=false]
[2025/10/21 06:52:50.024 +00:00] [INFO] [job/scheduler.go:150] ["start to pre-execute job"] [traceID=3d0775fd870ae62887a6f49d0b81912d] [collectionID=461643160539521121]
[2025/10/21 06:52:50.024 +00:00] [INFO] [job/scheduler.go:158] ["start to execute job"] [traceID=3d0775fd870ae62887a6f49d0b81912d] [collectionID=461643160539521121]
[2025/10/21 06:52:50.024 +00:00] [INFO] [meta/failed_load_cache.go:107] ["FailedLoadCache removes cache"] [collectionID=461643160539521121]
[2025/10/21 06:52:50.024 +00:00] [INFO] [job/scheduler.go:144] ["start to post-execute job"] [traceID=3d0775fd870ae62887a6f49d0b81912d] [collectionID=461643160539521121]
[2025/10/21 06:52:50.024 +00:00] [INFO] [job/scheduler.go:146] ["job finished"] [traceID=3d0775fd870ae62887a6f49d0b81912d] [collectionID=461643160539521121]
[2025/10/21 06:52:50.030 +00:00] [WARN] [proxy/util.go:1281] ["no channel ts found, use beginTs instead"]
[2025/10/21 06:52:51.214 +00:00] [WARN] [datacoord/meta.go:501] ["not found database name"] [collectionID=461643160539521273]
[2025/10/21 06:52:52.221 +00:00] [INFO] [observers/target_observer.go:526] ["Update readable segment version"] [collectionID=461643160538320086] [channelName=by-dev-rootcoord-dml_0_461643160538320086v0] [nodeID=1] [oldVersion=1761029552222834327] [newVersion=1761029562221866209]

Additional Information

No response

Originally created by @julien-oss on GitHub (Oct 21, 2025). ### Check Existing Issues - [x] I have searched for any existing and/or related issues. - [x] I have searched for any existing and/or related discussions. - [x] I am using the latest version of Open WebUI. ### Installation Method Docker ### Open WebUI Version v0.6.34 ### Ollama Version (if applicable) _No response_ ### Operating System Ubuntu24.04 ### Browser (if applicable) _No response_ ### Confirmation - [x] I have read and followed all instructions in `README.md`. - [x] I am using the latest version of **both** Open WebUI and Ollama. - [x] I have included the browser console logs. - [x] I have included the Docker container logs. - [x] I have **provided every relevant configuration, setting, and environment variable used in my setup.** - [x] I have clearly **listed every relevant configuration, custom setting, environment variable, and command-line option that influences my setup** (such as Docker Compose overrides, .env values, browser settings, authentication configurations, etc). - [x] I have documented **step-by-step reproduction instructions that are precise, sequential, and leave nothing to interpretation**. My steps: - Start with the initial platform/version/OS and dependencies used, - Specify exact install/launch/configure commands, - List URLs visited, user input (incl. example values/emails/passwords if needed), - Describe all options and toggles enabled or changed, - Include any files or environmental changes, - Identify the expected and actual result at each stage, - Ensure any reasonably skilled user can follow and hit the same issue. ### Expected Behavior I create a new knowledge base, upload a document, and then another completely different document. Both are added to the knowledge base and vector db. ### Actual Behavior I create a new knowledge base, upload a document, and then another completely different document. Only the first one is being added, every time I try to upload a second document, it get falsely flagged as duplicated content. ### Steps to Reproduce 1. Install milvus docker container using the official installation script standalone_embed.sh 2. Install openwebui docker container with milvusdb environment variable VECTOR_DB=milvus MILVUS_URI=*** MILVUS_TOKEN=*** MILVUS_DB=default 3. Log in to openwebui and create a new knowledge base 4. Add a file 5. File get successfully added 6. Add a completely different file 7. File get falsely flagged as duplicate content and don't get added to the knowledge base ### Logs & Screenshots Openwebui logs : ``` 2025-10-21 06:52:22.314 | INFO | open_webui.routers.retrieval:save_docs_to_vector_db:1300 - save_docs_to_vector_db: document Example1.pdf file-1cef0489-e432-48b5-b378-929f26ba137c 2025-10-21 06:52:22.326 | WARNING | open_webui.retrieval.vector.dbs.milvus:query:206 - Query attempted on non-existent collection: open_webui_file_1cef0489_e432_48b5_b378_929f26ba137c 2025-10-21 06:52:22.326 | INFO | open_webui.routers.retrieval:save_docs_to_vector_db:1326 - Using token text splitter: cl100k_base 2025-10-21 06:52:22.496 | INFO | open_webui.routers.retrieval:save_docs_to_vector_db:1416 - generating embeddings for file-1cef0489-e432-48b5-b378-929f26ba137c 2025-10-21 06:52:22.522 | INFO | open_webui.routers.retrieval:save_docs_to_vector_db:1452 - embeddings generated 1 for 1 items 2025-10-21 06:52:22.523 | INFO | open_webui.routers.retrieval:save_docs_to_vector_db:1464 - adding to collection file-1cef0489-e432-48b5-b378-929f26ba137c 2025-10-21 06:52:22.525 | INFO | open_webui.retrieval.vector.dbs.milvus:insert:268 - Collection open_webui_file_1cef0489_e432_48b5_b378_929f26ba137c does not exist. Creating now. 2025-10-21 06:52:22.526 | INFO | open_webui.retrieval.vector.dbs.milvus:_create_collection:124 - Using Milvus index type: HNSW, metric type: COSINE 2025-10-21 06:52:22.526 | INFO | open_webui.retrieval.vector.dbs.milvus:_create_collection:132 - HNSW params: {'M': 16, 'efConstruction': 100} 2025-10-21 06:52:23.676 | INFO | open_webui.retrieval.vector.dbs.milvus:_create_collection:165 - Successfully created collection 'open_webui_file_1cef0489_e432_48b5_b378_929f26ba137c' with index type 'HNSW' and metric 'COSINE'. 2025-10-21 06:52:23.676 | INFO | open_webui.retrieval.vector.dbs.milvus:insert:282 - Inserting 1 items into collection open_webui_file_1cef0489_e432_48b5_b378_929f26ba137c. 2025-10-21 06:52:23.692 | INFO | open_webui.routers.retrieval:save_docs_to_vector_db:1470 - added 1 items to collection file-1cef0489-e432-48b5-b378-929f26ba137c 2025-10-21 06:52:23.692 | INFO | open_webui.routers.retrieval:process_file:1668 - added 1 items to collection file-1cef0489-e432-48b5-b378-929f26ba137c 2025-10-21 06:52:23.909 | INFO | open_webui.retrieval.vector.dbs.milvus:query:222 - Querying collection open_webui_file_1cef0489_e432_48b5_b378_929f26ba137c with filter: 'metadata["file_id"] == "1cef0489-e432-48b5-b378-929f26ba137c"', limit: -1 2025-10-21 06:52:24.007 | INFO | open_webui.retrieval.vector.dbs.milvus:query:243 - Total results from query: 1 2025-10-21 06:52:24.011 | INFO | open_webui.routers.retrieval:save_docs_to_vector_db:1300 - save_docs_to_vector_db: document Example1.pdf 45ca70fe-c9be-4d16-869e-5a88167dcf3d 2025-10-21 06:52:24.019 | WARNING | open_webui.retrieval.vector.dbs.milvus:query:206 - Query attempted on non-existent collection: open_webui_45ca70fe_c9be_4d16_869e_5a88167dcf3d 2025-10-21 06:52:24.020 | INFO | open_webui.routers.retrieval:save_docs_to_vector_db:1326 - Using token text splitter: cl100k_base 2025-10-21 06:52:24.022 | INFO | open_webui.routers.retrieval:save_docs_to_vector_db:1416 - generating embeddings for 45ca70fe-c9be-4d16-869e-5a88167dcf3d 2025-10-21 06:52:24.042 | INFO | open_webui.routers.retrieval:save_docs_to_vector_db:1452 - embeddings generated 1 for 1 items 2025-10-21 06:52:24.042 | INFO | open_webui.routers.retrieval:save_docs_to_vector_db:1464 - adding to collection 45ca70fe-c9be-4d16-869e-5a88167dcf3d 2025-10-21 06:52:24.045 | INFO | open_webui.retrieval.vector.dbs.milvus:insert:268 - Collection open_webui_45ca70fe_c9be_4d16_869e_5a88167dcf3d does not exist. Creating now. 2025-10-21 06:52:24.045 | INFO | open_webui.retrieval.vector.dbs.milvus:_create_collection:124 - Using Milvus index type: HNSW, metric type: COSINE 2025-10-21 06:52:24.045 | INFO | open_webui.retrieval.vector.dbs.milvus:_create_collection:132 - HNSW params: {'M': 16, 'efConstruction': 100} 2025-10-21 06:52:25.383 | INFO | open_webui.retrieval.vector.dbs.milvus:_create_collection:165 - Successfully created collection 'open_webui_45ca70fe_c9be_4d16_869e_5a88167dcf3d' with index type 'HNSW' and metric 'COSINE'. 2025-10-21 06:52:25.384 | INFO | open_webui.retrieval.vector.dbs.milvus:insert:282 - Inserting 1 items into collection open_webui_45ca70fe_c9be_4d16_869e_5a88167dcf3d. 2025-10-21 06:52:25.391 | INFO | open_webui.routers.retrieval:save_docs_to_vector_db:1470 - added 1 items to collection 45ca70fe-c9be-4d16-869e-5a88167dcf3d 2025-10-21 06:52:25.392 | INFO | open_webui.routers.retrieval:process_file:1668 - added 1 items to collection 45ca70fe-c9be-4d16-869e-5a88167dcf3d 2025-10-21 06:52:25.403 | INFO | uvicorn.protocols.http.httptools_impl:send:476 - 192.168.220.94:0 - "POST /api/v1/knowledge/45ca70fe-c9be-4d16-869e-5a88167dcf3d/file/add HTTP/1.1" 200 2025-10-21 06:52:32.762 | INFO | open_webui.routers.files:upload_file_handler:164 - file.content_type: application/pdf 2025-10-21 06:52:32.769 | INFO | uvicorn.protocols.http.httptools_impl:send:476 - 192.168.220.94:0 - "POST /api/v1/files/ HTTP/1.1" 200 2025-10-21 06:52:32.802 | INFO | uvicorn.protocols.http.httptools_impl:send:476 - 192.168.220.94:0 - "GET /api/v1/files/2300e9cc-ef9d-4c0e-85e7-f9e581df1d5a/process/status?stream=true HTTP/1.1" 200 2025-10-21 06:52:38.255 | INFO | uvicorn.protocols.http.httptools_impl:send:476 - 192.168.220.94:0 - "GET /_app/version.json HTTP/1.1" 304 2025-10-21 06:52:47.814 | INFO | open_webui.routers.retrieval:save_docs_to_vector_db:1300 - save_docs_to_vector_db: document Example2.pdf file-2300e9cc-ef9d-4c0e-85e7-f9e581df1d5a 2025-10-21 06:52:47.821 | WARNING | open_webui.retrieval.vector.dbs.milvus:query:206 - Query attempted on non-existent collection: open_webui_file_2300e9cc_ef9d_4c0e_85e7_f9e581df1d5a 2025-10-21 06:52:47.821 | INFO | open_webui.routers.retrieval:save_docs_to_vector_db:1326 - Using token text splitter: cl100k_base 2025-10-21 06:52:47.826 | INFO | open_webui.routers.retrieval:save_docs_to_vector_db:1416 - generating embeddings for file-2300e9cc-ef9d-4c0e-85e7-f9e581df1d5a 2025-10-21 06:52:47.876 | INFO | open_webui.routers.retrieval:save_docs_to_vector_db:1452 - embeddings generated 2 for 2 items 2025-10-21 06:52:47.877 | INFO | open_webui.routers.retrieval:save_docs_to_vector_db:1464 - adding to collection file-2300e9cc-ef9d-4c0e-85e7-f9e581df1d5a 2025-10-21 06:52:47.879 | INFO | open_webui.retrieval.vector.dbs.milvus:insert:268 - Collection open_webui_file_2300e9cc_ef9d_4c0e_85e7_f9e581df1d5a does not exist. Creating now. 2025-10-21 06:52:47.880 | INFO | open_webui.retrieval.vector.dbs.milvus:_create_collection:124 - Using Milvus index type: HNSW, metric type: COSINE 2025-10-21 06:52:47.880 | INFO | open_webui.retrieval.vector.dbs.milvus:_create_collection:132 - HNSW params: {'M': 16, 'efConstruction': 100} 2025-10-21 06:52:49.421 | INFO | open_webui.retrieval.vector.dbs.milvus:_create_collection:165 - Successfully created collection 'open_webui_file_2300e9cc_ef9d_4c0e_85e7_f9e581df1d5a' with index type 'HNSW' and metric 'COSINE'. 2025-10-21 06:52:49.421 | INFO | open_webui.retrieval.vector.dbs.milvus:insert:282 - Inserting 2 items into collection open_webui_file_2300e9cc_ef9d_4c0e_85e7_f9e581df1d5a. 2025-10-21 06:52:49.429 | INFO | open_webui.routers.retrieval:save_docs_to_vector_db:1470 - added 2 items to collection file-2300e9cc-ef9d-4c0e-85e7-f9e581df1d5a 2025-10-21 06:52:49.429 | INFO | open_webui.routers.retrieval:process_file:1668 - added 1 items to collection file-2300e9cc-ef9d-4c0e-85e7-f9e581df1d5a 2025-10-21 06:52:49.908 | INFO | open_webui.retrieval.vector.dbs.milvus:query:222 - Querying collection open_webui_file_2300e9cc_ef9d_4c0e_85e7_f9e581df1d5a with filter: 'metadata["file_id"] == "2300e9cc-ef9d-4c0e-85e7-f9e581df1d5a"', limit: -1 2025-10-21 06:52:50.007 | INFO | open_webui.retrieval.vector.dbs.milvus:query:243 - Total results from query: 2 2025-10-21 06:52:50.012 | INFO | open_webui.routers.retrieval:save_docs_to_vector_db:1300 - save_docs_to_vector_db: document Example2.pdf 45ca70fe-c9be-4d16-869e-5a88167dcf3d 2025-10-21 06:52:50.026 | INFO | open_webui.retrieval.vector.dbs.milvus:query:222 - Querying collection open_webui_45ca70fe_c9be_4d16_869e_5a88167dcf3d with filter: 'metadata["hash"] == "d7aca43d47a0d3ece7e53de1d781351626ec6394e881b38a0eb49f8323714838"', limit: -1 2025-10-21 06:52:50.206 | INFO | open_webui.retrieval.vector.dbs.milvus:query:243 - Total results from query: 1 2025-10-21 06:52:50.206 | INFO | open_webui.routers.retrieval:save_docs_to_vector_db:1314 - Document with hash d7aca43d47a0d3ece7e53de1d781351626ec6394e881b38a0eb49f8323714838 already exists 2025-10-21 06:52:50.206 | ERROR | open_webui.routers.retrieval:process_file:1695 - Duplicate content detected. Please provide unique content to proceed. Traceback (most recent call last): File "/usr/local/lib/python3.11/threading.py", line 1002, in _bootstrap self._bootstrap_inner() │ └ <function Thread._bootstrap_inner at 0x74e817bec9a0> └ <WorkerThread(AnyIO worker thread, started 128522576185024)> File "/usr/local/lib/python3.11/threading.py", line 1045, in _bootstrap_inner self.run() │ └ <function WorkerThread.run at 0x74e4044e9f80> └ <WorkerThread(AnyIO worker thread, started 128522576185024)> File "/usr/local/lib/python3.11/site-packages/anyio/_backends/_asyncio.py", line 976, in run result = context.run(func, *args) │ │ │ └ () │ │ └ functools.partial(<function add_file_to_knowledge_by_id at 0x74e40661dda0>, user=UserModel(id='369dfe54-64a0-43d5-a9df-6d8524... │ └ <method 'run' of '_contextvars.Context' objects> └ <_contextvars.Context object at 0x74e404088900> File "/app/backend/open_webui/routers/knowledge.py", line 398, in add_file_to_knowledge_by_id process_file( └ <function process_file at 0x74e40657d940> > File "/app/backend/open_webui/routers/retrieval.py", line 1692, in process_file raise e └ ValueError(<ERROR_MESSAGES.DUPLICATE_CONTENT: 'Duplicate content detected. Please provide unique content to proceed.'>) File "/app/backend/open_webui/routers/retrieval.py", line 1656, in process_file result = save_docs_to_vector_db( └ <function save_docs_to_vector_db at 0x74e40657cae0> File "/app/backend/open_webui/routers/retrieval.py", line 1315, in save_docs_to_vector_db raise ValueError(ERROR_MESSAGES.DUPLICATE_CONTENT) │ └ <ERROR_MESSAGES.DUPLICATE_CONTENT: 'Duplicate content detected. Please provide unique content to proceed.'> └ <enum 'ERROR_MESSAGES'> ValueError: Duplicate content detected. Please provide unique content to proceed. 2025-10-21 06:52:50.215 | INFO | uvicorn.protocols.http.httptools_impl:send:476 - 192.168.220.94:0 - "POST /api/v1/knowledge/45ca70fe-c9be-4d16-869e-5a88167dcf3d/file/add HTTP/1.1" 400 ``` Milvus logs : ``` [2025/10/21 06:52:48.803 +00:00] [INFO] [segments/collection.go:112] ["new collection created"] [collectionID=461643160539521273] [schema="name:\"open_webui_file_2300e9cc_ef9d_4c0e_85e7_f9e581df1d5a\" fields:{fieldID:100 name:\"id\" is_primary_key:true data_type:VarChar type_params:{key:\"max_length\" value:\"65535\"}} fields:{fieldID:101 name:\"vector\" description:\"vector\" data_type:FloatVector type_params:{key:\"dim\" value:\"1024\"}} fields:{fieldID:102 name:\"data\" description:\"data\" data_type:JSON} fields:{fieldID:103 name:\"metadata\" description:\"metadata\" data_type:JSON} fields:{fieldID:104 name:\"$meta\" description:\"dynamic schema\" data_type:JSON is_dynamic:true} fields:{name:\"RowID\" description:\"row id\" data_type:Int64} fields:{fieldID:1 name:\"Timestamp\" description:\"time stamp\" data_type:Int64} enable_dynamic_field:true properties:{key:\"collection.timezone\" value:\"UTC\"}"] [] [2025/10/21 06:52:48.803 +00:00] [INFO] [delegator/delegator.go:1166] ["Init delete cache with list delete buffer"] [traceID=42479141a8136552017e5066fc480c8e] [collectionID=461643160539521273] [replicaID=461643160542773251] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [version=1761029568801863354] [startTs=461643335037616132] [sizePerBlock=1048576] [startTime=2025/10/21 06:52:47.862 +00:00] [2025/10/21 06:52:48.803 +00:00] [INFO] [delegator/delegator.go:1171] ["shard delegator setup l0 forward policy"] [traceID=42479141a8136552017e5066fc480c8e] [collectionID=461643160539521273] [replicaID=461643160542773251] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [version=1761029568801863354] [startTs=461643335037616132] [policy=FilterByBF] [2025/10/21 06:52:48.803 +00:00] [INFO] [delegator/distribution.go:316] ["channel distribution serviceable changed"] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [serviceable=true] [loadedRatio=1] [loadedSealedRowCount=0] [totalSealedRowCount=0] [unloadedSealedSegmentNum=0] [totalSealedSegmentNum=0] [action=NewDistribution] [2025/10/21 06:52:48.803 +00:00] [INFO] [delegator/delegator.go:1221] ["finish build new shardDelegator"] [traceID=42479141a8136552017e5066fc480c8e] [collectionID=461643160539521273] [replicaID=461643160542773251] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [version=1761029568801863354] [startTs=461643335037616132] [2025/10/21 06:52:48.803 +00:00] [INFO] [pipeline/manager.go:68] ["start create pipeine"] [collectionID=461643160539521273] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [2025/10/21 06:52:48.803 +00:00] [INFO] [delegator/delegator_data.go:534] ["loading l0 segments..."] [traceID=42479141a8136552017e5066fc480c8e] [collectionID=461643160539521273] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [replicaID=461643160542773251] [segmentIDs="[]"] [2025/10/21 06:52:48.803 +00:00] [INFO] [segments/segment_loader.go:261] ["no segment to load"] [traceID=42479141a8136552017e5066fc480c8e] [collectionID=461643160539521273] [segmentType=Sealed] [2025/10/21 06:52:48.803 +00:00] [INFO] [delegator/delegator_data.go:555] ["load l0 segments done"] [traceID=42479141a8136552017e5066fc480c8e] [collectionID=461643160539521273] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [replicaID=461643160542773251] [segmentIDs="[]"] [2025/10/21 06:52:48.803 +00:00] [INFO] [delegator/delegator_data.go:353] ["loading growing segments..."] [traceID=42479141a8136552017e5066fc480c8e] [collectionID=461643160539521273] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [replicaID=461643160542773251] [segmentIDs="[]"] [2025/10/21 06:52:48.803 +00:00] [INFO] [segments/segment_loader.go:261] ["no segment to load"] [traceID=42479141a8136552017e5066fc480c8e] [collectionID=461643160539521273] [segmentType=Growing] [2025/10/21 06:52:48.803 +00:00] [INFO] [delegator/delegator_data.go:376] ["load growing segments done"] [traceID=42479141a8136552017e5066fc480c8e] [collectionID=461643160539521273] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [replicaID=461643160542773251] [segmentIDs="[]"] [2025/10/21 06:52:48.803 +00:00] [INFO] [delegator/delegator_data.go:342] ["add growing segments to delegator"] [collectionID=461643160539521273] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [replicaID=461643160542773251] [segmentIDs="[]"] [2025/10/21 06:52:48.803 +00:00] [INFO] [querynodev2/services.go:362] ["channel seek position is smaller than delete checkpoint, use seek position to seek"] [traceID=42479141a8136552017e5066fc480c8e] [collectionID=461643160539521273] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [currentNodeID=1] [seekPosition=2025/10/21 06:52:47.862 +00:00] [deleteCheckpoint=2025/10/21 06:52:47.862 +00:00] [2025/10/21 06:52:48.803 +00:00] [INFO] [msgdispatcher/manager.go:71] ["create new dispatcherManager"] [role=querynode] [nodeID=1] [pchannel=by-dev-rootcoord-dml_2] [2025/10/21 06:52:48.803 +00:00] [INFO] [msgdispatcher/manager.go:91] ["target register done"] [traceID=42479141a8136552017e5066fc480c8e] [vchannel=by-dev-rootcoord-dml_2_461643160539521273v0] [2025/10/21 06:52:48.803 +00:00] [INFO] [msgdispatcher/client.go:113] ["register done"] [traceID=42479141a8136552017e5066fc480c8e] [role=querynode] [nodeID=1] [vchannel=by-dev-rootcoord-dml_2_461643160539521273v0] [dur=60.467µs] [2025/10/21 06:52:48.804 +00:00] [INFO] [pipeline/stream_pipeline.go:111] ["stream pipeline seeks from position with msgDispatcher"] [traceID=42479141a8136552017e5066fc480c8e] [pchannel=by-dev-rootcoord-dml_2_461643160539521273v0] [vchannel=by-dev-rootcoord-dml_2_461643160539521273v0] [checkpointTs=2025/10/21 06:52:47.862 +00:00] [tsLag=942.002642ms] [elapse=86.32µs] [2025/10/21 06:52:48.804 +00:00] [INFO] [querynodev2/services.go:388] ["watch dml channel success"] [traceID=42479141a8136552017e5066fc480c8e] [collectionID=461643160539521273] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [currentNodeID=1] [2025/10/21 06:52:48.804 +00:00] [INFO] [msgdispatcher/manager.go:130] ["dispatcherManager is running..."] [role=querynode] [nodeID=1] [pchannel=by-dev-rootcoord-dml_2] [2025/10/21 06:52:48.804 +00:00] [INFO] [task/executor.go:490] ["subscribe channel done"] [taskID=1761028902221] [collectionID=461643160539521273] [replicaID=461643160542773251] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [node=1] [source=channel_checker] [taskID=1761028902221] ["time taken"=2.621716ms] [2025/10/21 06:52:48.820 +00:00] [INFO] [observers/collection_observer.go:314] ["observe collection done"] [collectionID=461643160539521273] [dur=17.002µs] [2025/10/21 06:52:48.820 +00:00] [INFO] [observers/collection_observer.go:319] ["observe all collections done"] [num=1] [dur=70.131µs] [2025/10/21 06:52:48.820 +00:00] [INFO] [balance/utils.go:120] ["create channel task"] [collection=461643160539521273] [replica=461643160542773251] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [from=-1] [to=1] [2025/10/21 06:52:48.904 +00:00] [INFO] [msgdispatcher/manager.go:266] ["start to build dispatchers"] [role=querynode] [nodeID=1] [pchannel=by-dev-rootcoord-dml_2] [numTargets=1] [vchannels="[by-dev-rootcoord-dml_2_461643160539521273v0]"] [2025/10/21 06:52:48.904 +00:00] [INFO] [msgdispatcher/dispatcher.go:100] ["creating dispatcher..."] [pchannel=by-dev-rootcoord-dml_2] [id=1] [subName=by-dev-rootcoord-dml_2-1-1761029568904522155] [pullbackEndTs=461643335037616132] [2025/10/21 06:52:48.904 +00:00] [INFO] [msgdispatcher/dispatcher.go:122] ["as consumer done"] [pchannel=by-dev-rootcoord-dml_2] [id=1] [subName=by-dev-rootcoord-dml_2-1-1761029568904522155] [position="channel_name:\"by-dev-rootcoord-dml_2\" msgID:\"\\x03\\x00`>\\x02\\x16h\\x06\" timestamp:461643335037616132"] [2025/10/21 06:52:48.904 +00:00] [INFO] [streaming/msgstream_adaptor.go:99] ["delegator msgstream adaptor seeks from position with scanner"] [channel=by-dev-rootcoord-dml_2] [startFromMessageID=461643160697700355] [timestamp=461643335037616132] [2025/10/21 06:52:48.904 +00:00] [INFO] [msgdispatcher/dispatcher.go:129] ["seek successfully"] [pchannel=by-dev-rootcoord-dml_2] [id=1] [subName=by-dev-rootcoord-dml_2-1-1761029568904522155] [posTs=461643335037616132] [posTime=2025/10/21 06:52:47.862 +00:00] [tsLag=1.042672032s] [2025/10/21 06:52:48.904 +00:00] [INFO] [msgdispatcher/dispatcher.go:169] ["add new target"] [vchannel=by-dev-rootcoord-dml_2_461643160539521273v0] [id=1] [ts=461643335037616132] [2025/10/21 06:52:48.904 +00:00] [INFO] [msgdispatcher/dispatcher.go:233] ["handle signal done"] [pchannel=by-dev-rootcoord-dml_2] [id=1] [signal=start] [2025/10/21 06:52:48.904 +00:00] [INFO] [msgdispatcher/manager.go:296] ["build dispatcher done"] [role=querynode] [nodeID=1] [pchannel=by-dev-rootcoord-dml_2] [id=1] [numVchannels=1] [pullbackBeginTs=461643335037616132] [pullbackEndTs=461643335037616132] [lag=0s] [pullbackBeginTime=2025/10/21 06:52:47.862 +00:00] [pullbackEndTime=2025/10/21 06:52:47.862 +00:00] [buildDur=373.913µs] [pullbackDur=1.018µs] [vchannels="[by-dev-rootcoord-dml_2_461643160539521273v0]"] [2025/10/21 06:52:48.904 +00:00] [INFO] [handler/handler_client_impl.go:223] ["create handler success"] [pchannel=by-dev-rootcoord-dml_2] [vchannel=] [handler=consumer] [assignment=by-dev-rootcoord-dml_2:rw@2>1@172.17.0.2:22222] [isLocal=true] [2025/10/21 06:52:48.904 +00:00] [INFO] [msgdispatcher/dispatcher.go:238] ["begin to work"] [pchannel=by-dev-rootcoord-dml_2] [id=1] [2025/10/21 06:52:48.904 +00:00] [INFO] [msgdispatcher/dispatcher.go:243] ["stop working"] [pchannel=by-dev-rootcoord-dml_2] [id=1] [2025/10/21 06:52:48.904 +00:00] [INFO] [msgdispatcher/dispatcher.go:233] ["handle signal done"] [pchannel=by-dev-rootcoord-dml_2] [id=1] [signal=pause] [2025/10/21 06:52:48.904 +00:00] [INFO] [adaptor/scanner_adaptor.go:146] ["scanner start background task"] [module=streamingnode] [component=scanner] [name=by-dev-rootcoord-dml_2/2/2] [channel=by-dev-rootcoord-dml_2] [2025/10/21 06:52:48.904 +00:00] [INFO] [consumer/consumer_impl.go:164] ["resume on new consumer at new start message id"] [pchannel=by-dev-rootcoord-dml_2] [initialDeliverPolicy="start_from:{id:\"3i9iuca67toj\" WAL_name:RocksMQ}"] [deliverPolicy="start_from:{id:\"3i9iuca67toj\" WAL_name:RocksMQ}"] [2025/10/21 06:52:48.904 +00:00] [INFO] [msgdispatcher/dispatcher.go:238] ["begin to work"] [pchannel=by-dev-rootcoord-dml_2] [id=1] [2025/10/21 06:52:48.904 +00:00] [INFO] [msgdispatcher/dispatcher.go:233] ["handle signal done"] [pchannel=by-dev-rootcoord-dml_2] [id=1] [signal=resume] [2025/10/21 06:52:48.904 +00:00] [INFO] [adaptor/scanner_adaptor.go:188] ["start produce loop of scanner at model"] [module=streamingnode] [component=scanner] [name=by-dev-rootcoord-dml_2/2/2] [channel=by-dev-rootcoord-dml_2] [model=catchup] [2025/10/21 06:52:48.904 +00:00] [INFO] [msgdispatcher/manager.go:326] ["add main dispatcher"] [role=querynode] [nodeID=1] [pchannel=by-dev-rootcoord-dml_2] [id=1] [2025/10/21 06:52:48.905 +00:00] [INFO] [adaptor/scanner_switchable.go:156] ["scanner consuming was interrpted because catup done"] [module=streamingnode] [component=scanner] [name=by-dev-rootcoord-dml_2/2/2] [channel=by-dev-rootcoord-dml_2] [timetick=461643335063830532] [messageID=461643160697700356] [lastConfirmedMessageID=461643160697700353] [2025/10/21 06:52:48.905 +00:00] [INFO] [msgdispatcher/dispatcher.go:308] ["dispatcher pullback done"] [pchannel=by-dev-rootcoord-dml_2] [id=1] [pullbackEndTs=461643335037616132] [pullbackTime=2025/10/21 06:52:47.862 +00:00] [2025/10/21 06:52:48.905 +00:00] [INFO] [client/client_impl.go:175] ["Consumer MsgMutex closed"] [topic=by-dev-rootcoord-dml_2] [groupName=by-dev-rootcoord-dml_2/2/2] [2025/10/21 06:52:48.905 +00:00] [INFO] [adaptor/scanner_adaptor.go:195] ["switch scanner model"] [module=streamingnode] [component=scanner] [name=by-dev-rootcoord-dml_2/2/2] [channel=by-dev-rootcoord-dml_2] [model=tailing] [2025/10/21 06:52:48.906 +00:00] [INFO] [server/rocksmq_impl.go:397] ["init the latest message id done"] [module=rocksmq] [topicName=by-dev-rootcoord-dml_2] [msgID=461643160697700356] [2025/10/21 06:52:49.020 +00:00] [WARN] [observers/collection_observer.go:388] ["failed to manual check current target, skip update load status"] [collectionID=461643160539521273] [partitionID=461643160539521274] [2025/10/21 06:52:49.021 +00:00] [INFO] [observers/collection_observer.go:314] ["observe collection done"] [collectionID=461643160539521273] [dur=74.11µs] [2025/10/21 06:52:49.021 +00:00] [INFO] [observers/collection_observer.go:319] ["observe all collections done"] [num=1] [dur=100.648µs] [2025/10/21 06:52:49.021 +00:00] [INFO] [observers/target_observer.go:526] ["Update readable segment version"] [collectionID=461643160539521273] [channelName=by-dev-rootcoord-dml_2_461643160539521273v0] [nodeID=1] [oldVersion=1761029568406301109] [newVersion=1761029568406301109] [2025/10/21 06:52:49.021 +00:00] [INFO] [querynodev2/services.go:1393] ["sync action"] [traceID=02ecb84dee6fb7e153686e59b114cc6b] [collectionID=461643160539521273] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [currentNodeID=1] [Action=UpdateVersion] [TargetVersion=1761029568406301109] [checkPoint=2025/10/21 06:52:47.862 +00:00] [deleteCP=2025/10/21 06:52:47.862 +00:00] [partitions="[461643160539521274]"] [2025/10/21 06:52:49.022 +00:00] [INFO] [delegator/distribution.go:316] ["channel distribution serviceable changed"] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [serviceable=true] [loadedRatio=1] [loadedSealedRowCount=0] [totalSealedRowCount=0] [unloadedSealedSegmentNum=0] [totalSealedSegmentNum=0] [action=SyncTargetVersion] [2025/10/21 06:52:49.022 +00:00] [INFO] [delegator/distribution.go:463] ["Update channel query view"] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [partitions="[461643160539521274]"] [oldVersion=1761029568406301109] [newVersion=1761029568406301109] [serviceable=true] [loadedRatio=1] [growingSegmentNum=0] [sealedSegmentNum=0] [2025/10/21 06:52:49.022 +00:00] [INFO] [observers/target_observer.go:562] ["observer trigger update current target"] [collectionID=461643160539521273] [2025/10/21 06:52:49.022 +00:00] [INFO] [datacoord/services.go:1055] ["get recovery info request received"] [collectionID=461643160539521273] [partitionIDs="[]"] [2025/10/21 06:52:49.022 +00:00] [INFO] [datacoord/handler.go:209] [GetQueryVChanPositions] [collectionID=461643160539521273] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [numOfSegments=0] ["result flushed"=0] ["result growing"=0] ["result L0"=0] ["partition stats"={}] [2025/10/21 06:52:49.022 +00:00] [INFO] [datacoord/handler.go:471] ["channel seek position set from channel checkpoint meta"] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [posTs=461643335037616132] [posTime=2025/10/21 06:52:47.862 +00:00] [2025/10/21 06:52:49.022 +00:00] [INFO] [datacoord/services.go:1070] ["datacoord append channelInfo in GetRecoveryInfo"] [collectionID=461643160539521273] [partitionIDs="[]"] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] ["# of unflushed segments"=0] ["# of flushed segments"=0] ["# of dropped segments"=0] ["# of indexed segments"=0] ["# of l0 segments"=0] ["# of check point"=2025/10/21 06:52:47.862 +00:00] ["# of delete check point"=2025/10/21 06:52:47.862 +00:00] [2025/10/21 06:52:49.221 +00:00] [INFO] [observers/collection_observer.go:401] ["partition load status updated"] [collectionID=461643160539521273] [partitionID=461643160539521274] [partitionLoadPercentage=100] [subChannelCount=1] [loadSegmentCount=0] [2025/10/21 06:52:49.221 +00:00] [INFO] [observers/collection_observer.go:417] ["collection load status updated"] [collectionID=461643160539521273] [collectionLoadPercentage=100] [2025/10/21 06:52:49.221 +00:00] [INFO] [proxy/impl.go:125] ["received request to invalidate collection meta cache"] [traceID=25973f7c364b553986915f7e3aae5626] [module=Proxy] [role=proxy] [db=] [collectionName=] [collectionID=461643160539521273] [msgType=LoadCollection] [partitionName=] [2025/10/21 06:52:49.222 +00:00] [INFO] [proxy/meta_cache.go:1100] ["deprecate shard cache for collection"] [collectionName=open_webui_file_2300e9cc_ef9d_4c0e_85e7_f9e581df1d5a] [2025/10/21 06:52:49.222 +00:00] [INFO] [proxy/impl.go:155] ["complete to invalidate collection meta cache"] [traceID=25973f7c364b553986915f7e3aae5626] [module=Proxy] [role=proxy] [db=] [collectionName=] [collectionID=461643160539521273] [msgType=LoadCollection] [partitionName=] [type=LoadCollection] [2025/10/21 06:52:49.222 +00:00] [INFO] [proxy/impl.go:209] ["complete to invalidate collection meta cache"] [traceID=25973f7c364b553986915f7e3aae5626] [module=Proxy] [role=proxy] [db=] [collectionName=] [collectionID=461643160539521273] [msgType=LoadCollection] [partitionName=] [2025/10/21 06:52:49.222 +00:00] [INFO] [observers/collection_observer.go:306] ["Load task finish"] [traceID=42479141a8136552017e5066fc480c8e] [collectionID=461643160539521273] [partitionIDs="[]"] [loadType=LoadCollection] [2025/10/21 06:52:49.222 +00:00] [INFO] [observers/collection_observer.go:314] ["observe collection done"] [collectionID=461643160539521273] [dur=1.827883ms] [2025/10/21 06:52:49.222 +00:00] [INFO] [observers/collection_observer.go:319] ["observe all collections done"] [num=1] [dur=1.852068ms] [2025/10/21 06:52:49.222 +00:00] [INFO] [balance/score_based_balancer.go:644] ["node channel workload status"] [collectionID=461643160539521273] [replicaID=461643160542773251] [nodes="[\"{NodeID: 1, AssignedScore: 23.000000, CurrentScore: 23.000000, Priority: 0}\"]"] [2025/10/21 06:52:49.222 +00:00] [INFO] [balance/score_based_balancer.go:575] ["node segment workload status"] [collectionID=461643160539521273] [replicaID=461643160542773251] [nodes="[\"{NodeID: 1, AssignedScore: 0.000000, CurrentScore: 0.000000, Priority: 0}\"]"] [2025/10/21 06:52:49.302 +00:00] [INFO] [task/scheduler.go:1027] ["task removed"] [taskID=1761028902221] [collectionID=461643160539521273] [replicaID=461643160542773251] [status=succeeded] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [2025/10/21 06:52:49.302 +00:00] [INFO] [observers/leader_cache_observer.go:79] ["receive event, trigger leader cache update"] [event=461643160539521273] [2025/10/21 06:52:49.303 +00:00] [INFO] [task/scheduler.go:820] ["processed tasks"] [nodeID=1] [toProcessNum=0] [committedNum=0] [toRemoveNum=1] [promoteDur=3.52µs] [preprocessDUr=8.81µs] [processDUr=4.999µs] [totalDur=123.188µs] [2025/10/21 06:52:49.303 +00:00] [INFO] [task/scheduler.go:830] ["process tasks related to node done"] [nodeID=1] [processingTaskNum=0] [waitingTaskNum=0] [segmentTaskNum=0] [channelTaskNum=0] [2025/10/21 06:52:49.303 +00:00] [INFO] [proxy/impl.go:227] ["received request to invalidate shard leader cache"] [traceID=b10fccc002acfc70d047c6e94a52cc1f] [module=Proxy] [role=proxy] [collectionIDs="[461643160539521273]"] [2025/10/21 06:52:49.303 +00:00] [INFO] [proxy/meta_cache.go:1114] ["Invalidate shard cache for collections"] [collectionIDs="[461643160539521273]"] [2025/10/21 06:52:49.303 +00:00] [INFO] [proxy/impl.go:232] ["complete to invalidate shard leader cache"] [traceID=b10fccc002acfc70d047c6e94a52cc1f] [module=Proxy] [role=proxy] [collectionIDs="[461643160539521273]"] [2025/10/21 06:52:49.419 +00:00] [INFO] [proxy/meta_cache.go:529] ["meta update success"] [clientRequestUnixmsec=1761029569417] [traceID=676a75e73c31239fd487e4a3b417431d] [database=default] [collectionName=open_webui_file_2300e9cc_ef9d_4c0e_85e7_f9e581df1d5a] ["actual collection Name"=open_webui_file_2300e9cc_ef9d_4c0e_85e7_f9e581df1d5a] [collectionID=461643160539521273] [partition="[_default]"] [currentVersion=461643335037617133] [version=461643335443939330] [aliases="[]"] [2025/10/21 06:52:49.428 +00:00] [INFO] [shards/segment_alloc_worker.go:95] ["append create segment message"] [module=streamingnode] [component=shard-manager] [pchannel=by-dev-rootcoord-dml_2:rw@2] [vchannel=by-dev-rootcoord-dml_2_461643160539521273v0] [collectionID=461643160539521273] [partitionID=461643160539521274] [message="{type=CreateSegment,vchannel=by-dev-rootcoord-dml_2_461643160539521273v0,timetick=461643335430832146,size=0,collectionID=461643160539521273,segmentID=461643160538520110,lv=2}"] [messageID=461643160697700358] [timetick=461643335430832146] [2025/10/21 06:52:49.599 +00:00] [INFO] [recovery/recovery_storage_impl.go:366] ["create segment"] [module=streamingnode] [nodeID=1] [component=recovery-storage] [channel=by-dev-rootcoord-dml_2:rw@2] [state=working] [message="{type=CreateSegment,vchannel=by-dev-rootcoord-dml_2_461643160539521273v0,timetick=461643335430832146,messageID=461643160697700358,lastConfirmed=461643160697700355,size=0,collectionID=461643160539521273,segmentID=461643160538520110,lv=2}"] [2025/10/21 06:52:49.600 +00:00] [INFO] [pipeline/flow_graph_dd_node.go:243] ["receive create segment message"] [vchannel=ddNode-by-dev-rootcoord-dml_2_461643160539521273v0] [msgType=407] [timetick=461643335430832146] [2025/10/21 06:52:49.600 +00:00] [INFO] [datacoord/meta.go:557] ["meta update: adding segment - Start"] [traceID=74b23e351259fa8bcfc7ceda1c386821] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [segmentID=461643160538520110] I20251021 06:52:49.600895 76 IndexConfigGenerator.cpp:79] [SERVER][VecIndexConfig][CGO_DYN][]VecIndexConfig: origin_index_type=HNSW, index_type=IVF_FLAT_CC, metric_type=COSINE, config={"metric_type":"COSINE","nlist":"128","refine_type":0,"ssize":"48","sub_dim":4} I20251021 06:52:49.601094 76 index_factory.cc:55] [KNOWHERE][Create][CGO_DYN] use key IVF_FLAT_CC_fp32 to create knowhere index IVF_FLAT_CC with version 8 [2025/10/21 06:52:49.601 +00:00] [INFO] [segments/segment.go:378] ["create segment done"] [collectionID=461643160539521273] [partitionID=461643160539521274] [segmentID=461643160538520110] [segmentType=Growing] [level=L1] [2025/10/21 06:52:49.601 +00:00] [INFO] [datacoord/meta.go:573] ["meta update: adding segment - complete"] [traceID=74b23e351259fa8bcfc7ceda1c386821] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [segmentID=461643160538520110] [2025/10/21 06:52:49.601 +00:00] [INFO] [datacoord/segment_manager.go:438] ["datacoord: estimateTotalRows: "] [CollectionID=461643160539521273] [SegmentID=461643160538520110] [Channel=by-dev-rootcoord-dml_2_461643160539521273v0] [IsCreatedByStreaming=true] [2025/10/21 06:52:49.601 +00:00] [INFO] [flusherimpl/msg_handler_impl.go:87] ["alloc growing segment at datacoord"] [collectionID=461643160539521273] [partitionID=461643160539521274] [segmentID=461643160538520110] [2025/10/21 06:52:49.601 +00:00] [INFO] [writebuffer/write_buffer.go:518] ["add growing segment"] [segmentID=461643160538520110] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] ["storage version"=2] [2025/10/21 06:52:49.601 +00:00] [INFO] [flusherimpl/msg_handler_impl.go:55] ["create new growing segment"] [2025/10/21 06:52:49.601 +00:00] [INFO] [pipeline/flow_graph_dd_node.go:247] ["handle create segment message success"] [vchannel=ddNode-by-dev-rootcoord-dml_2_461643160539521273v0] [msgType=407] [timetick=461643335430832146] [2025/10/21 06:52:49.602 +00:00] [INFO] [delegator/delegator_data.go:342] ["add growing segments to delegator"] [collectionID=461643160539521273] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [replicaID=461643160542773251] [segmentIDs="[461643160538520110]"] [2025/10/21 06:52:49.602 +00:00] [INFO] [delegator/delegator_data.go:173] ["insert into growing segment"] [collectionID=461643160539521273] [channel=by-dev-rootcoord-dml_2_461643160539521273v0] [replicaID=461643160542773251] [collectionID=461643160539521273] [segmentID=461643160538520110] [rowCount=2] [maxTimestamp=461643335430832147] [2025/10/21 06:52:49.899 +00:00] [INFO] [proxy/impl.go:5897] ["connect received"] [traceID=2186dc8423ac182ca30f204fdd69f97b] [sdk_type=Python] [sdk_version=2.6.2] [local_time="2025-10-21 06:52:49.899041"] [user=] [host=8b5a629ad17b] [db=default] [2025/10/21 06:52:49.900 +00:00] [INFO] [rootcoord/root_coord.go:914] ["received request to list databases"] [traceID=2186dc8423ac182ca30f204fdd69f97b] [msgID=0] [2025/10/21 06:52:49.900 +00:00] [INFO] [rootcoord/root_coord.go:940] ["done to list databases"] [traceID=2186dc8423ac182ca30f204fdd69f97b] [msgID=0] ["num of databases"=1] [2025/10/21 06:52:49.901 +00:00] [INFO] [connection/manager.go:106] ["client register"] [traceID=2186dc8423ac182ca30f204fdd69f97b] [sdk_type=Python] [sdk_version=2.6.2] [local_time="2025-10-21 06:52:49.899041"] [user=] [host=8b5a629ad17b] [identifier=461643335561904130] [last_active_time=2025/10/21 06:52:49.901 +00:00] [2025/10/21 06:52:49.905 +00:00] [INFO] [proxy/impl.go:715] ["LoadCollection received"] [clientRequestUnixmsec=1761029569904] [traceID=8c934ae5ec3ef6fbd7a3b9f3e7b29260] [role=proxy] [db=default] [collection=open_webui_file_2300e9cc_ef9d_4c0e_85e7_f9e581df1d5a] [refreshMode=false] [2025/10/21 06:52:49.906 +00:00] [INFO] [proxy/task.go:2106] ["send LoadCollectionRequest to query coordinator"] [clientRequestUnixmsec=1761029569904] [traceID=8c934ae5ec3ef6fbd7a3b9f3e7b29260] [role=proxy] [collectionID=461643160539521273] [schema="name:\"open_webui_file_2300e9cc_ef9d_4c0e_85e7_f9e581df1d5a\" fields:{fieldID:100 name:\"id\" is_primary_key:true data_type:VarChar type_params:{key:\"max_length\" value:\"65535\"}} fields:{fieldID:101 name:\"vector\" description:\"vector\" data_type:FloatVector type_params:{key:\"dim\" value:\"1024\"}} fields:{fieldID:102 name:\"data\" description:\"data\" data_type:JSON} fields:{fieldID:103 name:\"metadata\" description:\"metadata\" data_type:JSON} fields:{fieldID:104 name:\"$meta\" description:\"dynamic schema\" data_type:JSON is_dynamic:true} enable_dynamic_field:true properties:{key:\"collection.timezone\" value:\"UTC\"}"] [priority=0] [2025/10/21 06:52:49.906 +00:00] [INFO] [querycoordv2/services.go:204] ["load collection request received"] [traceID=8c934ae5ec3ef6fbd7a3b9f3e7b29260] [collectionID=461643160539521273] [replicaNumber=0] [resourceGroups="[]"] [refreshMode=false] [schema="name:\"open_webui_file_2300e9cc_ef9d_4c0e_85e7_f9e581df1d5a\" fields:{fieldID:100 name:\"id\" is_primary_key:true data_type:VarChar type_params:{key:\"max_length\" value:\"65535\"}} fields:{fieldID:101 name:\"vector\" description:\"vector\" data_type:FloatVector type_params:{key:\"dim\" value:\"1024\"}} fields:{fieldID:102 name:\"data\" description:\"data\" data_type:JSON} fields:{fieldID:103 name:\"metadata\" description:\"metadata\" data_type:JSON} fields:{fieldID:104 name:\"$meta\" description:\"dynamic schema\" data_type:JSON is_dynamic:true} enable_dynamic_field:true properties:{key:\"collection.timezone\" value:\"UTC\"}"] [fieldIndexes="[461643160539521278]"] [2025/10/21 06:52:49.906 +00:00] [INFO] [rootcoord/root_coord.go:2998] ["received request to describe database "] [traceID=8c934ae5ec3ef6fbd7a3b9f3e7b29260] [dbName=default] [2025/10/21 06:52:49.906 +00:00] [INFO] [rootcoord/root_coord.go:3022] ["done to describe database"] [traceID=8c934ae5ec3ef6fbd7a3b9f3e7b29260] [dbName=default] [ts=461643335561904133] [2025/10/21 06:52:49.906 +00:00] [INFO] [querycoordv2/services.go:247] ["request doesn't indicate the number of replicas, set it to 1"] [traceID=8c934ae5ec3ef6fbd7a3b9f3e7b29260] [collectionID=461643160539521273] [replicaNumber=0] [resourceGroups="[]"] [refreshMode=false] [2025/10/21 06:52:49.907 +00:00] [INFO] [querycoordv2/services.go:252] ["request doesn't indicate the resource groups, set it to __default_resource_group"] [traceID=8c934ae5ec3ef6fbd7a3b9f3e7b29260] [collectionID=461643160539521273] [replicaNumber=0] [resourceGroups="[]"] [refreshMode=false] [2025/10/21 06:52:49.907 +00:00] [INFO] [job/scheduler.go:150] ["start to pre-execute job"] [traceID=8c934ae5ec3ef6fbd7a3b9f3e7b29260] [collectionID=461643160539521273] [2025/10/21 06:52:49.907 +00:00] [INFO] [job/scheduler.go:158] ["start to execute job"] [traceID=8c934ae5ec3ef6fbd7a3b9f3e7b29260] [collectionID=461643160539521273] [2025/10/21 06:52:49.907 +00:00] [INFO] [meta/failed_load_cache.go:107] ["FailedLoadCache removes cache"] [collectionID=461643160539521273] [2025/10/21 06:52:49.907 +00:00] [INFO] [job/scheduler.go:144] ["start to post-execute job"] [traceID=8c934ae5ec3ef6fbd7a3b9f3e7b29260] [collectionID=461643160539521273] [2025/10/21 06:52:49.907 +00:00] [INFO] [job/scheduler.go:146] ["job finished"] [traceID=8c934ae5ec3ef6fbd7a3b9f3e7b29260] [collectionID=461643160539521273] [2025/10/21 06:52:49.912 +00:00] [WARN] [proxy/util.go:1281] ["no channel ts found, use beginTs instead"] [2025/10/21 06:52:50.015 +00:00] [INFO] [proxy/impl.go:5897] ["connect received"] [traceID=8b99be003f3327c9a72b3e64e46169e9] [sdk_type=Python] [sdk_version=2.6.2] [local_time="2025-10-21 06:52:50.014479"] [user=] [host=8b5a629ad17b] [db=default] [2025/10/21 06:52:50.015 +00:00] [INFO] [rootcoord/root_coord.go:914] ["received request to list databases"] [traceID=8b99be003f3327c9a72b3e64e46169e9] [msgID=0] [2025/10/21 06:52:50.015 +00:00] [INFO] [rootcoord/root_coord.go:940] ["done to list databases"] [traceID=8b99be003f3327c9a72b3e64e46169e9] [msgID=0] ["num of databases"=1] [2025/10/21 06:52:50.016 +00:00] [INFO] [connection/manager.go:106] ["client register"] [traceID=8b99be003f3327c9a72b3e64e46169e9] [sdk_type=Python] [sdk_version=2.6.2] [local_time="2025-10-21 06:52:50.014479"] [user=] [host=8b5a629ad17b] [identifier=461643335600963586] [last_active_time=2025/10/21 06:52:50.016 +00:00] [2025/10/21 06:52:50.021 +00:00] [INFO] [proxy/impl.go:715] ["LoadCollection received"] [clientRequestUnixmsec=1761029570021] [traceID=3d0775fd870ae62887a6f49d0b81912d] [role=proxy] [db=default] [collection=open_webui_45ca70fe_c9be_4d16_869e_5a88167dcf3d] [refreshMode=false] [2025/10/21 06:52:50.023 +00:00] [INFO] [proxy/task.go:2106] ["send LoadCollectionRequest to query coordinator"] [clientRequestUnixmsec=1761029570021] [traceID=3d0775fd870ae62887a6f49d0b81912d] [role=proxy] [collectionID=461643160539521121] [schema="name:\"open_webui_45ca70fe_c9be_4d16_869e_5a88167dcf3d\" fields:{fieldID:100 name:\"id\" is_primary_key:true data_type:VarChar type_params:{key:\"max_length\" value:\"65535\"}} fields:{fieldID:101 name:\"vector\" description:\"vector\" data_type:FloatVector type_params:{key:\"dim\" value:\"1024\"}} fields:{fieldID:102 name:\"data\" description:\"data\" data_type:JSON} fields:{fieldID:103 name:\"metadata\" description:\"metadata\" data_type:JSON} fields:{fieldID:104 name:\"$meta\" description:\"dynamic schema\" data_type:JSON is_dynamic:true} enable_dynamic_field:true properties:{key:\"collection.timezone\" value:\"UTC\"}"] [priority=0] [2025/10/21 06:52:50.023 +00:00] [INFO] [querycoordv2/services.go:204] ["load collection request received"] [traceID=3d0775fd870ae62887a6f49d0b81912d] [collectionID=461643160539521121] [replicaNumber=0] [resourceGroups="[]"] [refreshMode=false] [schema="name:\"open_webui_45ca70fe_c9be_4d16_869e_5a88167dcf3d\" fields:{fieldID:100 name:\"id\" is_primary_key:true data_type:VarChar type_params:{key:\"max_length\" value:\"65535\"}} fields:{fieldID:101 name:\"vector\" description:\"vector\" data_type:FloatVector type_params:{key:\"dim\" value:\"1024\"}} fields:{fieldID:102 name:\"data\" description:\"data\" data_type:JSON} fields:{fieldID:103 name:\"metadata\" description:\"metadata\" data_type:JSON} fields:{fieldID:104 name:\"$meta\" description:\"dynamic schema\" data_type:JSON is_dynamic:true} enable_dynamic_field:true properties:{key:\"collection.timezone\" value:\"UTC\"}"] [fieldIndexes="[461643160539521126]"] [2025/10/21 06:52:50.024 +00:00] [INFO] [rootcoord/root_coord.go:2998] ["received request to describe database "] [traceID=3d0775fd870ae62887a6f49d0b81912d] [dbName=default] [2025/10/21 06:52:50.024 +00:00] [INFO] [rootcoord/root_coord.go:3022] ["done to describe database"] [traceID=3d0775fd870ae62887a6f49d0b81912d] [dbName=default] [ts=461643335600963589] [2025/10/21 06:52:50.024 +00:00] [INFO] [querycoordv2/services.go:247] ["request doesn't indicate the number of replicas, set it to 1"] [traceID=3d0775fd870ae62887a6f49d0b81912d] [collectionID=461643160539521121] [replicaNumber=0] [resourceGroups="[]"] [refreshMode=false] [2025/10/21 06:52:50.024 +00:00] [INFO] [querycoordv2/services.go:252] ["request doesn't indicate the resource groups, set it to __default_resource_group"] [traceID=3d0775fd870ae62887a6f49d0b81912d] [collectionID=461643160539521121] [replicaNumber=0] [resourceGroups="[]"] [refreshMode=false] [2025/10/21 06:52:50.024 +00:00] [INFO] [job/scheduler.go:150] ["start to pre-execute job"] [traceID=3d0775fd870ae62887a6f49d0b81912d] [collectionID=461643160539521121] [2025/10/21 06:52:50.024 +00:00] [INFO] [job/scheduler.go:158] ["start to execute job"] [traceID=3d0775fd870ae62887a6f49d0b81912d] [collectionID=461643160539521121] [2025/10/21 06:52:50.024 +00:00] [INFO] [meta/failed_load_cache.go:107] ["FailedLoadCache removes cache"] [collectionID=461643160539521121] [2025/10/21 06:52:50.024 +00:00] [INFO] [job/scheduler.go:144] ["start to post-execute job"] [traceID=3d0775fd870ae62887a6f49d0b81912d] [collectionID=461643160539521121] [2025/10/21 06:52:50.024 +00:00] [INFO] [job/scheduler.go:146] ["job finished"] [traceID=3d0775fd870ae62887a6f49d0b81912d] [collectionID=461643160539521121] [2025/10/21 06:52:50.030 +00:00] [WARN] [proxy/util.go:1281] ["no channel ts found, use beginTs instead"] [2025/10/21 06:52:51.214 +00:00] [WARN] [datacoord/meta.go:501] ["not found database name"] [collectionID=461643160539521273] [2025/10/21 06:52:52.221 +00:00] [INFO] [observers/target_observer.go:526] ["Update readable segment version"] [collectionID=461643160538320086] [channelName=by-dev-rootcoord-dml_0_461643160538320086v0] [nodeID=1] [oldVersion=1761029552222834327] [newVersion=1761029562221866209] ``` ### Additional Information _No response_

GiteaMirror added the bug label 2025-11-11 17:04:18 -06:00

GiteaMirror closed this issue

2025-11-11 17:04:18 -06:00

GiteaMirror commented

2025-11-11 17:04:19 -06:00

@Classic298 commented on GitHub (Oct 21, 2025):

Duplicate of #17088 and https://github.com/open-webui/open-webui/discussions/18119

@Classic298 commented on GitHub (Oct 21, 2025): Duplicate of #17088 and https://github.com/open-webui/open-webui/discussions/18119

GiteaMirror commented

2025-11-11 17:04:19 -06:00

@Classic298 commented on GitHub (Oct 21, 2025):

Possible Fix here, testing wanted: https://github.com/open-webui/open-webui/pull/17938