When using the RAG module, I stored a total of 1300 files, amounting to 90,701,824 characters. During the vector search process (selecting 1300 files for search), an index out-of-bounds bug occurred. The specific error is:
This happens during the vector search on the GPU, and there is still plenty of memory available during the search process.
How is this error triggered, and how can it be resolved?
Originally created by @Belonger on GitHub (Jul 5, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/3637
Description:
When using the RAG module, I stored a total of 1300 files, amounting to 90,701,824 characters. During the vector search process (selecting 1300 files for search), an index out-of-bounds bug occurred. The specific error is:
```
../aten/src/ATen/native/cuda/Indexing.cu:1289: indexSelectLargeIndex: block: [689,0,0], thread: [96,0,0] Assertion `srcIndex < srcSelectDimSize` failed.
../aten/src/ATen/native/cuda/Indexing.cu:1289: indexSelectLargeIndex: block: [689,0,0], thread: [97,0,0] Assertion `srcIndex < srcSelectDimSize` failed.
......
```
This happens during the vector search on the GPU, and there is still plenty of memory available during the search process.
How is this error triggered, and how can it be resolved?
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Originally created by @Belonger on GitHub (Jul 5, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/3637
Description:
When using the RAG module, I stored a total of 1300 files, amounting to 90,701,824 characters. During the vector search process (selecting 1300 files for search), an index out-of-bounds bug occurred. The specific error is:
This happens during the vector search on the GPU, and there is still plenty of memory available during the search process.
How is this error triggered, and how can it be resolved?