Ignore some file types for knowledge directory sync #4102

New Issue

GiteaMirror · 2025-11-11T15:46:05-06:00

GiteaMirror commented

2025-11-11 15:46:05 -06:00

Originally created by @step21 on GitHub (Feb 24, 2025).

Feature Request

Is your feature request related to a problem? Please describe.
When adding large, heterogenuous knowledge bases such as Zotero folders, some files, like css and js files from website snapshots should never be indexed. They will only take up space and not contain any useful information. Due to the size of the folders, it is impractical to copy files one by one or delete them after.

Describe the solution you'd like
Either accept a list of file types to exclude, or alternatively support a .ragignore style file in the synced directory, like suggested here https://github.com/open-webui/open-webui/discussions/9051

Describe alternatives you've considered
Deleting files after the fact and copying files somewhere else first. Both of these have obvious drawbacks. Deleting files after the fact is very tedious and wastes time on import. Copying only relevant files somewhere else first would be faster, but would f.e. take up a lot of space and not be able to sync later.

Additional context
Add any other context or screenshots about the feature request here.

Originally created by @step21 on GitHub (Feb 24, 2025). # Feature Request **Is your feature request related to a problem? Please describe.** When adding large, heterogenuous knowledge bases such as Zotero folders, some files, like css and js files from website snapshots should never be indexed. They will only take up space and not contain any useful information. Due to the size of the folders, it is impractical to copy files one by one or delete them after. **Describe the solution you'd like** Either accept a list of file types to exclude, or alternatively support a .ragignore style file in the synced directory, like suggested here https://github.com/open-webui/open-webui/discussions/9051 **Describe alternatives you've considered** Deleting files after the fact and copying files somewhere else first. Both of these have obvious drawbacks. Deleting files after the fact is very tedious and wastes time on import. Copying only relevant files somewhere else first would be faster, but would f.e. take up a lot of space and not be able to sync later. **Additional context** Add any other context or screenshots about the feature request here.

GiteaMirror closed this issue