Timothy Jaeryang Baek 4d2f189810 feat: add RAG_RERANKING_BATCH_SIZE configuration option ...

Add configurable reranker batch size (env var RAG_RERANKING_BATCH_SIZE,
default 32) following the same pattern as RAG_EMBEDDING_BATCH_SIZE.

- config.py: PersistentConfig for RAG_RERANKING_BATCH_SIZE
- main.py: import, state init, pass to get_reranking_function
- colbert.py: accept batch_size param in predict() (was hardcoded 32)
- utils.py: get_reranking_function passes batch_size at call time
- retrieval.py: expose in config GET/POST endpoints and ConfigForm
- Documents.svelte: add Reranking Batch Size input in admin settings

Closes #23730

2026-04-17 08:35:45 +09:00

..

loaders

fix(retrieval): offload Loader.load to a worker thread so file uploads stop blocking the event loop (#23705)

2026-04-14 10:55:46 -05:00

models

feat: add RAG_RERANKING_BATCH_SIZE configuration option

2026-04-17 08:35:45 +09:00

vector

chore: format

2026-04-14 17:27:31 -05:00

web

refac

2026-04-13 15:03:22 -05:00

utils.py

feat: add RAG_RERANKING_BATCH_SIZE configuration option

2026-04-17 08:35:45 +09:00