[PR #23805] [CLOSED] fix: add automatic fallback when external document loader fails #131048

Closed
opened 2026-05-21 16:01:05 -05:00 by GiteaMirror · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/open-webui/open-webui/pull/23805
Author: @marceaupatu123
Created: 4/16/2026
Status: Closed

Base: devHead: fix/external-loader-auto-fallback


📝 Commits (10+)

  • acbf058 Add native fallback when external document loader fails
  • 156816f fix: add explicit external loader autofallback warning
  • 9b31e40 fix: clarify external loader fallback warning condition
  • 1e2257d fix: warn on external loader no extractable text fallback
  • 168e761 fix: fallback to native loader on any external extraction error
  • 5ce294a fix(rag): normalize extraction engine for document loader fallback
  • 853e304 fix(rag): centralize external fallback and normalize config
  • a4f09c3 Add has_external_config condition
  • 5ae6581 Copilot suggestions fix
  • 1570f84 Potential fix for pull request finding

📊 Changes

7 files changed (+2923 additions, -42 deletions)

View changed files

📝 backend/open_webui/config.py (+12 -0)
📝 backend/open_webui/main.py (+4 -0)
📝 backend/open_webui/retrieval/loaders/external_document.py (+68 -2)
📝 backend/open_webui/retrieval/loaders/main.py (+81 -7)
backend/open_webui/routers/retrieval.image.latest.py (+2676 -0)
📝 backend/open_webui/routers/retrieval.py (+55 -33)
📝 src/lib/components/admin/Settings/Documents.svelte (+27 -0)

📄 Description

Pull Request Checklist

  • Target branch: Verify that the pull request targets the dev branch. PRs targeting main will be immediately closed.
  • Description: Provide a concise description of the changes made in this pull request down below.
  • Changelog: Ensure a changelog entry following the format of Keep a Changelog is added at the bottom of the PR description.
  • Documentation: Add docs in Open WebUI Docs Repository if needed.
  • Dependencies: No new or upgraded dependencies.
  • Testing: Manual testing performed.
  • Agentic AI Code: Changes went through additional human review and manual testing.
  • Code review: Self-review completed.
  • Design & Architecture: No major architecture/UI change; fallback improves resilience.
  • Git Hygiene: Atomic PR focused on one logical change.
  • Title Prefix: Uses fix: prefix.

Changelog Entry

Description

  • Add automatic fallback from external document loader failures to the default loader path so RAG continues without hard failure.

Added

  • Automatic fallback behavior when external loader errors.

Changed

  • Retrieval loading error path now gracefully degrades to default loader behavior.

Deprecated

  • None.

Removed

  • None.

Fixed

  • Prevents RAG flow from failing entirely when external loader is unavailable or errors.

Security

  • None.

Breaking Changes

  • BREAKING CHANGE: None.

Additional Information

  • Scope intentionally limited to fallback handling for external loader failures.

Screenshots or Videos

  • Not applicable (backend-only change).

Contributor License Agreement


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/open-webui/open-webui/pull/23805 **Author:** [@marceaupatu123](https://github.com/marceaupatu123) **Created:** 4/16/2026 **Status:** ❌ Closed **Base:** `dev` ← **Head:** `fix/external-loader-auto-fallback` --- ### 📝 Commits (10+) - [`acbf058`](https://github.com/open-webui/open-webui/commit/acbf058afed0bd0c3e2e7ee4ed5808bf531a3925) Add native fallback when external document loader fails - [`156816f`](https://github.com/open-webui/open-webui/commit/156816fcb8d3b54e4ca2e49e94987c0e22a916ed) fix: add explicit external loader autofallback warning - [`9b31e40`](https://github.com/open-webui/open-webui/commit/9b31e406a3897cb71a868bba8030e2a67669ec13) fix: clarify external loader fallback warning condition - [`1e2257d`](https://github.com/open-webui/open-webui/commit/1e2257dc65cfd8ae4ed7075d199158c05a0ed35e) fix: warn on external loader no extractable text fallback - [`168e761`](https://github.com/open-webui/open-webui/commit/168e7611240a3b807c152746c5dfd0e80d0cfffd) fix: fallback to native loader on any external extraction error - [`5ce294a`](https://github.com/open-webui/open-webui/commit/5ce294a90455e624a85d94882c4c34465af15b0e) fix(rag): normalize extraction engine for document loader fallback - [`853e304`](https://github.com/open-webui/open-webui/commit/853e30437aaffa77760209f8e8c20c051d719187) fix(rag): centralize external fallback and normalize config - [`a4f09c3`](https://github.com/open-webui/open-webui/commit/a4f09c325076e61666f570c3628a9866c1da1010) Add has_external_config condition - [`5ae6581`](https://github.com/open-webui/open-webui/commit/5ae65813c7544893c06798e2a266969f245a843a) Copilot suggestions fix - [`1570f84`](https://github.com/open-webui/open-webui/commit/1570f8472f4140c8dffd57e3539908cdd761da57) Potential fix for pull request finding ### 📊 Changes **7 files changed** (+2923 additions, -42 deletions) <details> <summary>View changed files</summary> 📝 `backend/open_webui/config.py` (+12 -0) 📝 `backend/open_webui/main.py` (+4 -0) 📝 `backend/open_webui/retrieval/loaders/external_document.py` (+68 -2) 📝 `backend/open_webui/retrieval/loaders/main.py` (+81 -7) ➕ `backend/open_webui/routers/retrieval.image.latest.py` (+2676 -0) 📝 `backend/open_webui/routers/retrieval.py` (+55 -33) 📝 `src/lib/components/admin/Settings/Documents.svelte` (+27 -0) </details> ### 📄 Description # Pull Request Checklist - [x] **Target branch:** Verify that the pull request targets the `dev` branch. **PRs targeting `main` will be immediately closed.** - [x] **Description:** Provide a concise description of the changes made in this pull request down below. - [x] **Changelog:** Ensure a changelog entry following the format of Keep a Changelog is added at the bottom of the PR description. - [x] **Documentation:** Add docs in Open WebUI Docs Repository if needed. - [x] **Dependencies:** No new or upgraded dependencies. - [x] **Testing:** Manual testing performed. - [x] **Agentic AI Code:** Changes went through additional human review and manual testing. - [x] **Code review:** Self-review completed. - [x] **Design & Architecture:** No major architecture/UI change; fallback improves resilience. - [x] **Git Hygiene:** Atomic PR focused on one logical change. - [x] **Title Prefix:** Uses `fix:` prefix. # Changelog Entry ### Description - Add automatic fallback from external document loader failures to the default loader path so RAG continues without hard failure. ### Added - Automatic fallback behavior when external loader errors. ### Changed - Retrieval loading error path now gracefully degrades to default loader behavior. ### Deprecated - None. ### Removed - None. ### Fixed - Prevents RAG flow from failing entirely when external loader is unavailable or errors. ### Security - None. ### Breaking Changes - **BREAKING CHANGE**: None. --- ### Additional Information - Scope intentionally limited to fallback handling for external loader failures. ### Screenshots or Videos - Not applicable (backend-only change). ### Contributor License Agreement - [x] By submitting this pull request, I confirm that I have read and fully agree to the [Contributor License Agreement (CLA)](https://github.com/open-webui/open-webui/blob/main/CONTRIBUTOR_LICENSE_AGREEMENT), and I am providing my contributions under its terms. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
GiteaMirror added the pull-request label 2026-05-21 16:01:05 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#131048