mirror of
https://github.com/open-webui/open-webui.git
synced 2026-05-06 02:48:13 -05:00
[GH-ISSUE #14305] issue: Web Search Error: Incomplete error logging when fetching Tesla.cn with empty error object #17206
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @belugaming on GitHub (May 25, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/14305
Check Existing Issues
Installation Method
Git Clone
Open WebUI Version
0.6.10
Ollama Version (if applicable)
No response
Operating System
macOS sequoia
Browser (if applicable)
Chrome
Confirmation
README.md.Expected Behavior
When the web search function encounters an error while fetching content from a website:
Actual Behavior
The web search function shows a warning with an empty error object when failing to fetch content from Tesla.cn:
- {}(empty object)Steps to Reproduce
- {}Logs & Screenshots
2025-05-25 02:29:43.906 | WARNING | langchain_community.document_loaders.web_base:_fetch_with_rate_limit:271 - Error fetching https://www.tesla.cn/blog, skipping due to continue_on_failure=True - {}
Additional Information
continue_on_failure=Truesetting causes the system to skip failed URLs silently@tth37 commented on GitHub (May 25, 2025):
This functionality is provided by langchain_community, the web loader won't log out error messages when continue on failure is set. Maybe consider creating an issue under langchain project? Or just re-implement the web loader.
@belugaming commented on GitHub (May 25, 2025):
Thanks, my search function doesn't work now
@tth37 commented on GitHub (May 25, 2025):
#14029 #14073 Already fixed in dev, for now just disable ssl validation to avoid the error
@rgaricano commented on GitHub (May 25, 2025):
or just adjust value of WEB_SEARCH_CONCURRENT_REQUESTS env var.
langchain_community.document_loaders.web_base lib is used on web scrap (
82716f3789/backend/open_webui/retrieval/web/utils.py) & it have a parameter(RateLimitMixin) that is dynamically setted based on that env var (82716f3789/backend/open_webui/routers/retrieval.py (L1368))