mirror of
https://github.com/open-webui/open-webui.git
synced 2026-07-16 06:03:26 -05:00
Use crawl4ai tool instead of poor web scraping technique #3912
No Assignees
Notifications
Due Date
No due date set.
Dependencies
No dependencies set.
Reference: github-starred/open-webui#3912
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @yossifibrahem on GitHub (Feb 17, 2025).
Feature Request
Important Notes
Is your feature request related to a problem? Please describe.
The web results are poor with no Important details, this is the scraping technique
Describe the solution you'd like
Use tool like: crawl4ai
This tool is Amazing, it is designed to LLMs RAG.
Additional context
just filter the result to remove all the media content and hyperlinks