[GH-ISSUE #10197] Use crawl4ai tool instead of poor web scraping technique #86544

Closed
opened 2026-05-15 10:53:52 -05:00 by GiteaMirror · 0 comments
Owner

Originally created by @yossifibrahem on GitHub (Feb 17, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/10197

Feature Request

Important Notes

Is your feature request related to a problem? Please describe.
The web results are poor with no Important details, this is the scraping technique

Describe the solution you'd like
Use tool like: crawl4ai
This tool is Amazing, it is designed to LLMs RAG.

Additional context
just filter the result to remove all the media content and hyperlinks

Originally created by @yossifibrahem on GitHub (Feb 17, 2025). Original GitHub issue: https://github.com/open-webui/open-webui/issues/10197 # Feature Request ## Important Notes **Is your feature request related to a problem? Please describe.** The web results are poor with no Important details, this is the scraping technique **Describe the solution you'd like** Use tool like: [crawl4ai](https://github.com/unclecode/crawl4ai) This tool is Amazing, it is designed to LLMs RAG. **Additional context** just filter the result to remove all the media content and hyperlinks
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#86544