[GH-ISSUE #1581] A web scraper awesome-list? #28975

Closed
opened 2026-05-23 14:42:15 -05:00 by GiteaMirror · 1 comment
Owner

Originally created by @PeskyPotato on GitHub (Jul 6, 2019).
Original GitHub issue: https://github.com/sindresorhus/awesome/issues/1581

I've noticed there is not awesome-list repository for web scrapers/crawlers and wanted to create one.

This one seems to be maintained but is not part of the awesome-list repository but is still a good list. I am aware that it does not meet the contribution requirements here (#675).

I have some resources I've been using and collecting for some time now, is this a good reason to start a new list?

Originally created by @PeskyPotato on GitHub (Jul 6, 2019). Original GitHub issue: https://github.com/sindresorhus/awesome/issues/1581 I've noticed there is not awesome-list repository for web scrapers/crawlers and wanted to create one. [This one](https://github.com/lorien/awesome-web-scraping) seems to be maintained but is not part of the awesome-list repository but is still a good list. I am aware that it does not meet the contribution requirements here (#675). I have some resources I've been using and collecting for some time now, is this a good reason to start a new list?
Author
Owner

@PeskyPotato commented on GitHub (Jul 13, 2019):

Well after 7 days of thought, I have come to the conclusion that awesome-web-scraping and awesome-datahoarding while not part of this awesome-list, are great lists. I'll just contribute to those.

<!-- gh-comment-id:511108763 --> @PeskyPotato commented on GitHub (Jul 13, 2019): Well after 7 days of thought, I have come to the conclusion that [awesome-web-scraping](https://github.com/lorien/awesome-web-scraping) and [awesome-datahoarding](https://github.com/lorien/awesome-web-scraping) while not part of this awesome-list, are great lists. I'll just contribute to those.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/awesome-sindresorhus#28975