It's a framework for scraping HTML sites, and aggregating data from multiple sites from a same category (e.g. banking sites, news sites, video sites, etc.).
There are ready-made modules for popular websites and ready-apps to interact with them.
Think youtube-dl applied to other domains than video!
What's the difference between this Python project and similar ones?
It's possible to scrape new websites with declarative-style extraction rules
It provides a standardized API for categories of sites for dedicated tasks (e.g. banking, web forums, video sites, news sites, music lyrics sites, etc.)
Scraped websites are grouped in those categories
Scraped websites are grouped in categories for a dedicated task:
The project comes with many existing backends for real-life websites
It has an internal upgrade system
🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.
## 📋 Pull Request Information
**Original PR:** https://github.com/vinta/awesome-python/pull/1441
**Author:** [@hydrargyrum](https://github.com/hydrargyrum)
**Created:** 11/29/2019
**Status:** ❌ Closed
**Base:** `master` ← **Head:** `patch-1`
---
### 📝 Commits (1)
- [`74c4407`](https://github.com/vinta/awesome-python/commit/74c4407db6a086398c12b21a1500ee99fa63b27f) Add weboob to Web Crawling section
### 📊 Changes
**1 file changed** (+1 additions, -0 deletions)
<details>
<summary>View changed files</summary>
📝 `README.md` (+1 -0)
</details>
### 📄 Description
## What is this Python project?
It's a framework for scraping HTML sites, and aggregating data from multiple sites from a same category (e.g. banking sites, news sites, video sites, etc.).
There are ready-made modules for popular websites and ready-apps to interact with them.
Think youtube-dl applied to other domains than video!
## What's the difference between this Python project and similar ones?
* It's possible to scrape new websites with declarative-style extraction rules
* It provides a standardized API for categories of sites for dedicated tasks (e.g. banking, web forums, video sites, news sites, music lyrics sites, etc.)
* Scraped websites are grouped in those categories
* Scraped websites are grouped in categories for a dedicated task:
* The project comes with many existing backends for real-life websites
* It has an internal upgrade system
---
<sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
📋 Pull Request Information
Original PR: https://github.com/vinta/awesome-python/pull/1441
Author: @hydrargyrum
Created: 11/29/2019
Status: ❌ Closed
Base:
master← Head:patch-1📝 Commits (1)
74c4407Add weboob to Web Crawling section📊 Changes
1 file changed (+1 additions, -0 deletions)
View changed files
📝
README.md(+1 -0)📄 Description
What is this Python project?
It's a framework for scraping HTML sites, and aggregating data from multiple sites from a same category (e.g. banking sites, news sites, video sites, etc.).
There are ready-made modules for popular websites and ready-apps to interact with them.
Think youtube-dl applied to other domains than video!
What's the difference between this Python project and similar ones?
🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.