From 1463ba82867787ce8eb3f83a10deb3a70a1e401d Mon Sep 17 00:00:00 2001 From: Vinta Chen Date: Sat, 15 Aug 2026 23:57:39 +0800 Subject: [PATCH] prune: sweep Data Analysis to the shortlist cap MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Per ADR-0001, maintainer-adjudicated at the Data & Science preview review (2026-08-15, all rows live-verified). Keeps: pandas and polars as Obvious Choices, ibis as Challenger — renamed to ibis-framework per the PyPI-name convention (maintainer-confirmed; bare 'ibis' on PyPI is an unrelated template engine). aws-sdk-pandas returns as a sub-item under pandas per maintainer direction (sub-items sit outside the cap, awesome-pytest pattern). Removed (downloads are PyPI last-30-days via BigQuery, 2026-08-15): - data-profiling (18.2K/month under fg-data-profiling): YData's profiler, but the listed name is not on PyPI and a profiling layer is not an obvious choice for this use case - datasette (178.6K/month): data publishing and exploration tool, a different job - desbordante (3.4K/month): no adoption - modin (1.6M/month): the pandas-at-scale job moved to polars and dask; repo quiet since 2026-02 - pathway (16.5K/month): stars far ahead of usage (62.5K stars); ETL job, mis-homed here - percentify (182.2K/month): personal project, 11-month-old repo, 418 stars — count not credible against the footprint Co-Authored-By: Claude --- README.md | 12 ++---------- 1 file changed, 2 insertions(+), 10 deletions(-) diff --git a/README.md b/README.md index 19515899..605c073c 100644 --- a/README.md +++ b/README.md @@ -480,18 +480,10 @@ _Libraries for serializing complex data types._ _Libraries for data analysis._ -- [aws-sdk-pandas](https://github.com/aws/aws-sdk-pandas) - Pandas on AWS. -- [data-profiling](https://github.com/Data-Centric-AI-Community/fg-data-profiling) - Generate detailed data profiling reports for pandas DataFrames. -- [datasette](https://github.com/simonw/datasette) - An open source multi-tool for exploring and publishing data. -- [desbordante](https://github.com/desbordante/desbordante-core/) - An open source data profiler for complex pattern discovery. -- [ibis](https://github.com/ibis-project/ibis) - A portable Python dataframe library with a single API for 20+ backends. -- [modin](https://github.com/modin-project/modin) - A drop-in pandas replacement that scales workflows by changing a single line of code. - [pandas](https://github.com/pandas-dev/pandas) - A library providing high-performance, easy-to-use data structures and data analysis tools. -- [pathway](https://github.com/pathwaycom/pathway) - Real-time data processing framework for Python with reactive dataflows. - -- [percentify](https://github.com/data-centt/percentify) - Exploratory stats and data-quality diagnostics/profiler, that supports both pandas and Polars DataFrames inputs. - + - [aws-sdk-pandas](https://github.com/aws/aws-sdk-pandas) - [polars](https://github.com/pola-rs/polars) - A fast DataFrame library implemented in Rust with a Python API. +- [ibis-framework](https://github.com/ibis-project/ibis) - A portable Python dataframe library with a single API for 20+ backends. ### Data Ingestion / ETL