2020-07-11 19:32:45 -04:00
2020-07-11 19:32:45 -04:00

AWESOME System Design

If you appreciate the content 📖, support projects visibility, give 👍| | 👏

About

A curated list of awesome System Designing articles, videos and resources for distributed computing, AKA Big Data.

Disclaimer: Stars on github does not reflect usage or popularity for every item here listed.

Inspired By Awesome-BigData

Contents

Articles

Books

Videos

Big Data

  • Relational Database Management System

  • NoSQL

Bonus

Articles

Introduction / Interviews

Advanced


Books


Videos

Introduction / Interviews

Advanced

Big Data

Relational Database Management System

Experimental listing. Arrows indicate trending, r/ reddit community size and SO indicates questions asked on StackOverflow.

  • ↗️ MariaDB - [r/ 1.2k 🗣] [SO 8.8k 📚] - MariaDB is a fork of MySQL server.

  • ↘️ MySQL - [r/ 22k 🗣] [SO 603k 📚] - Widely used relational database.

  • ↗️ PostgresSQL - [r/ 14.8k 🗣] [SO 120k 📚] - Relational database that has been gaining popularity.

  • ↘️ SQLite - [r/ 1.2k 🗣] [SO 83k 📚] - Another widely used database that is built into all mobile phones and most computers.

NoSQL

Cache (Key-Value)

  • Apache Ignite [3.3k ] - In memory caching with ACID properties.

  • Couchbase - Inspired by memcached, adding features such as replication and persistance.

  • Oracle Coherence [126 ] - High scaling, low latency in-memory caching.

  • Memcached [10.2k ] - One of the first in-memory caching database, high performing and multi-threaded.

  • Redis [44k ] - Widely used in-memory caching database with many added features such as persistent storage and supporting strings, lists, sets, hashses, streams, bitmaps, etc.

Store (Key-Value)

  • Apple FoundationDB [10k ] - Multi-model (many data types in a single database), ACID key-value store. Easily scalable and fault tolerant.

Document Store

  • CouchDB [4.6k ] - ACID compliant NoSQL document-store DB, provides a RESTful HTTP API for reading and updating database documents.

  • MongoDB - One of the most popular 'NoSQL' database for general purpose.

  • RethinkDB [23.8k ] - Document-store DB.

  • ElasticSearch [49.9k ] - Widely popular 'NoSQL' database for fast and scalable search engines.

Wide Column Store

  • Amazon DynamoDB - Key-Value and Document database, highly performant, scalable and secure.

  • Google Bigtable - Scalable and performant 'NoSQL' database for large analytical and operational workload.

  • Cassandra - Facebook-born project very fast, easily scalable, with option to include consistency with each operation.

  • Scylla [4.9k ] - 'NoSQL' data store using seastar framework, compatible with Cassandra.

  • HBASE [3.6k ] - Modeled after Google's Bigtable and written in Java. Developed as a part of Apache Hadoop project and runs on top of HDFS or Alluxio.

Graph

  • Amazon Neptune - Fast, reliable and fully managed graph database service.

  • ArangoDB [10k ] - Flexible database for documents, key-value, graphs. Uses its own query language, AQL.

  • Neo4j [7.9k ] - Good support for a graph db, ACID compliant and flexible.

Distributed File Systems

  • HDFS - Hadoop File System is a a widely popular choice among its big data competitors, providing high throughput access.

  • Lustre - File system for computer clusters.

  • CephFS - Unified, distributed storage system.

  • GlusterFS - Scale-out NAS file system.

  • MooseFS - POSIX-compliant distributed file system.

  • XtreemFS - Fault tolerant file system.

Data Processing Framework

Description
No description provided
Readme CC0-1.0 1.9 MiB
Languages
Markdown 100%