github-starred/awesome-bigdata
2
0
Fork 0
mirror of https://github.com/oxnr/awesome-bigdata.git synced 2026-07-10 17:55:45 -05:00
Code Issues 470 Packages Projects Releases Wiki Activity

Add Spotify Luigi

Browse Source
This commit is contained in:
Nikolay Petrachkov
2014-07-23 10:27:42 +04:00
parent 971b9b0a50
commit 64b1b750d1
1 changed files with 1 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
README.md
View File

@@ -232,6 +232,7 @@ Your contributions are always welcome!
* [Linkedin Norbert](http://data.linkedin.com/opensource/norbert) - cluster manager.
* [OpenMPI](http://www.open-mpi.org/) - message passing framework.
* [Serf](http://www.serfdom.io/) - decentralized solution for service discovery and orchestration.
* [Spotify Luigi] (https://github.com/spotify/luigi) - a Python package for building complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization, handling failures, command line integration, and much more.
* [Spring XD](https://github.com/spring-projects/spring-xd) - distributed and extensible system for data ingestion, real time analytics, batch processing, and data export.
* [Twitter Elephant Bird](https://github.com/kevinweil/elephant-bird) - libraries for working with LZOP-compressed data.
* [Twitter Finagle](https://twitter.github.io/finagle/) - asynchronous network stack for the JVM.