airflow by apache

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

created at April 13, 2015, 6:04 p.m.

Python

760 +2

37,126 +88

14,306 +25

GitHub
genie by Netflix

Distributed Big Data Orchestration Service

created at June 20, 2013, 8:35 p.m.

Java

528 +1

1,716 +0

369 +0

GitHub
suro by Netflix

Netflix's distributed Data Pipeline

created at March 20, 2013, 9:02 p.m.

Java

514 +1

794 +0

171 +0

GitHub
Lipstick by Netflix

Pig Visualization framework

created at May 21, 2013, 6:56 p.m.

JavaScript

499 +1

464 +0

131 +0

GitHub
PigPen by Netflix

Map-Reduce for Clojure

created at Dec. 12, 2013, 10:56 p.m.

Clojure

475 +1

567 +0

55 +0

GitHub
inviso by Netflix

None

created at July 29, 2014, 7:28 p.m.

JavaScript

462 +1

205 +0

65 +0

GitHub
schema-registry by confluentinc

Confluent Schema Registry for Kafka

created at Dec. 9, 2014, 10:38 p.m.

Java

379 +0

2,225 +1

1,114 +1

GitHub
Hive-Extensions-from-Think-Big-Analytics by ThinkBigAnalytics

Reusable code for Hive

created at April 6, 2011, 1:45 a.m.

Java

315 +0

16 +0

14 +0

GitHub
YCSB by brianfrankcooper

Yahoo! Cloud Serving Benchmark

created at April 19, 2010, 8:52 p.m.

Java

213 -1

4,955 +5

2,252 +4

GitHub
oryx by OryxProject

Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning

created at July 25, 2014, 8:08 p.m.

Java

208 +0

1,788 +0

405 +0

GitHub
registry by hortonworks

Schema Registry

created at Oct. 26, 2016, 8:28 a.m.

Java

206 +0

15 +0

8 +0

GitHub
banana by lucidworks

Banana for Solr - A Port of Kibana

created at Nov. 21, 2013, 5:30 p.m.

JavaScript

199 +0

668 +0

235 +0

GitHub
elephant-bird by twitter

Twitter's collection of LZO and Protocol Buffer-related Hadoop, Pig, Hive, and HBase code.

created at March 25, 2010, 1:49 a.m.

Java

188 +0

1,138 +0

387 +0

GitHub
elasticsearch-hadoop by elastic

elephant Elasticsearch real-time search and analytics natively integrated with Hadoop

created at March 11, 2013, 6:57 p.m.

Java

180 +1

9 +0

990 +0

GitHub
gobblin by apache

A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.

created at Dec. 1, 2014, 6:10 p.m.

Java

165 +0

2,228 +0

751 +1

GitHub
hdfs-du by twitter-archive

Visualize your HDFS cluster usage

created at Aug. 7, 2012, 5:52 p.m.

JavaScript

137 +0

230 +0

83 +0

GitHub
hindex by Huawei-Hadoop

Secondary Index for HBase

created at Aug. 8, 2013, 11:33 a.m.

Java

134 +0

591 +0

286 +0

GitHub
HiBench by Intel-bigdata

HiBench is a big data benchmark suite.

created at June 12, 2012, 7:56 a.m.

Java

126 +0

1,459 +2

768 +2

GitHub
white-elephant by LinkedInAttic

Hadoop log aggregator and dashboard

created at Jan. 24, 2013, 11:26 p.m.

Java

97 +0

192 +0

62 +0

GitHub
HiveSwarm by livingsocial

Helpful user defined fuctions / table generating functions for Hive

created at April 5, 2011, 5:46 p.m.

Java

66 +0

101 +0

46 +0

GitHub