airflow by apache

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

created at April 13, 2015, 6:04 p.m.

755 +2

34,583 +70

13,573 +23

genie by Netflix

Distributed Big Data Orchestration Service

created at June 20, 2013, 8:35 p.m.

521 +1

1,681 -1

365 +0

suro by Netflix

Netflix's distributed Data Pipeline

created at March 20, 2013, 9:02 p.m.

508 +1

789 +0

168 +0

Lipstick by Netflix

Pig Visualization framework

created at May 21, 2013, 6:56 p.m.

491 +1

465 +0

132 +0

elasticsearch-hadoop by elastic

Elasticsearch real-time search and analytics natively integrated with Hadoop

created at March 11, 2013, 6:57 p.m.

490 +0

1,924 -1

981 +0

PigPen by Netflix

Map-Reduce for Clojure

created at Dec. 12, 2013, 10:56 p.m.

466 +1

558 +1

55 +0

inviso by Netflix

None

created at July 29, 2014, 7:28 p.m.

456 +1

205 +0

72 +0

schema-registry by confluentinc

Confluent Schema Registry for Kafka

created at Dec. 9, 2014, 10:38 p.m.

368 +0

2,139 +1

1,101 +2

Hive-Extensions-from-Think-Big-Analytics by ThinkBigAnalytics

Reusable code for Hive

created at April 6, 2011, 1:45 a.m.

316 +0

16 +0

14 +0

YCSB by brianfrankcooper

Yahoo! Cloud Serving Benchmark

created at April 19, 2010, 8:52 p.m.

215 +0

4,803 +4

2,194 +2

oryx by OryxProject

Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning

created at July 25, 2014, 8:08 p.m.

209 +0

1,788 +1

405 +0

registry by hortonworks

Schema Registry

created at Oct. 26, 2016, 8:28 a.m.

203 +0

12 +0

7 +0

banana by lucidworks

Banana for Solr - A Port of Kibana

created at Nov. 21, 2013, 5:30 p.m.

201 +0

670 +0

237 +0

elephant-bird by twitter

Twitter's collection of LZO and Protocol Buffer-related Hadoop, Pig, Hive, and HBase code.

created at March 25, 2010, 1:49 a.m.

190 +0

1,137 +0

390 +0

gobblin by apache

A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.

created at Dec. 1, 2014, 6:10 p.m.

167 +0

2,190 +0

742 +0

hdfs-du by twitter-archive

Visualize your HDFS cluster usage

created at Aug. 7, 2012, 5:52 p.m.

138 +0

231 +0

87 +0

hindex by Huawei-Hadoop

Secondary Index for HBase

created at Aug. 8, 2013, 11:33 a.m.

134 +0

589 +0

289 +0

HiBench by Intel-bigdata

HiBench is a big data benchmark suite.

created at June 12, 2012, 7:56 a.m.

126 +0

1,433 +2

756 -1

white-elephant by LinkedInAttic

Hadoop log aggregator and dashboard

created at Jan. 24, 2013, 11:26 p.m.

97 +0

190 +0

63 +0

HiveSwarm by livingsocial

Helpful user defined fuctions / table generating functions for Hive

created at April 5, 2011, 5:46 p.m.

66 +0

101 +0

46 +0