airflow by apache

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

created at April 13, 2015, 6:04 p.m.

754 +2

34,425 +83

13,523 +18

YCSB by brianfrankcooper

Yahoo! Cloud Serving Benchmark

created at April 19, 2010, 8:52 p.m.

215 +0

4,791 +3

2,187 +4

gobblin by apache

A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.

created at Dec. 1, 2014, 6:10 p.m.

167 +0

2,190 +0

742 +0

schema-registry by confluentinc

Confluent Schema Registry for Kafka

created at Dec. 9, 2014, 10:38 p.m.

369 +0

2,136 +1

1,097 +0

elasticsearch-hadoop by elastic

Elasticsearch real-time search and analytics natively integrated with Hadoop

created at March 11, 2013, 6:57 p.m.

491 +1

1,925 +3

982 +2

oryx by OryxProject

Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning

created at July 25, 2014, 8:08 p.m.

209 +0

1,786 -1

405 +0

genie by Netflix

Distributed Big Data Orchestration Service

created at June 20, 2013, 8:35 p.m.

519 +1

1,682 +3

363 +1

PyHive by dropbox

Python interface to Hive and Presto. 🐝

created at Feb. 1, 2014, 9:05 a.m.

62 +0

1,665 +2

552 +0

HiBench by Intel-bigdata

HiBench is a big data benchmark suite.

created at June 12, 2012, 7:56 a.m.

126 +0

1,429 +0

757 +2

hdfs by colinmarc

A native go client for HDFS

created at Oct. 8, 2014, 7:37 p.m.

39 +0

1,342 +0

340 +0

elephant-bird by twitter

Twitter's collection of LZO and Protocol Buffer-related Hadoop, Pig, Hive, and HBase code.

created at March 25, 2010, 1:49 a.m.

190 +0

1,137 +0

390 +0

suro by Netflix

Netflix's distributed Data Pipeline

created at March 20, 2013, 9:02 p.m.

506 +1

789 +0

168 +0

banana by lucidworks

Banana for Solr - A Port of Kibana

created at Nov. 21, 2013, 5:30 p.m.

201 +0

670 +0

237 +0

happybase by python-happybase

A developer-friendly Python library to interact with Apache HBase

created at May 20, 2012, 8:06 p.m.

35 +0

609 +0

162 +0

hindex by Huawei-Hadoop

Secondary Index for HBase

created at Aug. 8, 2013, 11:33 a.m.

134 +0

589 +0

289 +0

PigPen by Netflix

Map-Reduce for Clojure

created at Dec. 12, 2013, 10:56 p.m.

464 +1

556 +0

55 +0

Lipstick by Netflix

Pig Visualization framework

created at May 21, 2013, 6:56 p.m.

489 +1

464 +0

132 +0

schema-registry-ui by Landoop

Web tool for Avro Schema Registry |

created at June 12, 2016, 1:01 p.m.

36 +0

414 +0

112 +0

packetpig by packetloop

Packetpig - Open Source Big Data Security Analytics

created at March 7, 2012, 4:03 a.m.

57 +0

298 +0

85 +0

HiveRunner by HiveRunner

An Open Source unit test framework for Hive queries based on JUnit 4 and 5

created at Nov. 22, 2013, 9:19 a.m.

34 +0

252 -1

79 +0