gobblin by apache

A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.

created at Dec. 1, 2014, 6:10 p.m.

165 +0

2,228 +0

751 +1

elasticsearch-hadoop by elastic

Elasticsearch real-time search and analytics natively integrated with Hadoop

created at March 11, 2013, 6:57 p.m.

180 +1

9 +0

990 +0

elephant-bird by twitter

Twitter's collection of LZO and Protocol Buffer-related Hadoop, Pig, Hive, and HBase code.

created at March 25, 2010, 1:49 a.m.

188 +0

1,138 +0

387 +0

banana by lucidworks

Banana for Solr - A Port of Kibana

created at Nov. 21, 2013, 5:30 p.m.

199 +0

668 +0

235 +0

registry by hortonworks

Schema Registry

created at Oct. 26, 2016, 8:28 a.m.

206 +0

15 +0

8 +0

oryx by OryxProject

Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning

created at July 25, 2014, 8:08 p.m.

208 +0

1,788 +0

405 +0

YCSB by brianfrankcooper

Yahoo! Cloud Serving Benchmark

created at April 19, 2010, 8:52 p.m.

213 -1

4,955 +5

2,252 +4

Hive-Extensions-from-Think-Big-Analytics by ThinkBigAnalytics

Reusable code for Hive

created at April 6, 2011, 1:45 a.m.

315 +0

16 +0

14 +0

schema-registry by confluentinc

Confluent Schema Registry for Kafka

created at Dec. 9, 2014, 10:38 p.m.

379 +0

2,225 +1

1,114 +1

inviso by Netflix

None

created at July 29, 2014, 7:28 p.m.

462 +1

205 +0

65 +0

PigPen by Netflix

Map-Reduce for Clojure

created at Dec. 12, 2013, 10:56 p.m.

475 +1

567 +0

55 +0

Lipstick by Netflix

Pig Visualization framework

created at May 21, 2013, 6:56 p.m.

499 +1

464 +0

131 +0

suro by Netflix

Netflix's distributed Data Pipeline

created at March 20, 2013, 9:02 p.m.

514 +1

794 +0

171 +0

genie by Netflix

Distributed Big Data Orchestration Service

created at June 20, 2013, 8:35 p.m.

528 +1

1,716 +0

369 +0

airflow by apache

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

created at April 13, 2015, 6:04 p.m.

760 +2

37,126 +88

14,306 +25