YCSB by brianfrankcooper

Yahoo! Cloud Serving Benchmark

created at April 19, 2010, 8:52 p.m.

Java

213 -1

4,955 +5

2,252 +4

GitHub
gobblin by apache

A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.

created at Dec. 1, 2014, 6:10 p.m.

Java

165 +0

2,228 +0

751 +1

GitHub
schema-registry by confluentinc

Confluent Schema Registry for Kafka

created at Dec. 9, 2014, 10:38 p.m.

Java

379 +0

2,225 +1

1,114 +1

GitHub
oryx by OryxProject

Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning

created at July 25, 2014, 8:08 p.m.

Java

208 +0

1,788 +0

405 +0

GitHub
genie by Netflix

Distributed Big Data Orchestration Service

created at June 20, 2013, 8:35 p.m.

Java

528 +1

1,716 +0

369 +0

GitHub
HiBench by Intel-bigdata

HiBench is a big data benchmark suite.

created at June 12, 2012, 7:56 a.m.

Java

126 +0

1,459 +2

768 +2

GitHub
elephant-bird by twitter

Twitter's collection of LZO and Protocol Buffer-related Hadoop, Pig, Hive, and HBase code.

created at March 25, 2010, 1:49 a.m.

Java

188 +0

1,138 +0

387 +0

GitHub
suro by Netflix

Netflix's distributed Data Pipeline

created at March 20, 2013, 9:02 p.m.

Java

514 +1

794 +0

171 +0

GitHub
hindex by Huawei-Hadoop

Secondary Index for HBase

created at Aug. 8, 2013, 11:33 a.m.

Java

134 +0

591 +0

286 +0

GitHub
HiveRunner by HiveRunner

An Open Source unit test framework for Hive queries based on JUnit 4 and 5

created at Nov. 22, 2013, 9:19 a.m.

Java

34 +0

255 +0

77 +0

GitHub
white-elephant by LinkedInAttic

Hadoop log aggregator and dashboard

created at Jan. 24, 2013, 11:26 p.m.

Java

97 +0

192 +0

62 +0

GitHub
haeinsa by VCNC

Haeinsa is linearly scalable multi-row, multi-table transaction library for HBase

created at Aug. 10, 2013, 3:43 p.m.

Java

30 +0

158 +0

42 +0

GitHub
mpich2-yarn by alibaba

Running MPICH2 on Yarn

created at Aug. 23, 2012, 3:57 a.m.

Java

34 +0

114 +0

62 +0

GitHub
HiveSwarm by livingsocial

Helpful user defined fuctions / table generating functions for Hive

created at April 5, 2011, 5:46 p.m.

Java

66 +0

101 +0

46 +0

GitHub
akela by mozilla-metrics

A bunch of utility classes for Java, Hadoop, HBase, Pig, etc.

created at Dec. 11, 2010, 12:36 a.m.

Java

22 +0

76 +0

31 +0

GitHub
Beetest by kawaa

A super simple utility for testing Apache Hive scripts locally for non-Java developers.

created at Dec. 7, 2013, 6:17 p.m.

Java

8 +0

72 +0

23 +0

GitHub
flume-ng-mongodb-sink by leonlee

Flume NG MongoDB source.

created at Sept. 28, 2012, 2:15 a.m.

Java

13 +0

71 +0

62 +0

GitHub
hive_test by edwardcapriolo

Unit test framework for hive and hive-service

created at Sept. 16, 2011, 2:39 p.m.

Java

18 +0

64 +0

46 +0

GitHub
flume-ng-rabbitmq by jcustenborder

Flume plugin for RabbitMQ

created at June 13, 2012, 8:22 p.m.

Java

10 +0

58 +0

46 +0

GitHub
varaha by thedatachef

Machine learning and natural language processing with Apache Pig

created at April 25, 2011, 3:39 a.m.

Java

9 +0

53 +0

15 +0

GitHub