oryx by OryxProject

Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning

updated at Oct. 19, 2024, 8:54 a.m.

208 +0

1,788 +0

405 +0

elephant-bird by twitter

Twitter's collection of LZO and Protocol Buffer-related Hadoop, Pig, Hive, and HBase code.

updated at Oct. 25, 2024, 8:30 a.m.

188 +0

1,138 +0

387 +0

banana by lucidworks

Banana for Solr - A Port of Kibana

updated at Nov. 6, 2024, 10:41 a.m.

199 +0

668 +0

235 +0

genie by Netflix

Distributed Big Data Orchestration Service

updated at Nov. 6, 2024, 12:51 p.m.

528 +1

1,716 +0

369 +0

shib by tagomoris

WebUI for query engines: Hive and Presto

updated at Nov. 6, 2024, 8:43 p.m.

27 +0

200 +0

59 +0

HiveRunner by HiveRunner

An Open Source unit test framework for Hive queries based on JUnit 4 and 5

updated at Nov. 11, 2024, 9:43 a.m.

34 +0

255 +0

77 +0

elasticsearch-hadoop by elastic

Elasticsearch real-time search and analytics natively integrated with Hadoop

updated at Nov. 13, 2024, 6:37 a.m.

180 +1

9 +0

990 +0

PyHive by dropbox

Python interface to Hive and Presto. 🐝

updated at Nov. 14, 2024, 5:59 a.m.

62 +0

1,671 +1

549 +0

YCSB by brianfrankcooper

Yahoo! Cloud Serving Benchmark

updated at Nov. 14, 2024, 5:52 p.m.

213 -1

4,955 +5

2,252 +4

hdfs by colinmarc

A native go client for HDFS

updated at Nov. 15, 2024, 7:35 a.m.

37 +0

1,370 +1

341 +0

schema-registry by confluentinc

Confluent Schema Registry for Kafka

updated at Nov. 15, 2024, 9:40 p.m.

379 +0

2,225 +1

1,114 +1

gobblin by apache

A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.

updated at Nov. 15, 2024, 10:11 p.m.

165 +0

2,228 +0

751 +1

HiBench by Intel-bigdata

HiBench is a big data benchmark suite.

updated at Nov. 16, 2024, 5:46 p.m.

126 +0

1,459 +2

768 +2

packetpig by packetloop

Packetpig - Open Source Big Data Security Analytics

updated at Nov. 16, 2024, 8:56 p.m.

57 +0

299 +1

85 +0

airflow by apache

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

updated at Nov. 17, 2024, 1:21 a.m.

760 +2

37,126 +88

14,306 +25