spark by apache

Apache Spark - A unified analytics engine for large-scale data processing

created at Feb. 25, 2014, 8 a.m.

2,023 +1

39,929 +83

28,314 +8

aeron by real-logic

Efficient reliable UDP unicast, UDP multicast, and IPC message transport

created at Feb. 7, 2014, 5:16 p.m.

357 +0

7,404 +11

890 +1

monix by monix

Asynchronous, Reactive Programming for Scala and Scala.js.

created at Jan. 6, 2014, 12:56 p.m.

59 +0

1,929 +1

246 +0

teknek-core by edwardcapriolo

The core libraries of the teknek stream processing platform

created at Jan. 1, 2014, 10:06 p.m.

3 +0

8 +0

1 +0

onyx by onyx-platform

Distributed, masterless, high performance, fault tolerant data processing

created at Dec. 2, 2013, 1:21 a.m.

122 +0

2,050 +0

205 +0

pipelinedb by pipelinedb

High-performance time-series aggregation for PostgreSQL

created at Nov. 26, 2013, 12:11 a.m.

104 +0

2,633 -1

241 +0

storm by apache

Apache Storm

created at Nov. 5, 2013, 8 a.m.

578 +0

6,603 +1

4,078 +2

storm-perf-test by yahoo

A simple storm performance/stress test

created at Oct. 1, 2013, 4:53 p.m.

21 +0

76 +0

40 +0

incubator-stormcrawler by apache

A scalable, mature and versatile web crawler based on Apache Storm

created at April 12, 2013, 2:13 p.m.

66 +0

891 +2

260 +0

trident-ml by pmerienne

Trident-ML : A realtime online machine learning library

created at March 22, 2013, 5:01 p.m.

42 +0

382 +0

87 +0

suro by Netflix

Netflix's distributed Data Pipeline

created at March 20, 2013, 9:02 p.m.

514 +1

794 +0

171 +0

fs2 by typelevel

Compositional, streaming I/O library for Scala

created at March 6, 2013, 5:34 p.m.

88 +0

2,371 +3

601 +0

camus by LinkedInAttic

LinkedIn's previous generation Kafka to HDFS pipeline.

created at Dec. 20, 2012, 11:54 p.m.

143 +0

881 -1

457 +0

databus by linkedin

Source-agnostic distributed change data capture system

created at Dec. 17, 2012, 5:49 p.m.

381 +0

3,641 +0

735 +0

Turbine by Netflix

SSE Stream Aggregator

created at Dec. 6, 2012, 9:44 p.m.

497 +1

835 +0

255 +0

summingbird by twitter

Streaming MapReduce with Scalding and Storm

created at Sept. 25, 2012, 10:38 p.m.

291 +0

2,137 +0

267 +0

mupd8 by walmartlabs

Muppet

created at Aug. 2, 2012, 11:49 p.m.

48 +0

126 +0

35 +0

nsq by nsqio

A realtime distributed messaging platform

created at May 12, 2012, 2:37 p.m.

842 +0

24,983 +14

2,901 +2

squall by epfldata

A streaming / online query processing / analytics engine based on Apache Storm

created at March 29, 2012, 5:02 p.m.

62 +0

270 +0

96 +0

Metamorphosis by killme2008

A high available,high performance distributed messaging system.

created at March 8, 2012, 7:01 a.m.

266 +0

1,335 +2

692 +0