manuzhang/awesome-streaming

spark by apache

Apache Spark - A unified analytics engine for large-scale data processing

created at Feb. 25, 2014, 8 a.m.

Scala

2,023 +0

40,020 +91

28,338 +24

GitHub

kafka by apache

Mirror of Apache Kafka

created at Aug. 15, 2011, 6:06 p.m.

Java

1,058 -2

28,908 +56

13,986 +17

GitHub

flink by apache

Apache Flink

created at June 7, 2014, 7 a.m.

Java

941 -2

24,157 +40

13,361 +13

GitHub

rocketmq by apache

Apache RocketMQ is a cloud native messaging and streaming platform, making it simple to build event-driven applications.

created at Nov. 30, 2016, 8 a.m.

Java

868 +0

21,282 +28

11,705 +9

GitHub

nsq by nsqio

A realtime distributed messaging platform

created at May 12, 2012, 2:37 p.m.

Go

842 +0

24,998 +15

2,903 +2

GitHub

streamline by hortonworks

StreamLine - Streaming Analytics

created at May 14, 2015, 5:56 p.m.

Java

686 +1

164 +0

95 +0

GitHub

storm by apache

Apache Storm

created at Nov. 5, 2013, 8 a.m.

Java

577 -1

6,601 -2

4,078 +0

GitHub

akka by akka

A platform to build and run apps that are elastic, agile, and resilient. SDK, libraries, and hosted environments.

created at Feb. 16, 2009, 12:51 p.m.

Scala

572 +0

13,059 +2

3,592 -2

GitHub

mediapipe by google-ai-edge

Cross-platform, customizable ML solutions for live and streaming media.

created at June 13, 2019, 7:16 p.m.

C++

512 +1

27,714 +113

5,176 +11

GitHub

suro by Netflix

Netflix's distributed Data Pipeline

created at March 20, 2013, 9:02 p.m.

Java

512 -2

794 +0

171 +0

GitHub

Turbine by Netflix

SSE Stream Aggregator

created at Dec. 6, 2012, 9:44 p.m.

Java

495 -2

835 +0

255 +0

GitHub

pulsar by apache

Apache Pulsar - distributed pub-sub messaging system

created at June 28, 2016, 7 a.m.

Java

403 -1

14,273 +20

3,590 +6

GitHub

databus by linkedin

Source-agnostic distributed change data capture system

created at Dec. 17, 2012, 5:49 p.m.

Java

380 -1

3,642 +1

735 +0

GitHub

aeron by real-logic

Efficient reliable UDP unicast, UDP multicast, and IPC message transport

created at Feb. 7, 2014, 5:16 p.m.

Java

357 +0

7,419 +15

892 +2

GitHub

summingbird by twitter

Streaming MapReduce with Scalding and Storm

created at Sept. 25, 2012, 10:38 p.m.

Scala

292 +1

2,137 +0

267 +0

GitHub

incubator-heron by apache

Apache Heron (Incubating) is a realtime, distributed, fault-tolerant stream processing engine from Twitter

created at Sept. 25, 2015, 4:09 p.m.

Java

283 +0

3,641 -1

598 +0

GitHub

Metamorphosis by killme2008

A high available,high performance distributed messaging system.

created at March 8, 2012, 7:01 a.m.

Java

266 +0

1,335 +0

692 +0

GitHub

beam by apache

Apache Beam is a unified programming model for Batch and Streaming data processing.

created at Feb. 2, 2016, 8 a.m.

Java

257 +0

7,886 +7

4,270 +5

GitHub

logging-flume by apache

Apache Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log-like data

created at Aug. 12, 2011, 6:20 p.m.

Java

225 +0

2,536 -1

1,570 -1

GitHub

mantis by Netflix

A platform that makes it easy for developers to build realtime, cost-effective, operations-focused applications

created at June 6, 2019, 11:44 p.m.

Java

222 +0

1,417 +1

202 +0

GitHub