spark by apache

Apache Spark - A unified analytics engine for large-scale data processing

created at Feb. 25, 2014, 8 a.m.

Scala

2,031 +0

38,419 +43

27,958 +14

GitHub
kafka by apache

Mirror of Apache Kafka

created at Aug. 15, 2011, 6:06 p.m.

Java

1,073 +0

27,411 +56

13,493 +12

GitHub
flink by apache

Apache Flink

created at June 7, 2014, 7 a.m.

Java

945 +0

23,198 +28

12,964 +3

GitHub
rocketmq by apache

Apache RocketMQ is a cloud native messaging and streaming platform, making it simple to build event-driven applications.

created at Nov. 30, 2016, 8 a.m.

Java

879 -1

20,579 +11

11,450 +8

GitHub
mediapipe by google

Cross-platform, customizable ML solutions for live and streaming media.

created at June 13, 2019, 7:16 p.m.

C++

492 -1

25,532 +42

4,966 -1

GitHub
beam by apache

Apache Beam is a unified programming model for Batch and Streaming data processing.

created at Feb. 2, 2016, 8 a.m.

Java

262 +0

7,535 +19

4,132 +5

GitHub
storm by apache

Apache Storm

created at Nov. 5, 2013, 8 a.m.

Java

586 +0

6,544 +3

4,070 -2

GitHub
akka by akka

Build highly concurrent, distributed, and resilient message-driven applications on the JVM

created at Feb. 16, 2009, 12:51 p.m.

Scala

580 +0

12,932 +4

3,585 -3

GitHub
pulsar by apache

Apache Pulsar - distributed pub-sub messaging system

created at June 28, 2016, 7 a.m.

Java

401 +0

13,763 +9

3,501 +6

GitHub
nsq by nsqio

A realtime distributed messaging platform

created at May 12, 2012, 2:37 p.m.

Go

845 +1

24,594 +16

2,892 -1

GitHub
logging-flume by apache

Apache Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log-like data

created at Aug. 12, 2011, 6:20 p.m.

Java

227 +0

2,505 +1

1,571 -1

GitHub
ksql by confluentinc

The database purpose-built for stream processing applications.

created at Sept. 27, 2016, 9:30 p.m.

Java

432 +1

5,820 +2

1,035 +2

GitHub
aeron by real-logic

Efficient reliable UDP unicast, UDP multicast, and IPC message transport

created at Feb. 7, 2014, 5:16 p.m.

Java

362 +1

7,067 +8

851 +3

GitHub
benthos by benthosdev

Fancy stream processing made operationally mundane

created at March 22, 2016, 1:18 a.m.

Go

108 +1

7,616 +30

736 +4

GitHub
databus by linkedin

Source-agnostic distributed change data capture system

created at Dec. 17, 2012, 5:49 p.m.

Java

382 -1

3,587 -1

732 +0

GitHub
Metamorphosis by killme2008

A high available,high performance distributed messaging system.

created at March 8, 2012, 7:01 a.m.

Java

266 +0

1,336 +1

697 +2

GitHub
incubator-heron by apache

Apache Heron (Incubating) is a realtime, distributed, fault-tolerant stream processing engine from Twitter

created at Sept. 25, 2015, 4:09 p.m.

Java

283 +0

3,638 +0

603 -1

GitHub
fs2 by typelevel

Compositional, streaming I/O library for Scala

created at March 6, 2013, 5:34 p.m.

Scala

88 +0

2,329 +3

589 +1

GitHub
redpanda by vectorizedio

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!

created at Nov. 2, 2020, 10:43 p.m.

C++

137 +0

8,855 +47

541 +2

GitHub
faust by robinhood

Python Stream Processing

created at March 8, 2017, 6:36 p.m.

Python

141 +0

6,678 +1

536 +0

GitHub