spark by apache

Apache Spark - A unified analytics engine for large-scale data processing

created at Feb. 25, 2014, 8 a.m.

Scala

2,035 +3

38,325 +70

27,930 +16

GitHub
kafka by apache

Mirror of Apache Kafka

created at Aug. 15, 2011, 6:06 p.m.

Java

1,073 +1

27,288 +49

13,449 +11

GitHub
mediapipe by google

Cross-platform, customizable ML solutions for live and streaming media.

created at June 13, 2019, 7:16 p.m.

C++

493 -2

25,409 +78

4,960 +8

GitHub
nsq by nsqio

A realtime distributed messaging platform

created at May 12, 2012, 2:37 p.m.

Go

844 +0

24,543 +22

2,891 +6

GitHub
flink by apache

Apache Flink

created at June 7, 2014, 7 a.m.

Java

947 -1

23,142 +29

12,945 +16

GitHub
rocketmq by apache

Apache RocketMQ is a cloud native messaging and streaming platform, making it simple to build event-driven applications.

created at Nov. 30, 2016, 8 a.m.

Java

879 +0

20,535 +38

11,433 +9

GitHub
pulsar by apache

Apache Pulsar - distributed pub-sub messaging system

created at June 28, 2016, 7 a.m.

Java

403 +1

13,733 +20

3,493 +5

GitHub
akka by akka

Build highly concurrent, distributed, and resilient message-driven applications on the JVM

created at Feb. 16, 2009, 12:51 p.m.

Scala

580 +0

12,923 +4

3,589 +0

GitHub
redpanda by vectorizedio

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!

created at Nov. 2, 2020, 10:43 p.m.

C++

137 +0

8,779 +57

539 +3

GitHub
benthos by benthosdev

Fancy stream processing made operationally mundane

created at March 22, 2016, 1:18 a.m.

Go

107 +0

7,558 +46

726 +5

GitHub
beam by apache

Apache Beam is a unified programming model for Batch and Streaming data processing.

created at Feb. 2, 2016, 8 a.m.

Java

262 +0

7,508 +31

4,122 +5

GitHub
aeron by real-logic

Efficient reliable UDP unicast, UDP multicast, and IPC message transport

created at Feb. 7, 2014, 5:16 p.m.

Java

361 +0

7,047 +7

847 +0

GitHub
faust by robinhood

Python Stream Processing

created at March 8, 2017, 6:36 p.m.

Python

141 +0

6,672 +4

536 +1

GitHub
storm by apache

Apache Storm

created at Nov. 5, 2013, 8 a.m.

Java

586 +0

6,536 +8

4,072 -2

GitHub
ksql by confluentinc

The database purpose-built for stream processing applications.

created at Sept. 27, 2016, 9:30 p.m.

Java

432 -1

5,810 +4

1,031 +0

GitHub
river by creme-ml

🌊 Online machine learning in Python

created at Jan. 24, 2019, 3:18 p.m.

Python

85 +0

4,765 +13

523 +3

GitHub
rudder-server by rudderlabs

Privacy and Security focused Segment-alternative, in Golang and React

created at July 19, 2019, 9:24 a.m.

Go

61 +0

3,923 +11

289 +3

GitHub
incubator-heron by apache

Apache Heron (Incubating) is a realtime, distributed, fault-tolerant stream processing engine from Twitter

created at Sept. 25, 2015, 4:09 p.m.

Java

283 +0

3,636 +0

603 +0

GitHub
databus by linkedin

Source-agnostic distributed change data capture system

created at Dec. 17, 2012, 5:49 p.m.

Java

383 +0

3,587 +1

730 +0

GitHub
streamalert by airbnb

StreamAlert is a serverless, realtime data analysis framework which empowers you to ingest, analyze, and alert on data from any environment, using datasources and alerting logic you define.

created at Jan. 22, 2017, 1:10 a.m.

Python

101 +0

2,828 +3

333 +0

GitHub