spark by apache

Apache Spark - A unified analytics engine for large-scale data processing

created at Feb. 25, 2014, 8 a.m.

Scala

2,031 +1

38,571 +40

27,995 +16

GitHub
kafka by apache

Mirror of Apache Kafka

created at Aug. 15, 2011, 6:06 p.m.

Java

1,069 -2

27,557 +52

13,552 +20

GitHub
mediapipe by google-ai-edge

Cross-platform, customizable ML solutions for live and streaming media.

created at June 13, 2019, 7:16 p.m.

C++

493 -1

25,752 +64

4,992 +9

GitHub
nsq by nsqio

A realtime distributed messaging platform

created at May 12, 2012, 2:37 p.m.

Go

843 +0

24,637 +22

2,892 +2

GitHub
flink by apache

Apache Flink

created at June 7, 2014, 7 a.m.

Java

945 +0

23,290 +32

13,015 +15

GitHub
rocketmq by apache

Apache RocketMQ is a cloud native messaging and streaming platform, making it simple to build event-driven applications.

created at Nov. 30, 2016, 8 a.m.

Java

881 +3

20,650 +16

11,470 +7

GitHub
pulsar by apache

Apache Pulsar - distributed pub-sub messaging system

created at June 28, 2016, 7 a.m.

Java

402 +1

13,822 +24

3,504 -1

GitHub
akka by akka

Build highly concurrent, distributed, and resilient message-driven applications on the JVM

created at Feb. 16, 2009, 12:51 p.m.

Scala

579 +1

12,942 +6

3,587 +0

GitHub
redpanda by vectorizedio

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!

created at Nov. 2, 2020, 10:43 p.m.

C++

137 +0

8,964 +33

547 +1

GitHub
benthos by benthosdev

Fancy stream processing made operationally mundane

created at March 22, 2016, 1:18 a.m.

Go

108 +0

7,720 +40

754 +2

GitHub
beam by apache

Apache Beam is a unified programming model for Batch and Streaming data processing.

created at Feb. 2, 2016, 8 a.m.

Java

262 +0

7,582 +12

4,149 +6

GitHub
aeron by real-logic

Efficient reliable UDP unicast, UDP multicast, and IPC message transport

created at Feb. 7, 2014, 5:16 p.m.

Java

361 +1

7,105 +9

863 +3

GitHub
faust by robinhood

Python Stream Processing

created at March 8, 2017, 6:36 p.m.

Python

140 -1

6,678 +4

537 +0

GitHub
storm by apache

Apache Storm

created at Nov. 5, 2013, 8 a.m.

Java

585 +0

6,542 +1

4,072 +3

GitHub
ksql by confluentinc

The database purpose-built for stream processing applications.

created at Sept. 27, 2016, 9:30 p.m.

Java

436 +2

5,838 +11

1,037 +1

GitHub
river by creme-ml

🌊 Online machine learning in Python

created at Jan. 24, 2019, 3:18 p.m.

Python

85 -1

4,814 +9

526 -1

GitHub
rudder-server by rudderlabs

Privacy and Security focused Segment-alternative, in Golang and React

created at July 19, 2019, 9:24 a.m.

Go

61 +0

3,960 +10

296 +3

GitHub
incubator-heron by apache

Apache Heron (Incubating) is a realtime, distributed, fault-tolerant stream processing engine from Twitter

created at Sept. 25, 2015, 4:09 p.m.

Java

282 +0

3,639 +0

601 +0

GitHub
databus by linkedin

Source-agnostic distributed change data capture system

created at Dec. 17, 2012, 5:49 p.m.

Java

381 +0

3,595 +2

732 +0

GitHub
streamalert by airbnb

StreamAlert is a serverless, realtime data analysis framework which empowers you to ingest, analyze, and alert on data from any environment, using datasources and alerting logic you define.

created at Jan. 22, 2017, 1:10 a.m.

Python

101 +0

2,825 +0

334 +0

GitHub