spark by apache

Apache Spark - A unified analytics engine for large-scale data processing

created at Feb. 25, 2014, 8 a.m.

2,023 +1

39,929 +83

28,314 +8

kafka by apache

Mirror of Apache Kafka

created at Aug. 15, 2011, 6:06 p.m.

1,060 -1

28,852 +62

13,969 +14

mediapipe by google-ai-edge

Cross-platform, customizable ML solutions for live and streaming media.

created at June 13, 2019, 7:16 p.m.

511 -3

27,601 +89

5,165 +11

nsq by nsqio

A realtime distributed messaging platform

created at May 12, 2012, 2:37 p.m.

842 +0

24,983 +14

2,901 +2

flink by apache

Apache Flink

created at June 7, 2014, 7 a.m.

943 -1

24,117 +46

13,348 +10

rocketmq by apache

Apache RocketMQ is a cloud native messaging and streaming platform, making it simple to build event-driven applications.

created at Nov. 30, 2016, 8 a.m.

868 +0

21,254 +29

11,696 +18

pulsar by apache

Apache Pulsar - distributed pub-sub messaging system

created at June 28, 2016, 7 a.m.

404 +0

14,253 +19

3,584 +2

akka by akka

A platform to build and run apps that are elastic, agile, and resilient. SDK, libraries, and hosted environments.

created at Feb. 16, 2009, 12:51 p.m.

572 +0

13,057 +7

3,594 +0

redpanda by vectorizedio

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!

created at Nov. 2, 2020, 10:43 p.m.

137 +0

9,653 +13

589 +3

connect by vectorizedio

Fancy stream processing made operationally mundane

created at March 22, 2016, 1:18 a.m.

120 +0

8,137 +8

839 +5

beam by apache

Apache Beam is a unified programming model for Batch and Streaming data processing.

created at Feb. 2, 2016, 8 a.m.

257 +0

7,879 +16

4,265 +6

aeron by real-logic

Efficient reliable UDP unicast, UDP multicast, and IPC message transport

created at Feb. 7, 2014, 5:16 p.m.

357 +0

7,404 +11

890 +1

faust by robinhood

Python Stream Processing

created at March 8, 2017, 6:36 p.m.

139 +0

6,746 +0

534 +0

storm by apache

Apache Storm

created at Nov. 5, 2013, 8 a.m.

578 +0

6,603 +1

4,078 +2

river by creme-ml

🌊 Online machine learning in Python

created at Jan. 24, 2019, 3:18 p.m.

83 +0

5,086 +7

552 +4

pathway by pathwaycom

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

created at Nov. 27, 2022, 1:01 p.m.

29 +1

4,325 +54

139 +2

rudder-server by rudderlabs

Privacy and Security focused Segment-alternative, in Golang and React

created at July 19, 2019, 9:24 a.m.

63 +1

4,093 +11

317 +0

fluvio by infinyon

Lean and mean distributed stream processing system written in rust and web assembly. Alternative to Kafka + Flink in one.

created at Aug. 31, 2019, 12:11 a.m.

42 +0

3,880 +12

491 -1

automq by AutoMQ

AutoMQ is a cloud-first alternative to Kafka by decoupling durability to S3 and EBS. 10x Cost-Effective. No Cross-AZ Traffic Cost. Autoscale in seconds. Single-digit ms latency.

created at Aug. 17, 2023, 7:50 a.m.

36 +0

3,836 +15

214 -2

incubator-heron by apache

Apache Heron (Incubating) is a realtime, distributed, fault-tolerant stream processing engine from Twitter

created at Sept. 25, 2015, 4:09 p.m.

283 +0

3,642 -1

598 +0