redpanda by vectorizedio

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!

created at Nov. 2, 2020, 10:43 p.m.

C++

137 +0

9,653 +13

589 +3

GitHub
faust by robinhood

Python Stream Processing

created at March 8, 2017, 6:36 p.m.

Python

139 +0

6,746 +0

534 +0

GitHub
camus by LinkedInAttic

LinkedIn's previous generation Kafka to HDFS pipeline.

created at Dec. 20, 2012, 11:54 p.m.

Java

143 +0

881 -1

457 +0

GitHub
ksql by confluentinc

The database purpose-built for stream processing applications.

created at Sept. 27, 2016, 9:30 p.m.

Java

171 +0

126 +3

1,040 +0

GitHub
mantis by Netflix

A platform that makes it easy for developers to build realtime, cost-effective, operations-focused applications

created at June 6, 2019, 11:44 p.m.

Java

222 +1

1,416 +1

202 +0

GitHub
logging-flume by apache

Apache Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log-like data

created at Aug. 12, 2011, 6:20 p.m.

Java

225 +1

2,537 +1

1,571 +0

GitHub
beam by apache

Apache Beam is a unified programming model for Batch and Streaming data processing.

created at Feb. 2, 2016, 8 a.m.

Java

257 +0

7,879 +16

4,265 +6

GitHub
Metamorphosis by killme2008

A high available,high performance distributed messaging system.

created at March 8, 2012, 7:01 a.m.

Java

266 +0

1,335 +2

692 +0

GitHub
incubator-heron by apache

Apache Heron (Incubating) is a realtime, distributed, fault-tolerant stream processing engine from Twitter

created at Sept. 25, 2015, 4:09 p.m.

Java

283 +0

3,642 -1

598 +0

GitHub
summingbird by twitter

Streaming MapReduce with Scalding and Storm

created at Sept. 25, 2012, 10:38 p.m.

Scala

291 +0

2,137 +0

267 +0

GitHub
aeron by real-logic

Efficient reliable UDP unicast, UDP multicast, and IPC message transport

created at Feb. 7, 2014, 5:16 p.m.

Java

357 +0

7,404 +11

890 +1

GitHub
databus by linkedin

Source-agnostic distributed change data capture system

created at Dec. 17, 2012, 5:49 p.m.

Java

381 +0

3,641 +0

735 +0

GitHub
pulsar by apache

Apache Pulsar - distributed pub-sub messaging system

created at June 28, 2016, 7 a.m.

Java

404 +0

14,253 +19

3,584 +2

GitHub
Turbine by Netflix

SSE Stream Aggregator

created at Dec. 6, 2012, 9:44 p.m.

Java

497 +1

835 +0

255 +0

GitHub
mediapipe by google-ai-edge

Cross-platform, customizable ML solutions for live and streaming media.

created at June 13, 2019, 7:16 p.m.

C++

511 -3

27,601 +89

5,165 +11

GitHub
suro by Netflix

Netflix's distributed Data Pipeline

created at March 20, 2013, 9:02 p.m.

Java

514 +1

794 +0

171 +0

GitHub
akka by akka

A platform to build and run apps that are elastic, agile, and resilient. SDK, libraries, and hosted environments.

created at Feb. 16, 2009, 12:51 p.m.

Scala

572 +0

13,057 +7

3,594 +0

GitHub
storm by apache

Apache Storm

created at Nov. 5, 2013, 8 a.m.

Java

578 +0

6,603 +1

4,078 +2

GitHub
streamline by hortonworks

StreamLine - Streaming Analytics

created at May 14, 2015, 5:56 p.m.

Java

685 +0

164 +0

95 -1

GitHub
nsq by nsqio

A realtime distributed messaging platform

created at May 12, 2012, 2:37 p.m.

Go

842 +0

24,983 +14

2,901 +2

GitHub