fluvio by infinyon

Lean and mean distributed stream processing system written in rust and web assembly.

created at Aug. 31, 2019, 12:11 a.m.

Rust

37 +0

2,670 +20

191 +0

GitHub
pipelinedb by pipelinedb

High-performance time-series aggregation for PostgreSQL

created at Nov. 26, 2013, 12:11 a.m.

C

106 +0

2,615 +1

240 +2

GitHub
logging-flume by apache

Apache Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log-like data

created at Aug. 12, 2011, 6:20 p.m.

Java

227 +0

2,505 +1

1,571 -1

GitHub
nats-streaming-server by nats-io

NATS Streaming System Server

created at March 24, 2016, 5:42 p.m.

Go

80 +0

2,496 +2

286 +0

GitHub
fs2 by typelevel

Compositional, streaming I/O library for Scala

created at March 6, 2013, 5:34 p.m.

Scala

88 +0

2,329 +3

589 +1

GitHub
summingbird by twitter

Streaming MapReduce with Scalding and Storm

created at Sept. 25, 2012, 10:38 p.m.

Scala

292 +0

2,138 +0

267 +0

GitHub
onyx by onyx-platform

Distributed, masterless, high performance, fault tolerant data processing

created at Dec. 2, 2013, 1:21 a.m.

Clojure

122 +0

2,045 +1

206 +0

GitHub
monix by monix

Asynchronous, Reactive Programming for Scala and Scala.js.

created at Jan. 6, 2014, 12:56 p.m.

Scala

60 +0

1,921 +1

243 +0

GitHub
faststream by airtai

FastStream is a powerful and easy-to-use Python framework for building asynchronous services interacting with event streams such as Apache Kafka, RabbitMQ, NATS and Redis.

created at Dec. 1, 2022, 9:46 a.m.

Python

16 +0

1,820 +24

80 +2

GitHub
pathway by pathwaycom

Pathway is a high-throughput, low-latency data processing framework that handles live data & streaming for you. Made with ❤️ for Python & ML/AI developers.

created at Nov. 27, 2022, 1:01 p.m.

Python

20 +0

1,737 +15

68 +2

GitHub
yomo by yomorun

🦖 Stateful Serverless Framework for building Geo-distributed Edge AI Infra

created at July 1, 2020, 5:48 a.m.

Go

43 +0

1,614 +2

128 +0

GitHub
siddhi by siddhi-io

Stream Processing and Complex Event Processing Engine

created at April 21, 2014, 9:51 a.m.

Java

122 +0

1,500 +0

522 +0

GitHub
streamparse by pystorm

Run Python in Apache Storm topologies. Pythonic API, CLI tooling, and a topology DSL.

created at May 2, 2014, 8:33 p.m.

Python

103 +0

1,490 +0

218 +0

GitHub
wally by WallarooLabs

Distributed Stream Processing

created at Dec. 30, 2015, 3:11 p.m.

Pony

71 +0

1,480 -1

67 +1

GitHub
mantis by Netflix

A platform that makes it easy for developers to build realtime, cost-effective, operations-focused applications

created at June 6, 2019, 11:44 p.m.

Java

213 +1

1,389 +1

195 +0

GitHub
ekuiper by lf-edge

Lightweight data stream processing engine for IoT edge

created at July 3, 2019, 7:37 a.m.

Go

41 +0

1,365 +1

387 +5

GitHub
Metamorphosis by killme2008

A high available,high performance distributed messaging system.

created at March 8, 2012, 7:01 a.m.

Java

266 +0

1,336 +1

697 +2

GitHub
datafusion-ballista by apache

Apache Arrow Ballista Distributed Query Engine

created at May 19, 2022, 2:32 p.m.

Rust

55 -1

1,296 +15

173 +2

GitHub
proton by timeplus-io

A streaming SQL engine, a fast and lightweight alternative to ksqlDB and Apache Flink, 🚀 powered by ClickHouse.

created at Aug. 14, 2023, 3:11 a.m.

C++

16 +1

1,293 +8

45 +1

GitHub
Trill by Microsoft

Trill is a single-node query processor for temporal or streaming data.

created at Sept. 26, 2018, 6:48 p.m.

C#

63 +0

1,231 +1

133 +0

GitHub