transform-hub by scramjetorg

Scramjet Transform Hub (STH) is a runtime supervisor that can run data processing programs called Sequences and manage local resources on any Linux server, Docker on small edge servers, and even large-scale Kubernetes clusters in the cloud or datacenters. It connects to Scramjet Spaces in Scramjet Cloud Platform.

created at June 30, 2021, 1:18 p.m.

13 +0

67 +0

8 +0

hailstorm by hailstorm-hs

Haskell distributed stream processing with exactly-once semantics

created at May 5, 2014, 1:56 a.m.

13 +0

90 +0

7 +0

scramjet by scramjetorg

Public tracker for Scramjet Cloud Platform, a platform that bring data from many environments together.

created at Jan. 18, 2017, 12:34 p.m.

13 -1

253 +0

20 +0

SPQR by ottogroup

Spooker is a dynamic framework for processing high volume data streams via processing pipelines

created at March 9, 2015, 5:01 p.m.

14 +0

29 +0

6 +0

yurita by paypal

Anomaly detection framework @ PayPal

created at March 28, 2019, 10:16 p.m.

14 +0

107 +0

32 +0

samza-luwak by romseygeek

Integration of Samza and Luwak

created at Nov. 10, 2014, 2:26 p.m.

15 +0

99 +0

15 +0

coast by bkirwi

Experiments in Streaming

created at Sept. 26, 2014, 5:47 p.m.

15 +0

60 +0

3 +0

bytewax by bytewax

Python Stream Processing

created at Feb. 4, 2022, 6:29 p.m.

18 +0

1,559 +12

64 +0

quix-streams by quixio

Python stream processing for Kafka

created at Nov. 17, 2022, 8:36 p.m.

19 +0

1,190 +6

69 +1

sensorbee by sensorbee

Lightweight stream processing engine for IoT

created at Feb. 19, 2016, 7:49 a.m.

19 +0

231 +0

42 +0

proton by timeplus-io

A streaming SQL engine, a fast and lightweight alternative to ksqlDB and Apache Flink, 🚀 powered by ClickHouse.

created at Aug. 14, 2023, 3:11 a.m.

20 +0

1,570 +8

68 +0

Flotilla by tylertreat

Automated message queue orchestration for scaled-up benchmarking.

created at Dec. 13, 2014, 4:46 a.m.

20 +0

236 +0

38 +0

storm-perf-test by yahoo

A simple storm performance/stress test

created at Oct. 1, 2013, 4:53 p.m.

21 +0

76 +0

40 +0

faststream by airtai

FastStream is a powerful and easy-to-use Python framework for building asynchronous services interacting with event streams such as Apache Kafka, RabbitMQ, NATS and Redis.

created at Dec. 1, 2022, 9:46 a.m.

22 +0

3,133 +39

161 +1

swave by sirthias

A lightweight Reactive Streams Infrastructure Toolkit for Scala.

created at Feb. 19, 2016, 4:19 p.m.

22 +0

171 +0

22 +0

numaflow by numaproj

Kubernetes-native platform to run massively parallel data/streaming jobs

created at May 20, 2022, 10:05 p.m.

22 +0

1,291 +163

114 +1

StormCV by sensorstorm

Apache Storm + OpenCV = large scale distributed image and video analysis.

created at Dec. 9, 2014, 12:57 p.m.

24 +0

167 +0

59 +0

hstream by hstreamdb

HStreamDB is an open-source, cloud-native streaming database for IoT and beyond. Modernize your data stack for real-time applications.

created at Aug. 31, 2020, 9:42 a.m.

25 +0

707 +0

55 +0

streampipes by apache

Apache StreamPipes - A self-service (Industrial) IoT toolbox to enable non-technical users to connect, analyze and explore IoT data streams.

created at April 22, 2018, 8:06 p.m.

26 +0

605 +1

181 +5

pathway by pathwaycom

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

created at Nov. 27, 2022, 1:01 p.m.

29 +1

4,325 +54

139 +2