benthos by benthosdev

Fancy stream processing made operationally mundane

created at March 22, 2016, 1:18 a.m.

Go

108 +0

7,720 +40

754 +2

GitHub
framework-cpp by scramjetorg

Simple yet powerful live data computation framework. C++ port of Scramjet framework.

created at Aug. 17, 2021, 7:39 p.m.

C++

9 +0

3 +0

0 +0

GitHub
framework-js by scramjetorg

Simple yet powerful live data computation framework.

created at April 14, 2021, 7:35 p.m.

TypeScript

11 +0

36 +0

0 +0

GitHub
framework-python by scramjetorg

Python port of Scramjet framework

created at Aug. 19, 2021, 8:56 a.m.

Python

12 +0

35 +0

1 +0

GitHub
kafka-streams-dotnet by LGouellec

.NET Stream Processing Library for Apache Kafka 🚀

created at Jan. 3, 2020, 1:07 p.m.

C#

34 +0

444 +1

73 +0

GitHub
streampipes by apache

Apache StreamPipes - A self-service (Industrial) IoT toolbox to enable non-technical users to connect, analyze and explore IoT data streams.

created at April 22, 2018, 8:06 p.m.

Java

27 +0

556 +1

171 -1

GitHub
bytewax by bytewax

Python Stream Processing

created at Feb. 4, 2022, 6:29 p.m.

Python

14 +0

1,264 +21

56 +0

GitHub
quix-streams by quixio

100% Python stream processing with Streaming DataFrames

created at Nov. 17, 2022, 8:36 p.m.

Python

17 +1

836 +21

42 +2

GitHub
substation by brexhq

Substation is a toolkit for routing, normalizing, and enriching security event and audit logs.

created at April 15, 2022, 2:23 p.m.

Go

8 +0

288 +1

13 +1

GitHub
zilla by aklivity

🦎 A multi-protocol, event-native proxy. Securely interface web apps, IoT clients, & microservices to Apache Kafka® via declaratively defined, stateless APIs.

created at Dec. 7, 2021, 10:10 p.m.

Java

9 +0

494 +3

47 +0

GitHub
javactrl-kafka by javactrl

Distributed, Scalable, Fault-Tolerant, Minimalistic Workflow Engine - No DAGs, No YAML, No Cumbersome Diagrams, Just Code

created at Dec. 27, 2022, 5:42 p.m.

Java

4 +0

9 +0

2 +0

GitHub
faststream by airtai

FastStream is a powerful and easy-to-use Python framework for building asynchronous services interacting with event streams such as Apache Kafka, RabbitMQ, NATS and Redis.

created at Dec. 1, 2022, 9:46 a.m.

Python

17 +0

1,875 +23

88 +4

GitHub
pathway by pathwaycom

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

created at Nov. 27, 2022, 1:01 p.m.

Python

20 +0

2,120 +330

80 +12

GitHub
proton by timeplus-io

A streaming SQL engine, a fast and lightweight alternative to ksqlDB and Apache Flink, 🚀 powered by ClickHouse.

created at Aug. 14, 2023, 3:11 a.m.

C++

20 +0

1,343 +14

46 +0

GitHub
numalogic by numaproj

Collection of operational time series ML models and tools

created at July 12, 2022, 11:48 p.m.

Python

8 +0

163 +3

27 +0

GitHub
numaflow by numaproj

Kubernetes-native platform to run massively parallel data/streaming jobs

created at May 20, 2022, 10:05 p.m.

Go

17 +1

930 +7

95 +0

GitHub
logging-flume by apache

Apache Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log-like data

created at Aug. 12, 2011, 6:20 p.m.

Java

227 +0

2,503 +0

1,569 +1

GitHub
pekko by apache

Build highly concurrent, distributed, and resilient message-driven applications using Java/Scala

created at Oct. 31, 2022, 8:40 a.m.

Scala

58 +0

1,090 +8

133 +3

GitHub
streamparse by pystorm

Run Python in Apache Storm topologies. Pythonic API, CLI tooling, and a topology DSL.

created at May 2, 2014, 8:33 p.m.

Python

103 +0

1,492 +2

218 +0

GitHub
incubator-stormcrawler by apache

A scalable, mature and versatile web crawler based on Apache Storm

created at April 12, 2013, 2:13 p.m.

HTML

70 -1

862 +0

256 +0

GitHub