pathway by pathwaycom

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

updated at May 26, 2024, 1:38 a.m.

Python

20 +0

2,120 +330

80 +12

GitHub
pulsar by apache

Apache Pulsar - distributed pub-sub messaging system

updated at May 26, 2024, 1:20 a.m.

Java

402 +1

13,822 +24

3,504 -1

GitHub
ekuiper by lf-edge

Lightweight data stream processing engine for IoT edge

updated at May 26, 2024, 1:08 a.m.

Go

41 +0

1,378 +5

393 +1

GitHub
fluvio by infinyon

Lean and mean distributed stream processing system written in rust and web assembly.

updated at May 26, 2024, 12:57 a.m.

Rust

35 +1

2,699 +14

196 +4

GitHub
redpanda by vectorizedio

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!

updated at May 26, 2024, 12:03 a.m.

C++

137 +0

8,964 +33

547 +1

GitHub
pekko by apache

Build highly concurrent, distributed, and resilient message-driven applications using Java/Scala

updated at May 25, 2024, 9:17 p.m.

Scala

58 +0

1,090 +8

133 +3

GitHub
faststream by airtai

FastStream is a powerful and easy-to-use Python framework for building asynchronous services interacting with event streams such as Apache Kafka, RabbitMQ, NATS and Redis.

updated at May 25, 2024, 8:13 p.m.

Python

17 +0

1,875 +23

88 +4

GitHub
quix-streams by quixio

100% Python stream processing with Streaming DataFrames

updated at May 25, 2024, 8:11 p.m.

Python

17 +1

836 +21

42 +2

GitHub
kafka by apache

Mirror of Apache Kafka

updated at May 25, 2024, 7:23 p.m.

Java

1,069 -2

27,557 +52

13,552 +20

GitHub
proton by timeplus-io

A streaming SQL engine, a fast and lightweight alternative to ksqlDB and Apache Flink, 🚀 powered by ClickHouse.

updated at May 25, 2024, 7:16 p.m.

C++

20 +0

1,343 +14

46 +0

GitHub
bytewax by bytewax

Python Stream Processing

updated at May 25, 2024, 7:02 p.m.

Python

14 +0

1,264 +21

56 +0

GitHub
nsq by nsqio

A realtime distributed messaging platform

updated at May 25, 2024, 6:28 p.m.

Go

843 +0

24,637 +22

2,892 +2

GitHub
faust by robinhood

Python Stream Processing

updated at May 25, 2024, 6:23 p.m.

Python

140 -1

6,678 +4

537 +0

GitHub
beam by apache

Apache Beam is a unified programming model for Batch and Streaming data processing.

updated at May 25, 2024, 6:22 p.m.

Java

262 +0

7,582 +12

4,149 +6

GitHub
mediapipe by google-ai-edge

Cross-platform, customizable ML solutions for live and streaming media.

updated at May 25, 2024, 6:18 p.m.

C++

493 -1

25,752 +64

4,992 +9

GitHub
akka by akka

Build highly concurrent, distributed, and resilient message-driven applications on the JVM

updated at May 25, 2024, 5:17 p.m.

Scala

579 +1

12,942 +6

3,587 +0

GitHub
spark by apache

Apache Spark - A unified analytics engine for large-scale data processing

updated at May 25, 2024, 4:43 p.m.

Scala

2,031 +1

38,571 +40

27,995 +16

GitHub
rocketmq by apache

Apache RocketMQ is a cloud native messaging and streaming platform, making it simple to build event-driven applications.

updated at May 25, 2024, 4:29 p.m.

Java

881 +3

20,650 +16

11,470 +7

GitHub
ksql by confluentinc

The database purpose-built for stream processing applications.

updated at May 25, 2024, 4:18 p.m.

Java

436 +2

5,838 +11

1,037 +1

GitHub
zilla by aklivity

🦎 A multi-protocol, event-native proxy. Securely interface web apps, IoT clients, & microservices to Apache Kafka® via declaratively defined, stateless APIs.

updated at May 25, 2024, 3:49 p.m.

Java

9 +0

494 +3

47 +0

GitHub