spark-connect-csharp by mdrakiburrahman

Apache Spark Connect Client for C#

created at April 14, 2024, 11:40 p.m.

2 +0

1 +0

0 +0

spark-connect-rs by sjrusso8

Apache Spark Connect Client for Rust

created at Sept. 18, 2023, 1:32 p.m.

5 +0

90 +0

15 +0

spark-connect-go by apache

Apache Spark Connect Client for Golang

created at May 30, 2023, 10:09 a.m.

25 +0

161 +2

32 +0

python-deequ by awslabs

Python API for Deequ

created at Nov. 9, 2020, 9:28 p.m.

17 +0

730 +3

136 +1

delight by datamechanics

A Spark UI and Spark History Server alternative with CPU and Memory metrics! Delight is free, cross-platform, and open-source.

created at Oct. 26, 2020, 1:56 p.m.

16 +0

342 +0

53 +0

kotlin-spark-api by Kotlin

This projects gives Kotlin bindings and several extensions for Apache Spark. We are looking to have this as a part of Apache Spark 3.x

created at June 1, 2020, 11:07 a.m.

20 -1

461 +0

35 +0

itachi by yaooqinn

A library that brings useful functions from various modern database management systems to Apache Spark

created at April 2, 2020, noon

5 +0

56 +0

4 +0

joblib-spark by joblib

Joblib Apache Spark Backend

created at Nov. 20, 2019, 7:02 p.m.

9 +0

242 +0

26 +0

delta by delta-io

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

created at April 22, 2019, 6:56 p.m.

217 +0

7,599 +18

1,707 +6

spark by dotnet

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

created at April 22, 2019, 6:55 p.m.

93 +0

2,024 +1

315 +0

chispa by MrPowers

PySpark test helper methods with beautiful error messages

created at March 19, 2019, 3:52 p.m.

5 +0

620 +3

68 +0

koalas by databricks

Koalas: pandas API on Apache Spark

created at Jan. 3, 2019, 9:46 p.m.

326 +0

3,338 +3

358 +0

iceberg by apache

Apache Iceberg

created at Nov. 19, 2018, 4:26 p.m.

160 +0

6,464 +20

2,235 +10

deequ by awslabs

Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.

created at Aug. 7, 2018, 8:55 p.m.

81 +0

3,308 +1

539 +1

kyuubi by apache

Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.

created at Dec. 18, 2017, 9:05 a.m.

62 +0

2,105 +7

914 -2

spark-nlp by JohnSnowLabs

State of the Art Natural Language Processing

created at Sept. 24, 2017, 7:36 p.m.

100 +0

3,871 +6

712 +2

quinn by mrpowers-io

pyspark methods to enhance developer productivity 📣 👯 🎉

created at Sept. 15, 2017, 1:02 p.m.

20 +0

642 +1

99 +0

aut by archivesunleashed

The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.

created at July 6, 2017, 10:13 a.m.

15 +0

137 +0

33 +0

incubator-livy by apache

Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.

created at June 25, 2017, 7 a.m.

60 +0

888 +2

602 +0

SynapseML by Microsoft

Simple and Distributed Machine Learning

created at June 5, 2017, 8:23 a.m.

146 +0

5,068 +3

831 -1