incubator-toree by apache

Mirror of Apache Toree (Incubating)

created at Jan. 7, 2016, 8 a.m.

48 +0

740 +0

225 +0

hail by hail-is

Cloud-native genomic dataframes and batch computing

created at Oct. 27, 2015, 8:55 p.m.

55 +0

984 +2

246 +0

graphframes by graphframes

None

created at Jan. 20, 2016, 11:17 p.m.

59 +0

1,001 +2

237 +0

incubator-livy by apache

Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.

created at June 25, 2017, 7 a.m.

60 +0

888 +2

602 +0

sparkle by tweag

Haskell on Apache Spark.

created at Nov. 9, 2015, 3:49 p.m.

61 +0

447 +0

30 +0

kyuubi by apache

Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.

created at Dec. 18, 2017, 9:05 a.m.

62 +0

2,105 +7

914 -2

joblib by joblib

Computing with Python functions.

created at May 7, 2010, 6:48 a.m.

64 +1

3,876 +11

416 +2

docker-spark by sequenceiq

None

created at July 11, 2014, 3:45 p.m.

65 +0

765 +0

282 +0

mleap by combust

MLeap: Deploy ML Pipelines to Production

created at Aug. 23, 2016, 3:51 a.m.

66 +0

1,504 +0

313 +1

sparklyr by sparklyr

R interface for Apache Spark

created at May 20, 2016, 3:28 p.m.

73 +0

957 +1

310 +0

spark-testing-base by holdenk

Base classes to use when writing tests with Spark

created at Jan. 30, 2015, 10:23 p.m.

77 +0

1,523 +1

358 +0

mongo-spark by mongodb

The MongoDB Spark Connector

created at May 20, 2015, 5:59 p.m.

79 +0

712 +0

309 +0

deequ by awslabs

Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.

created at Aug. 7, 2018, 8:55 p.m.

81 +0

3,308 +1

539 +1

photon-ml by linkedin

A scalable machine learning library on Apache Spark

created at Feb. 3, 2016, 1:12 a.m.

82 +0

792 +0

185 +0

livy by cloudera

Livy is an open source REST interface for interacting with Apache Spark from anywhere

created at Nov. 17, 2015, 6:55 a.m.

91 +0

1,009 +0

314 +0

spark by dotnet

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

created at April 22, 2019, 6:55 p.m.

93 +0

2,024 +1

315 +0

sedona by apache

A cluster computing framework for processing large-scale geospatial data

created at April 24, 2015, 6:01 p.m.

95 +0

1,956 +2

693 -2

adam by bigdatagenomics

ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.

created at Nov. 19, 2013, 11:47 p.m.

100 +0

1,003 +0

308 +0

spark-nlp by JohnSnowLabs

State of the Art Natural Language Processing

created at Sept. 24, 2017, 7:36 p.m.

100 +0

3,871 +6

712 +2

crossdata by Stratio

DISCONTINUED - Easy access to big things. Library for Apache Spark extending and improving its capabilities

created at Feb. 6, 2014, 9:41 a.m.

101 +0

169 +0

51 +0