cromwell by broadinstitute

Scientific workflow engine designed for simplicity & scalability. Trivially transition between one off use cases to massive scale production environments

created at April 17, 2015, 7:39 p.m.

112 -1

958 +1

349 +1

neo4j-spark-connector by neo4j-contrib

Neo4j Connector for Apache Spark, which provides bi-directional read/write access to Neo4j from Spark, using the Spark DataSource APIs

created at March 3, 2016, 4:01 p.m.

35 +0

303 +0

114 +0

docker-spark by sequenceiq

None

created at July 11, 2014, 3:45 p.m.

65 +0

764 +0

284 +0

photon-ml by linkedin

A scalable machine learning library on Apache Spark

created at Feb. 3, 2016, 1:12 a.m.

83 +0

790 +0

185 +0

crossdata by Stratio

DISCONTINUED - Easy access to big things. Library for Apache Spark extending and improving its capabilities

created at Feb. 6, 2014, 9:41 a.m.

101 +0

169 +0

51 +0

oryx by OryxProject

Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning

created at July 25, 2014, 8:08 p.m.

209 +0

1,787 +1

405 +0

first-edition by spark-in-action

The book's repo

created at March 25, 2015, 2:54 a.m.

42 +0

271 +0

191 +0

spark-gotchas by awesome-spark

Spark Gotchas. A subjective compilation of the Apache Spark tips and tricks

created at June 2, 2016, 10:21 p.m.

33 +0

354 +0

82 +0

aas by sryza

Code to accompany Advanced Analytics with Spark from O'Reilly Media

created at Nov. 8, 2014, 10:18 p.m.

148 +0

1,515 +1

1,032 +0

spark-fast-tests by MrPowers

Apache Spark testing helpers (dependency free & works with Scalatest, uTest, and MUnit)

created at April 6, 2017, 9:40 p.m.

15 +0

418 +0

73 +0

spark-testing-base by holdenk

Base classes to use when writing tests with Spark

created at Jan. 30, 2015, 10:23 p.m.

78 +0

1,492 +0

358 -1

blaze by blaze

NumPy and Pandas interface to Big Data

created at Oct. 26, 2012, 2:25 p.m.

195 +0

3,181 -1

393 +0

spark-corenlp by databricks

Stanford CoreNLP wrapper for Apache Spark

created at Aug. 21, 2015, 8:54 p.m.

52 +0

423 +0

120 +0

pyspark-stubs by zero323

Apache (Py)Spark type annotations (stub files).

created at Jan. 31, 2017, 1:13 a.m.

6 +0

114 +0

37 +0

silex by willb

something to help you spark

created at Oct. 5, 2016, 5:47 p.m.

3 +0

19 +0

0 +0

incubator-toree by apache

Mirror of Apache Toree (Incubating)

created at Jan. 7, 2016, 8 a.m.

49 +0

732 +0

223 +0

mist by Hydrospheredata

Serverless proxy for Spark cluster

created at Jan. 15, 2016, 7:22 a.m.

41 +0

326 +0

67 +0

spark-jobserver by spark-jobserver

REST job server for Apache Spark

created at Aug. 21, 2014, 11:07 p.m.

221 +0

2,841 -1

1,005 -1

livy by cloudera

Livy is an open source REST interface for interacting with Apache Spark from anywhere

created at Nov. 17, 2015, 6:55 a.m.

91 +0

1,004 +0

316 -5

adam by bigdatagenomics

ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.

created at Nov. 19, 2013, 11:47 p.m.

100 +0

967 +0

304 +0