This projects gives Kotlin bindings and several extensions for Apache Spark. We are looking to have this as a part of Apache Spark 3.x
created at June 1, 2020, 11:07 a.m.
Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, GraphRAG, DeepSpeed, Axolotl, etc
created at Aug. 29, 2016, 7:59 a.m.
Apache Spark testing helpers (dependency free & works with Scalatest, uTest, and MUnit)
created at April 6, 2017, 9:40 p.m.
pyspark methods to enhance developer productivity 📣 👯 🎉
created at Sept. 15, 2017, 1:02 p.m.
Essential Spark extensions and helper methods ✨😲
created at Feb. 16, 2017, 3:41 p.m.
Neo4j Connector for Apache Spark, which provides bi-directional read/write access to Neo4j from Spark, using the Spark DataSource APIs
created at March 3, 2016, 4:01 p.m.
Apache Spark Connect Client for Golang
created at May 30, 2023, 10:09 a.m.
Apache Spark Connect Client for C#
created at April 14, 2024, 11:40 p.m.
Apache Spark Connect Client for Rust
created at Sept. 18, 2023, 1:32 p.m.