Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, Baichuan, Mixtral, Gemma, etc.) on Intel CPU and GPU (e.g., local PC with iGPU, discrete GPU such as Arc, Flex and Max). A PyTorch LLM library that seamlessly integrates with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, DeepSpeed, vLLM, FastChat, etc.
updated at May 12, 2024, 3:48 a.m.
scikit-learn: machine learning in Python
updated at May 12, 2024, 2:16 a.m.
Distributed Deep Learning, with a focus on distributed training, using Keras and Apache Spark.
updated at May 10, 2024, 5:12 a.m.
Jupyter magics and kernels for working with remote Spark clusters
updated at May 3, 2024, 11:02 p.m.
(Deprecated) Scikit-learn integration package for Apache Spark
updated at April 17, 2024, 4:13 a.m.
Apache (Py)Spark type annotations (stub files).
updated at Sept. 16, 2023, 6:30 p.m.