lit-llama

Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

created at March 22, 2023, 2:28 p.m.

66

4,909

393

lit-gpt

Hackable implementation of state-of-the-art open-source LLMs based on nanoGPT. Supports flash attention, 4-bit and 8-bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

created at May 4, 2023, 5:46 p.m.

65

5,120

533

pytorch-lightning

Pretrain, finetune and deploy AI models on multiple GPUs, TPUs with zero code changes.

created at March 31, 2019, 12:45 a.m.

246

26,876

3,250

lightning-thunder

Make PyTorch models Lightning fast! Thunder is a source to source compiler for PyTorch. It enables using different hardware executors at once.

created at March 18, 2024, 3:30 p.m.

34

755

43

litgpt

Pretrain, finetune, deploy 20+ LLMs on your own data. Uses state-of-the-art techniques: flash attention, FSDP, 4-bit, LoRA, and more.

created at May 4, 2023, 5:46 p.m.

69

6,502

690

pytorch-lightning

The lightweight PyTorch wrapper for high-performance AI research. Scale your models, not the boilerplate.

created at March 31, 2019, 12:45 a.m.

223

18,608

2,376

pytorch-lightning-bolts

Toolbox of models, callbacks, and datasets for AI/ML researchers.

created at March 25, 2020, 4:03 p.m.

25

806

139

lightning-flash

Your PyTorch AI Factory - Flash enables you to easily configure and run complex AI recipes for over 15 tasks across 7 data domains

created at Jan. 28, 2021, 6:47 p.m.

32

1,213

109

metrics

Machine learning metrics for distributed, scalable PyTorch applications.

created at Dec. 22, 2020, 8:02 p.m.

15

103

6

lightning

Deep learning framework to train, deploy, and ship AI products Lightning fast.

created at March 31, 2019, 12:45 a.m.

244

25,254

3,087

stable-diffusion-deploy

Learn to serve Stable Diffusion models on cloud infrastructure at scale. This Lightning App shows load-balancing, orchestrating, pre-provisioning, dynamic batching, GPU-inference, micro-services working together via the Lightning Apps framework.

created at Aug. 23, 2022, 6:52 a.m.

23

163

5

lit-parrot

Implementation of Falcon, StableLM, Pythia, INCITE language models based on nanoGPT. Supports flash attention, LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

created at May 4, 2023, 5:46 p.m.

24

1,152

89