keyvalue
id617504730
namelit-llama
full_nameLightning-AI/lit-llama
html_urlhttps://github.com/Lightning-AI/lit-llama
descriptionImplementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.
created_atMarch 22, 2023, 2:28 p.m.
updated_atJuly 22, 2023, 7:52 p.m.
pushed_atJuly 19, 2023, 5:12 p.m.
size1,659
stargazers_count4,909
watchers_count66
forks_count393
open_issues91
languagePython