Repositories

Lightning-AI repositories

2 supported repositories

Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

Last commit Jan 5, 2024

 (5,533 stars) (473 forks) (2 indexed issues) (2 open good first issues)

Pretrain, finetune and deploy AI models on multiple GPUs, TPUs with zero code changes.

Last commit Apr 6, 2024

 (26,687 stars) (3,233 forks) (121 indexed issues) (121 open good first issues)