Repository Issues
Lightning-AI/lit-llama
Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.
Issues
Open
Resume in the pretraining code
help wanted
No assignee yetHas a beginner-friendly label
2 comments1 reaction0 assignees
Open
`generate.py` and `generate/full.py` could be merged
good first issueinference
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly label
4 comments0 reactions0 assignees