PyTorch compiler that accelerates training and inference. Get built-in optimizations for performance, memory, parallelism, and easily write your own.
(1,460 stars) (114 forks) (13 件の索引済み issue) (13 件のオープンな good first issue)
リポジトリ
PyTorch compiler that accelerates training and inference. Get built-in optimizations for performance, memory, parallelism, and easily write your own.
Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.
Pretrain, finetune and deploy AI models on multiple GPUs, TPUs with zero code changes.