An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
Repositórios
Repositórios de rasbt
Finetuning BLOOM on a single GPU using gradient-accumulation
Public repository for managing Grid Platform documentation synced with gitbook on docs.grid.ai
Calculates hydrogen-bond interaction tables for protein-small molecule complexes, based on protein PDB and protonated ligand MOL2 structure input. Raschka et al. (2018) J. Computer-Aided Molec. Design
Tools for generating hydrogen-bond interaction visualizations from Hbind
Python module to perform under sampling and over sampling with various techniques.
Code examples for my Interpretable Machine Learning Blog Series
🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch
Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, quantization, LoRA fine-tuning, pre-training. Apache 2.0-licensed.
Streamline data pipelines for AI. Process datasets across 1000s of machines, and optimize data for blazing fast model training.
Deploy AI models at scale. High-throughput serving engine for AI/ML models that uses the latest state-of-the-art model deployment techniques.
LLM Architecture Gallery source data
Website for NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1 GPU + 1 Day
A 4-hour coding workshop to understand how LLMs are implemented and used
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
Code Repository for Machine Learning with PyTorch and Scikit-Learn