rasbt/gpt-neoxPython
An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
(10 stars) (1 fork) (0 indexed issues) (0 open good first issues)
Repositories
rasbt repositories
Finetuning BLOOM on a single GPU using gradient-accumulation
(32 stars) (4 forks) (0 indexed issues) (0 open good first issues)
rasbt/grid-docsJavaScript
Public repository for managing Grid Platform documentation synced with gitbook on docs.grid.ai
(1 star) (0 forks) (0 indexed issues) (0 open good first issues)
rasbt/grid-tutorialsPython
(1 star) (0 forks) (0 indexed issues) (0 open good first issues)
Calculates hydrogen-bond interaction tables for protein-small molecule complexes, based on protein PDB and protonated ligand MOL2 structure input. Raschka et al. (2018) J. Computer-Aided Molec. Design
(28 stars) (15 forks) (0 indexed issues) (0 open good first issues)
rasbt/HbindVizPython
Tools for generating hydrogen-bond interaction visualizations from Hbind
(11 stars) (6 forks) (0 indexed issues) (0 open good first issues)
rasbt/imbalanced-learnPython
Python module to perform under sampling and over sampling with various techniques.
(4 stars) (4 forks) (0 indexed issues) (0 open good first issues)
rasbt/interpretable-ml-articleJupyter Notebook
Code examples for my Interpretable Machine Learning Blog Series
(56 stars) (6 forks) (0 indexed issues) (0 open good first issues)
rasbt/lion-pytorchPython
🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch
(3 stars) (2 forks) (0 indexed issues) (0 open good first issues)
rasbt/lit-llamaPython
Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, quantization, LoRA fine-tuning, pre-training. Apache 2.0-licensed.
(3 stars) (2 forks) (0 indexed issues) (0 open good first issues)
rasbt/litdataPython
Streamline data pipelines for AI. Process datasets across 1000s of machines, and optimize data for blazing fast model training.
(16 stars) (2 forks) (0 indexed issues) (0 open good first issues)
rasbt/LitServePython
Deploy AI models at scale. High-throughput serving engine for AI/ML models that uses the latest state-of-the-art model deployment techniques.
(9 stars) (2 forks) (0 indexed issues) (0 open good first issues)
LLM Architecture Gallery source data
(1,494 stars) (130 forks) (0 indexed issues) (0 open good first issues)
Website for NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1 GPU + 1 Day
(3 stars) (0 forks) (0 indexed issues) (0 open good first issues)
rasbt/LLM-finetuning-scriptsJupyter Notebook
(224 stars) (50 forks) (0 indexed issues) (0 open good first issues)
rasbt/LLM-workshop-2024Jupyter Notebook
A 4-hour coding workshop to understand how LLMs are implemented and used
(1,113 stars) (384 forks) (0 indexed issues) (0 open good first issues)
rasbt/LLMs-from-scratchJupyter Notebook
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
(103,682 stars) (15,865 forks) (0 indexed issues) (0 open good first issues)
(77 stars) (16 forks) (0 indexed issues) (0 open good first issues)
(28 stars) (4 forks) (0 indexed issues) (0 open good first issues)
rasbt/machine-learning-bookJupyter Notebook
Code Repository for Machine Learning with PyTorch and Scikit-Learn
(5,342 stars) (1,836 forks) (0 indexed issues) (0 open good first issues)