Repositories

lucidrains repositories

402 supported repositories

Implementation of Axial attention - attending to multi-dimensional data efficiently

Last commit Aug 26, 2021

 (394 stars) (33 forks) (0 indexed issues) (0 open good first issues)

Axial Positional Embedding for Pytorch

Last commit Feb 25, 2025

 (84 stars) (6 forks) (0 indexed issues) (0 open good first issues)

A simple cross attention that updates both the source and target in one step

Last commit Jul 29, 2025

 (196 stars) (16 forks) (0 indexed issues) (0 open good first issues)

A simple command line tool for text to image generation, using OpenAI's CLIP and a BigGAN. Technique was originally created by https://twitter.com/advadnoun

Last commit Jan 31, 2022

 (2,571 stars) (301 forks) (0 indexed issues) (0 open good first issues)

open source repository

Last commit Feb 25, 2022

 (2 stars) (1 fork) (0 indexed issues) (0 open good first issues)

Implementation of Bit Diffusion, Hinton's group's attempt at discrete denoising diffusion, in Pytorch

Last commit Oct 14, 2023

 (356 stars) (20 forks) (0 indexed issues) (0 open good first issues)

8-bit CUDA functions for PyTorch

Last commit Mar 22, 2023

 (5 stars) (2 forks) (0 indexed issues) (0 open good first issues)

Implementation and explorations into Blackbox Gradient Sensing (BGS), an evolutionary strategies approach proposed in a Google Deepmind paper for Table Tennis

Last commit Apr 17, 2026

 (20 stars) (1 fork) (0 indexed issues) (0 open good first issues)

Implementation of Block Recurrent Transformer - Pytorch

Last commit Aug 20, 2024

 (226 stars) (20 forks) (0 indexed issues) (0 open good first issues)

10x faster matrix and vector operations

Last commit Apr 30, 2022

 (1 star) (2 forks) (0 indexed issues) (0 open good first issues)

A PyTorch Basecaller for Oxford Nanopore Reads

Last commit Oct 7, 2021

 (2 stars) (1 fork) (0 indexed issues) (0 open good first issues)

Implementation of Bottleneck Transformer in Pytorch

Last commit Sep 20, 2021

 (678 stars) (81 forks) (0 indexed issues) (0 open good first issues)

Usable Implementation of "Bootstrap Your Own Latent" self-supervised learning, from Deepmind, in Pytorch

Last commit Apr 27, 2026

 (1,894 stars) (251 forks) (0 indexed issues) (0 open good first issues)

Implementation of the GBST block from the Charformer paper, in Pytorch

Last commit Jul 15, 2021

 (118 stars) (11 forks) (0 indexed issues) (0 open good first issues)

Implementation of Chroma, generative models of protein using DDPM and GNNs, in Pytorch

Last commit Dec 27, 2022

 (159 stars) (24 forks) (0 indexed issues) (0 open good first issues)

CLASP - Contrastive Language-Aminoacid Sequence Pretraining

Last commit Apr 17, 2021

 (4 stars) (1 fork) (0 indexed issues) (0 open good first issues)

Implementation of Classifier Free Guidance in Pytorch, with emphasis on text conditioning, and flexibility to include multiple text embedding models

Last commit Mar 11, 2025

 (543 stars) (35 forks) (0 indexed issues) (0 open good first issues)

Explorations into training LLMs to use clinical calculators from patient history, using open sourced models. Will start with Wells' Criteria

Last commit Aug 31, 2025

 (314 stars) (31 forks) (0 indexed issues) (0 open good first issues)

Implementation of COCO-LM, Correcting and Contrasting Text Sequences for Language Model Pretraining, in Pytorch

Last commit Mar 3, 2021

 (46 stars) (7 forks) (0 indexed issues) (0 open good first issues)

Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch

Last commit Jun 20, 2025

 (183 stars) (8 forks) (0 indexed issues) (0 open good first issues)