Implementation of ResFit, Residual Off-Policy RL for Finetuning Behavior Cloning Policies
(17 stars) (0 forks) (0 indexed issues) (0 open good first issues)
Repositories
lucidrains repositories
Implementation of Retrieval-Augmented Denoising Diffusion Probabilistic Models in Pytorch
(66 stars) (5 forks) (0 indexed issues) (0 open good first issues)
Implementation of ReWiND, "Language-Guided Rewards Teach Robot Policies without New Demonstrations", from USC / Amazon Robotics
(35 stars) (1 fork) (0 indexed issues) (0 open good first issues)
lucidrains/rgn2-replicaPython
Replication attempt for the Protein Folding Model described in https://www.biorxiv.org/content/10.1101/2021.08.02.454840v1
(2 stars) (0 forks) (0 indexed issues) (0 open good first issues)
lucidrains/rigidformerPython
Implementation of RigidFormer, Learning Rigid Dynamics using Transformers
(21 stars) (1 fork) (0 indexed issues) (0 open good first issues)
Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch
(547 stars) (36 forks) (0 indexed issues) (0 open good first issues)
Implementation of RT1 (Robotic Transformer) in Pytorch
(450 stars) (36 forks) (0 indexed issues) (0 open good first issues)
Implementation of Rotary Embeddings, from the Roformer paper, in Pytorch
(812 stars) (68 forks) (0 indexed issues) (0 open good first issues)
Fully featured implementation of Routing Transformer
(301 stars) (30 forks) (0 indexed issues) (0 open good first issues)
lucidrains/rvq-vae-gptPython
My attempts at applying Soundstream design on learned tokenization of text and then applying hierarchical attention to text generation
(90 stars) (1 fork) (0 indexed issues) (0 open good first issues)
Exploration into the Scaling Value Iteration Networks paper, from Schmidhuber's group
(37 stars) (0 forks) (0 indexed issues) (0 open good first issues)
Implementation of Scattering Compositional Learner in Pytorch
(6 stars) (3 forks) (0 indexed issues) (0 open good first issues)
lucidrains/sdft-pytorchPython
Explorations into the proposed SDFT, Self-Distillation Enables Continual Learning, from Shenfeld et al. of MIT
(32 stars) (2 forks) (0 indexed issues) (0 open good first issues)
Implementation of SE3-Transformers for Equivariant Self-Attention, in Pytorch. This specific repository is geared towards integration with eventual Alphafold2 replication.
(329 stars) (32 forks) (0 indexed issues) (0 open good first issues)
Implementation of Segformer, Attention + MLP neural network for segmentation, in Pytorch
(372 stars) (44 forks) (0 indexed issues) (0 open good first issues)
Exploration into the proposed "Self Reasoning Tokens" by Felipe Bonetto
(57 stars) (4 forks) (0 indexed issues) (0 open good first issues)
Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI
(1,409 stars) (70 forks) (0 indexed issues) (0 open good first issues)
Experiments around a simple idea for inducing multiple hierarchical predictive model within a GPT
(227 stars) (14 forks) (0 indexed issues) (0 open good first issues)
Implementation of 2-simplicial attention proposed by Clift et al. (2019) and the recent attempt to make practical in Fast and Simplex, Roy et al. (2025)
(48 stars) (1 fork) (0 indexed issues) (0 open good first issues)
Self contained pytorch implementation of a sinkhorn based router, for mixture of experts or otherwise
(40 stars) (0 forks) (0 indexed issues) (0 open good first issues)