Repositories

lucidrains repositories

402 supported repositories

Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)

Last commit Jun 24, 2022

 (189 stars) (10 forks) (0 indexed issues) (0 open good first issues)

Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways

Last commit Jul 29, 2022

 (824 stars) (83 forks) (0 indexed issues) (0 open good first issues)

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

Last commit Jan 14, 2024

 (7,498 stars) (649 forks) (0 indexed issues) (0 open good first issues)

Efficient implementation (and explorations) into polar coordinate positional embedding (PoPE) - from Gopalakrishnan et al. under Schmidhuber

Last commit Mar 25, 2026

 (64 stars) (3 forks) (0 indexed issues) (0 open good first issues)

Toward High-Accuracy Open-Source Biomolecular Structure Prediction.

Last commit Feb 4, 2026

 (1 star) (0 forks) (0 indexed issues) (0 open good first issues)

A simplified implementation of DSSP algorithm for PyTorch and NumPy

Last commit Feb 9, 2023

 (6 stars) (1 fork) (0 indexed issues) (0 open good first issues)

Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch

Last commit Oct 30, 2023

 (877 stars) (110 forks) (0 indexed issues) (0 open good first issues)

Code for running RFdiffusion

Last commit Mar 31, 2023

 (6 stars) (0 forks) (0 indexed issues) (0 open good first issues)

Implementation of Recurrent Independent Mechanisms in Pytorch

Last commit Apr 6, 2026

 (27 stars) (3 forks) (0 indexed issues) (0 open good first issues)

Implementation of RISE

Last commit Feb 22, 2026

 (3 stars) (0 forks) (0 indexed issues) (0 open good first issues)

RITA is a family of autoregressive protein models, developed by LightOn in collaboration with the OATML group at Oxford and the Debora Marks Lab at Harvard.

Last commit Jul 3, 2022

 (5 stars) (0 forks) (0 indexed issues) (0 open good first issues)

Implementation of RL-100, Performant Robotic Manipulation with Real-World Reinforcement Learning

Last commit Nov 26, 2025

 (64 stars) (1 fork) (0 indexed issues) (0 open good first issues)

Implementation of RQ Transformer, proposed in the paper "Autoregressive Image Generation using Residual Quantization"

Last commit Apr 19, 2022

 (127 stars) (8 forks) (0 indexed issues) (0 open good first issues)

RaveForce - An OpenAI Gym style toolkit for music generation experiments.

Last commit Mar 28, 2022

 (2 stars) (1 fork) (0 indexed issues) (0 open good first issues)

The correct way to resize images or tensors. For Numpy or Pytorch (differentiable).

Last commit May 5, 2022

 (18 stars) (3 forks) (0 indexed issues) (0 open good first issues)

Framework for creating (partially) reversible neural networks with PyTorch

Last commit Jan 29, 2020

 (1 star) (0 forks) (0 indexed issues) (0 open good first issues)

Implementation of Soft Actor Critic and some of its improvements in Pytorch

Last commit Jun 4, 2026

 (69 stars) (2 forks) (0 indexed issues) (0 open good first issues)

Standard Open Arm 100

Last commit May 12, 2025

 (6 stars) (0 forks) (0 indexed issues) (0 open good first issues)

Implementation of the model architecture for SRT-H

Last commit Jun 1, 2026

 (28 stars) (4 forks) (0 indexed issues) (0 open good first issues)

Implementation of STAM (Space Time Attention Model), a pure and simple attention model that reaches SOTA for video classification

Last commit Mar 31, 2021

 (134 stars) (15 forks) (0 indexed issues) (0 open good first issues)