Repositories

lucidrains repositories

402 supported repositories

Implementation of Kronecker Attention in Pytorch

Last commit Sep 12, 2020

 (20 stars) (3 forks) (0 indexed issues) (0 open good first issues)

Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute

Last commit Nov 18, 2020

 (1,525 stars) (155 forks) (0 indexed issues) (0 open good first issues)

HTTP client load balancer with retries

Last commit Sep 28, 2016

 (1 star) (1 fork) (0 indexed issues) (0 open good first issues)

Training framework for Large Behavioral Models

Last commit Sep 17, 2025

 (28 stars) (1 fork) (0 indexed issues) (0 open good first issues)

An implementation of Transformer with Expire-Span, a circuit for learning which memories to retain

Last commit Oct 30, 2020

 (34 stars) (5 forks) (0 indexed issues) (0 open good first issues)

Implementation of Lie Transformer, Equivariant Self-Attention, in Pytorch

Last commit Feb 19, 2021

 (98 stars) (10 forks) (0 indexed issues) (0 open good first issues)

Implementation of Lift4d, Harmonizing Single-View 3D Estimation for 4D Reconstruction In-the-Wild, from Litman et al. of Carnegie Mellon

Last commit Jun 23, 2026

 (0 stars) (0 forks) (0 indexed issues) (0 open good first issues)

Implementation of a Light Recurrent Unit in Pytorch

Last commit Oct 6, 2024

 (49 stars) (3 forks) (0 indexed issues) (0 open good first issues)

Implementation of 'lightweight' GAN, proposed in ICLR 2021, in Pytorch. High resolution image generations that can be trained within a day or two

Last commit Jan 12, 2025

 (1,681 stars) (219 forks) (0 indexed issues) (0 open good first issues)

Transformer based on a variant of attention that is linear complexity in respect to sequence length

Last commit Sep 7, 2021

 (838 stars) (77 forks) (0 indexed issues) (0 open good first issues)

Implementation of Linformer for Pytorch

Last commit Jan 5, 2024

 (306 stars) (27 forks) (0 indexed issues) (0 open good first issues)

Masked Depth Modeling for Spatial Perception

Last commit Jan 29, 2026

 (2 stars) (0 forks) (0 indexed issues) (0 open good first issues)

🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch

Last commit Jul 28, 2023

 (1,821 stars) (47 forks) (0 indexed issues) (0 open good first issues)

Liquid simulator based on Conway's Game of Life

Last commit Mar 16, 2017

 (4 stars) (1 fork) (0 indexed issues) (0 open good first issues)

Implementation of the Llama architecture with RLHF + Q-learning

Last commit Feb 1, 2025

 (170 stars) (8 forks) (0 indexed issues) (0 open good first issues)

Implementation of Llama2 inference in Nim

Last commit Sep 14, 2023

 (11 stars) (1 fork) (0 indexed issues) (0 open good first issues)

An implementation of local windowed attention for language modeling

Last commit Jul 16, 2025

 (499 stars) (49 forks) (0 indexed issues) (0 open good first issues)

Local Attention - Flax module for Jax

Last commit May 26, 2021

 (22 stars) (2 forks) (0 indexed issues) (0 open good first issues)

LocoFormer - Generalist Locomotion via Long-Context Adaptation

Last commit May 28, 2026

 (113 stars) (6 forks) (0 indexed issues) (0 open good first issues)

Implementation of LogAvgExp for Pytorch

Last commit Apr 10, 2025

 (37 stars) (2 forks) (0 indexed issues) (0 open good first issues)