lucidrains repositories

Pytorch implementation of the hamburger module from the ICLR 2021 paper "Is Attention Better Than Matrix Decomposition"

Last commit Jan 13, 2021

Unofficial implementation of Hippoformer, Integrating Hippocampus-inspired Spatial Memory with Transformers

Last commit Apr 28, 2026

The Gaussian Histogram Loss (HL-Gauss) proposed by Imani et al. with a few convenient wrappers for regression, in Pytorch

Last commit Apr 3, 2026

Implementation of a holodeck, written in Pytorch

Last commit Nov 1, 2023

Implementation of Hourglass Transformer, in Pytorch, from Google and OpenAI

Last commit Nov 10, 2021

Fork of HyenaDNA, a long-range genomic foundation model built with Hyena

Last commit Aug 14, 2023

Attempt to make multiple residual streams from Bytedance's Hyper-Connections paper accessible to the public

Last commit May 13, 2026

Unofficial implementation of iTransformer - SOTA Time Series Forecasting using Attention networks, out of Tsinghua / Ant group

Last commit Jun 12, 2025

Implementation of Imagen, Google's Text-to-Image Neural Network, in Pytorch

Last commit Oct 5, 2023

Implementation of the new SOTA for model based RL, from the paper "Improving Transformer World Models for Data-Efficient RL", in Pytorch

Last commit May 2, 2025

Implementation of Infini-Transformer in Pytorch

Last commit Jan 4, 2025

Implementation of Insertion-deletion Denoising Diffusion Probabilistic Models

Last commit May 31, 2022

Implementation of Invariant Point Attention, used for coordinate refinement in the structure module of Alphafold2, as a standalone Pytorch module

Last commit Nov 25, 2022

An implementation of (Induced) Set Attention Block, from the Set Transformers paper

Last commit Jan 10, 2023

Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more

Last commit Jan 7, 2020

Use Jax functions in Pytorch

Last commit Jul 1, 2023

Flash Attention Triton kernel with support for second-order derivatives

Last commit Sep 3, 2025

Implementation of the Kalman Filtering Attention proposed in "Kalman Filtering Attention for User Behavior Modeling in CTR Prediction"

Last commit Oct 22, 2023

Implementation of Kalmanformer, modeling the Kalman gain with a transformer

Last commit Jun 2, 2026

KErnel OPerationS, on CPUs and GPUs, with autodiff and without memory overflows

Last commit Mar 18, 2022