Repositories

lucidrains repositories

402 supported repositories

A Tiny, Pure Javascript implementation of Gradient Boosted Trees.

No recent commit data

 (1 star) (0 forks) (0 indexed issues) (0 open good first issues)

Unofficial implementation of Titans, SOTA memory for transformers, in Pytorch

Last commit Jun 6, 2026

 (1,964 stars) (207 forks) (0 indexed issues) (0 open good first issues)

Implementation of TiTok, proposed by Bytedance in "An Image is Worth 32 Tokens for Reconstruction and Generation"

Last commit Jun 20, 2024

 (184 stars) (5 forks) (0 indexed issues) (0 open good first issues)

Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing

Last commit Jan 27, 2022

 (49 stars) (7 forks) (0 indexed issues) (0 open good first issues)

Implementation of Toolformer, Language Models That Can Use Tools, by MetaAI

Last commit Dec 21, 2023

 (2,057 stars) (130 forks) (0 indexed issues) (0 open good first issues)

Some utility functions to help myself (and perhaps others) go faster with ML/AI work

Last commit Jun 2, 2026

 (50 stars) (1 fork) (0 indexed issues) (0 open good first issues)

Implementation of trRosetta and trDesign for Pytorch, made into a convenient package, for protein structure prediction and design

Last commit Aug 27, 2021

 (83 stars) (8 forks) (0 indexed issues) (0 open good first issues)

Implementation of Tranception, an attention network, paired with retrieval, that is SOTA for protein fitness prediction

Last commit Jun 19, 2022

 (32 stars) (1 fork) (0 indexed issues) (0 open good first issues)

Explorations into whether a transformer with RL can direct a genetic algorithm to converge faster

Last commit Jun 2, 2026

 (71 stars) (0 forks) (0 indexed issues) (0 open good first issues)

Implementation of Transformer in Transformer, pixel level attention paired with patch level attention for image classification, in Pytorch

Last commit Dec 27, 2021

 (306 stars) (41 forks) (0 indexed issues) (0 open good first issues)

Explorations into adversarial losses on top of autoregressive loss for language modeling

Last commit Dec 21, 2025

 (41 stars) (2 forks) (0 indexed issues) (0 open good first issues)

Implementation of Transframer, Deepmind's U-net + Transformer architecture for up to 30 seconds video generation, in Pytorch

Last commit Aug 23, 2022

 (72 stars) (5 forks) (0 indexed issues) (0 open good first issues)

Pytorch implementation of Transfusion, "Predict the Next Token and Diffuse Images with One Multi-Modal Model", from MetaAI

Last commit Jan 27, 2026

 (1,369 stars) (73 forks) (0 indexed issues) (0 open good first issues)

Implementation of TransGanFormer, an all-attention GAN that combines the finding from the recent GanFormer and TransGan paper

Last commit Apr 27, 2021

 (155 stars) (15 forks) (0 indexed issues) (0 open good first issues)

Implementation of the Triangle Multiplicative module, used in Alphafold2 as an efficient way to mix rows or columns of a 2d feature map, as a standalone package for Pytorch

Last commit Aug 3, 2021

 (39 stars) (2 forks) (0 indexed issues) (0 open good first issues)

Development repository for the Triton language and compiler

Last commit Aug 10, 2022

 (2 stars) (0 forks) (0 indexed issues) (0 open good first issues)

Implementation of a Transformer, but completely in Triton

Last commit Apr 5, 2022

 (278 stars) (15 forks) (0 indexed issues) (0 open good first issues)

Reinforcement Learning example in Nim, playing tic tac toe. Based off original C version from the great Antirez

Last commit Apr 2, 2025

 (15 stars) (0 forks) (0 indexed issues) (0 open good first issues)

Applying NLP transfer learning techniques to predict Tweet stance

Last commit Feb 10, 2019

 (2 stars) (0 forks) (0 indexed issues) (0 open good first issues)

Explorations into the proposal from the paper, Visual-tactile pretraining and online multitask learning for humanlike manipulation dexterity

Last commit Feb 6, 2026

 (6 stars) (0 forks) (0 indexed issues) (0 open good first issues)