A Tiny, Pure Javascript implementation of Gradient Boosted Trees.
Repositories
lucidrains repositories
Unofficial implementation of Titans, SOTA memory for transformers, in Pytorch
Implementation of TiTok, proposed by Bytedance in "An Image is Worth 32 Tokens for Reconstruction and Generation"
Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing
Implementation of Toolformer, Language Models That Can Use Tools, by MetaAI
Some utility functions to help myself (and perhaps others) go faster with ML/AI work
Implementation of trRosetta and trDesign for Pytorch, made into a convenient package, for protein structure prediction and design
Implementation of Tranception, an attention network, paired with retrieval, that is SOTA for protein fitness prediction
Explorations into whether a transformer with RL can direct a genetic algorithm to converge faster
Implementation of Transformer in Transformer, pixel level attention paired with patch level attention for image classification, in Pytorch
Explorations into adversarial losses on top of autoregressive loss for language modeling
Implementation of Transframer, Deepmind's U-net + Transformer architecture for up to 30 seconds video generation, in Pytorch
Pytorch implementation of Transfusion, "Predict the Next Token and Diffuse Images with One Multi-Modal Model", from MetaAI
Implementation of TransGanFormer, an all-attention GAN that combines the finding from the recent GanFormer and TransGan paper
Implementation of the Triangle Multiplicative module, used in Alphafold2 as an efficient way to mix rows or columns of a 2d feature map, as a standalone package for Pytorch
Development repository for the Triton language and compiler
Implementation of a Transformer, but completely in Triton
Reinforcement Learning example in Nim, playing tic tac toe. Based off original C version from the great Antirez
Applying NLP transfer learning techniques to predict Tweet stance
Explorations into the proposal from the paper, Visual-tactile pretraining and online multitask learning for humanlike manipulation dexterity