Implementation of Uformer, Attention-based Unet, in Pytorch
Repositories
lucidrains repositories
Implementation of UltraMem, improved Product Key Memory design, from Bytedance AI labs
A Pytorch implementation of Stylegan2 with UNet Discriminator
Implementation of Uniformer, a simple attention and 3d convolutional net that achieved SOTA in a number of video classification tasks, debuted in ICLR 2022
Exploration into some new research surrounding value networks
Implementation of Value Networks
Vector (and Scalar) Quantization, in Pytorch
A high performance linear algebra library.
Implementation of Video Diffusion Models, Jonathan Ho's new paper extending DDPMs to Video Generation - in Pytorch
Implementation of ViLLA-X, Enhancing Latent Action Modeling in Vision-Language-Action Models
Explorations into improving ViTArc with Slot Attention
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
Implementation of Voicebox, new SOTA Text-to-speech network from MetaAI, in Pytorch
Implementation of WorldParticle, Unified World Simulation of Lagrangian Particle Dynamics via Transformer
A concise but complete implementation of CLIP with various experimental improvements from recent papers
Implementation of various evolutionary algorithms, starting with evolutionary strategies
Explorations into some of the approaches advocated by Yann LeCun, and just a more wholistic architecture (JEPA) in general
Just a repository that will house some MLPs and their variants, so to avoid having to reimplement them again and again for different projects (especially RL)
A concise but complete full-attention transformer with a set of promising experimental features from various papers
Implementation of a transformer for reinforcement learning using `x-transformers`