Web-based dashboard for Sacred
Repositories
lucidrains repositories
Implementation of OmniNet, Omnidirectional Representations from Transformers, in Pytorch
An open source implementation of CLIP.
Open-source implementation of AlphaEvolve
A PyTorch framework for prediction of tertiary protein structure
List of packages for Nimble
Another attempt at a long-context / efficient transformer by me
Implementation of Parti, Google's pure attention-based text-to-image neural network, in Pytorch
Explorations into PathNet, "Evolution Channels Gradient Descent in Super Neural Networks" from Deepmind in 2017
Yet another random morning idea to be quickly tried and architecture shared if it works; to allow the transformer to pause for any amount of time on any token
Implementation of Perceiver AR, Deepmind's new long-context attention network based on Perceiver architecture, in Pytorch
Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch
An implementation of Performer, a linear attention-based transformer, in Pytorch
Implementation of Key-Locked Rank One Editing, from Nvidia AI
Implementation of Phenaki Video, which uses Mask GIT to produce text guided videos of up to 2 minutes in length, in Pytorch
Implementation of π-GAN, for 3d-aware image synthesis, in Pytorch
Implementation of π₀, the robotic foundation model architecture proposed by Physical Intelligence
Implementation of Pixel-level Contrastive Learning, proposed in the paper "Propagate Yourself", in Pytorch
Implementation of the Point Transformer layer, in Pytorch
Implementation of Poly-attention, a higher-order self-attention proposed by Chakrabarti et al. of Columbia