Implementation of Axial attention - attending to multi-dimensional data efficiently
Repositories
lucidrains repositories
Axial Positional Embedding for Pytorch
A simple cross attention that updates both the source and target in one step
A simple command line tool for text to image generation, using OpenAI's CLIP and a BigGAN. Technique was originally created by https://twitter.com/advadnoun
open source repository
Implementation of Bit Diffusion, Hinton's group's attempt at discrete denoising diffusion, in Pytorch
8-bit CUDA functions for PyTorch
Implementation and explorations into Blackbox Gradient Sensing (BGS), an evolutionary strategies approach proposed in a Google Deepmind paper for Table Tennis
Implementation of Block Recurrent Transformer - Pytorch
10x faster matrix and vector operations
A PyTorch Basecaller for Oxford Nanopore Reads
Implementation of Bottleneck Transformer in Pytorch
Usable Implementation of "Bootstrap Your Own Latent" self-supervised learning, from Deepmind, in Pytorch
Implementation of the GBST block from the Charformer paper, in Pytorch
Implementation of Chroma, generative models of protein using DDPM and GNNs, in Pytorch
CLASP - Contrastive Language-Aminoacid Sequence Pretraining
Implementation of Classifier Free Guidance in Pytorch, with emphasis on text conditioning, and flexibility to include multiple text embedding models
Explorations into training LLMs to use clinical calculators from patient history, using open sourced models. Will start with Wells' Criteria
Implementation of COCO-LM, Correcting and Contrasting Text Sequences for Language Model Pretraining, in Pytorch
Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch