Implementation of Kronecker Attention in Pytorch
Repositories
lucidrains repositories
Implementation of LambdaNetworks, a new approach to image recognition that reaches SOTA with less compute
HTTP client load balancer with retries
Training framework for Large Behavioral Models
An implementation of Transformer with Expire-Span, a circuit for learning which memories to retain
Implementation of Lie Transformer, Equivariant Self-Attention, in Pytorch
Implementation of Lift4d, Harmonizing Single-View 3D Estimation for 4D Reconstruction In-the-Wild, from Litman et al. of Carnegie Mellon
Implementation of a Light Recurrent Unit in Pytorch
Implementation of 'lightweight' GAN, proposed in ICLR 2021, in Pytorch. High resolution image generations that can be trained within a day or two
Transformer based on a variant of attention that is linear complexity in respect to sequence length
Implementation of Linformer for Pytorch
Masked Depth Modeling for Spatial Perception
🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch
Liquid simulator based on Conway's Game of Life
Implementation of the Llama architecture with RLHF + Q-learning
Implementation of Llama2 inference in Nim
An implementation of local windowed attention for language modeling
Local Attention - Flax module for Jax
LocoFormer - Generalist Locomotion via Long-Context Adaptation
Implementation of LogAvgExp for Pytorch