Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)
Repositories
lucidrains repositories
Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways
Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
Efficient implementation (and explorations) into polar coordinate positional embedding (PoPE) - from Gopalakrishnan et al. under Schmidhuber
Toward High-Accuracy Open-Source Biomolecular Structure Prediction.
A simplified implementation of DSSP algorithm for PyTorch and NumPy
Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch
Code for running RFdiffusion
Implementation of Recurrent Independent Mechanisms in Pytorch
Implementation of RISE
RITA is a family of autoregressive protein models, developed by LightOn in collaboration with the OATML group at Oxford and the Debora Marks Lab at Harvard.
Implementation of RL-100, Performant Robotic Manipulation with Real-World Reinforcement Learning
Implementation of RQ Transformer, proposed in the paper "Autoregressive Image Generation using Residual Quantization"
RaveForce - An OpenAI Gym style toolkit for music generation experiments.
The correct way to resize images or tensors. For Numpy or Pytorch (differentiable).
Framework for creating (partially) reversible neural networks with PyTorch
Implementation of Soft Actor Critic and some of its improvements in Pytorch
Standard Open Arm 100
Implementation of the model architecture for SRT-H
Implementation of STAM (Space Time Attention Model), a pure and simple attention model that reaches SOTA for video classification