Exploration and eventually practical implementation for the Multistep Quasimetric Estimation proposed by Zheng et al. of Berkeley
Repositories
lucidrains repositories
Implementation of Multistream Transformers in Pytorch
Implementation of Muse: Text-to-Image Generation via Masked Generative Transformers, in Pytorch
Implementation of MusicLM, Google's new SOTA model for music generation using attention networks, in Pytorch
Implementation of N-Grammer, augmenting Transformers with latent n-grams, in Pytorch
Quick implementation of nGPT, learning entirely on the hypersphere, from NvidiaAI
Implementation of the sparse attention pattern proposed by the Deepseek team in their "Native Sparse Attention" paper
Implementation of Natural Speech 2, Zero-shot Speech and Singing Synthesizer, in Pytorch
Explorations into NEAT and some of its derivative research
Explorations into the proposed NeuralGrok from Zhou et al. of EPFL
Implementation of Nvidia's NeuralPlexer, for end-to-end differentiable design of functional small-molecules and ligand-binding proteins, in Pytorch
Implementation of the Neural Sequence Chunker, Schmidhuber paper back from 1991, in the context of Attention and Transformers
a simple genetic algorithm written in Nim
Parser for mmCIF files in Nim
Implementation of a simple BPE tokenizer, but in Nim
Alternative Twitter front-end
🤗 nlp: datasets and evaluation metrics for Natural Language Processing in NumPy, Pandas, PyTorch and TensorFlow
🧬 Nucleotide Transformer: Building and Evaluating Robust Foundation Models for Human Genomics
Implementation of NÜWA, state of the art attention network for text to video synthesis, in Pytorch
Implementation of Nyström Self-attention, from the paper Nyströmformer