Multi-Modal Multi-Embodied Hivemind-like Iteration of RTX-2
Repository
Repository di kyegomez
Implementation of a Hierarchical Mamba as described in the paper: "Hierarchical State Space Models for Continuous Sequence-to-Sequence Modeling"
Lessons from hacking books and resources
Revolutionize your farm with HarvestNet! Unleash Multi-Modal AI power for smarter, greener, and more sustainable agriculture. Be part of the agro-future now!
Implementation of the model "Hedgehog" from the paper: "The Hedgehog & the Porcupine: Expressive Linear Attentions with Softmax Mimicry"
An Implementation of an Transformer model that generates tokens non-linearly all at once like the heptapods from Arrival
My implementation of Hindsight replay in PyTorch: "Hindsight Experience Replay"
Automating billions of tasks with millions of autonomous swarms
First ever AI-designed rocket engine for long distance solar travel.
A table of hyper-parameters used by the largest models. Add your favorite's models hyperparams!
A curious inquiry into Ihara-Grubb Transformation algorithms from the cyberpunk universe and trying to implement them in the real-world
Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTORCH
Open-source repository dedicated to advancing AI Reasoning towards superintelligence.
InternVideo: General Video Foundation Models via Generative and Discriminative Learning (https://arxiv.org/abs/2212.03191)
PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"
This repository demonstrates how to build a Decoder-Only Transformer with Multi-Query Attention in JAX.
Humanity's roadmap
KNOTX is a new and theoretical activation function designed for ultra-fast multi-modality learning utilizing knot theory + dynamical systems modeling.
A simple pytorch implementation of a meta learning algorithm from OPENAI "Reptile: A scalable meta-learning algorithm"
My personal implementation of Kosmos-2, Kosmos-2: Grounding Multimodal Large Language Models to the World, much simpler codebase