Pipeline parallelism for the minimalist
Repositories
crazyguitar repositories
Implementations of basic RL algorithms with minimal lines of codes! (pytorch based)
A very minimal example to get LLM models working with FSDP. The goal is to be minimal, yet scalable to demonstrate the strengths of FSDP.
An interactive TLS-capable intercepting HTTP proxy for penetration testers and software developers
PyTorch Re-Implementation of "The Sparsely-Gated Mixture-of-Experts Layer" by Noam Shazeer et al. https://arxiv.org/abs/1701.06538
A Pytorch implementation of Sparsely-Gated Mixture of Experts, for massively increasing the parameter count of language models
Machine Learning Engineering Open Book
Code for a simple MLP (Multi-Layer Perceptron)
A cheatsheet of modern C language and library features.
A cheatsheet of modern C++ language and library features.
Run OpenClaw, (formerly Moltbot, formerly Clawdbot) on Cloudflare Workers
Infection Monkey - An automated pentest tool
This repository contains opportunities for you to apply to more than 300 product base companies(NOT JUST FAANGM) & good start-ups.
MPI programming lessons in C and executable code examples
Public repository of the Micro QuickJS Javascript Engine
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.6, DeepSeek-R1, GLM-5, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM4.5v, Llava, Phi4, ...) (AAAI 2025).
MSCCL++: A GPU-driven communication stack for scalable AI applications
Examples demonstrating available options to program multiple GPUs in a single node or a cluster
machine learning algorithm
Compiler from type annotated Python to C extensions