alexrosen45/IpsumGPT

A modular implementation of a causal transformer with scaled dot-product attention, layer normalization, and residual connections.