Owner

wdlctc

3 indexed repositories · View on GitHub

• open-attention-residuals

  Open implementation of Attention Residuals (Kimi Team, arXiv:2603.15031)

  Python · 83 stars

• delta-attention-residuals-code

  Delta Attention Residuals - supplementary code and pretrained models

  Python · 43 stars

• multi-head-attention-residuals

  Multi-Head Attention Residuals (MHAR): zero-parameter multi-head routing over the depth history — paper + reference implementation

  Python · 12 stars