mirage-project/mirage

Supporting RMSNorm at kernel level

Open

#253 opened on Apr 22, 2025

View on GitHub
 (0 comments) (0 reactions) (0 assignees)Cuda (232 forks)auto 404
good first issue

Repository metrics

Stars
 (2,381 stars)
PR merge metrics
 (PR metrics pending)

Description

Currently RMSNorm is not supported at the kernel level in the search. Supporting it would allow for more optimizations for this operator.

Contributor guide

Research direction
Study existing kernel implementations of LayerNorm in Mirage, then adapt to RMSNorm by removing the mean subtraction and adjusting the normalization factor.
Tech stack
None
Domain
ai infra agentsbackend
Issue type
Feature
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
4
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
1-2 days
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Fresh
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Clear
Prerequisites
CudaLLM kernel knowledge
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
30