radixark/miles

Weight update bitwise correctness checker

Offen

#405 geöffnet am 06.01.2026

 (1 Kommentar) (0 Reaktionen) (0 zugewiesene Personen)Python (244 Forks)github user discovery
enhancementhelp wanted

Repository-Metriken

Stars
 (1.513 Sterne)
PR-Merge-Metriken
 (Durchschn. Merge 9T 17h) (200 gemergte PRs in 30 T)

Beschreibung

Currently I have already supported some weight checking logic. It would be great if we make it a test, and/or check every time. I do not have time recently thus write this as an issue.

I guess there may be a few things to do:

  • Try to enable those flags and see whether there are any issues (or it works well and only enable that flag), especially if we want to enable it by default for all cases
  • May implement some logic like bf16 training fp8 rollout checker etc
  • May support things like "compute checksum in miles weight, compute checksum in sglang weight (after updates), check whether they are identical"

Contributor Guide