开放
Integrate LucidRain's RotaryEmbeddings
enhancementgood first issue
2 条评论0 个反应0 负责人
议题
开放
Remove apex dependency after PyTorch 2.0?
better-enggood first issue
3 条评论0 个反应1 负责人
开放
Remove Megatron dependency - move entirely to Fairscale
better-enggood first issue
1 条评论0 个反应1 负责人
开放
Convert string matches to enum comparison if possible
better-engconfigenhancementgood first issue
4 条评论0 个反应0 负责人
开放
Unify tokenizers
better-engenhancementgood first issue
1 条评论1 个反应1 负责人
开放
Add Model FLOPS Utilization and Hardware FLOPS utilization % to the logs.
better-engenhancementgood first issuetelemetry
2 条评论6 个反应0 负责人
开放
Track all of our RNG offsets to avoid collisions
enhancementgood first issue
0 条评论0 个反应0 负责人
开放
Add tests for MultiplePadDataset class
better-engenhancementgood first issue
2 条评论0 个反应0 负责人