facebookresearch/fairscale
[feat] make sure AdaScale works with Lightning trainer loop
開放
#293 建立於 2021年1月6日
good first issueicebox
倉庫指標
- 星標
- (3,411 顆星)
- PR 合併指標
- (PR 指標待抓取)
描述
🚀 Feature
as title
Motivation
changing the LR schedule based on the effective step is not easy to do for the user, it would be nice to support it without user's change.
Pitch
make sure adascale works without or with small user impacts
Alternatives
not supporting it
Additional context
surface from an internal discussion and use case