facebookresearch/fairscale
[feat] make sure AdaScale works with Lightning trainer loop
开放
#293 创建于 2021年1月6日
good first issueicebox
仓库指标
- 星标
- (3,411 个星标)
- PR 合并指标
- (PR 指标待抓取)
描述
🚀 Feature
as title
Motivation
changing the LR schedule based on the effective step is not easy to do for the user, it would be nice to support it without user's change.
Pitch
make sure adascale works without or with small user impacts
Alternatives
not supporting it
Additional context
surface from an internal discussion and use case