Lightning-AI/pytorch-lightning
在 GitHub 查看Allow obtaining num_nodes from ClusterEnvironment
Open
#7,361 建立於 2021年5月4日
environmentfeaturegood first issuehelp wanted
倉庫指標
- Star
- (26,687 star)
- PR 合併指標
- (平均合併 9天 15小時) (30 天內合併 3 個 PR)
描述
🚀 Feature
num_nodes must currently be specified manually by the user. However, the number of nodes is generally known in a cluster environment [1] and could be provided by and initialized from ClusterEnvironment
[1] For example $AWS_BATCH_JOB_NUM_NODES in https://docs.aws.amazon.com/batch/latest/userguide/multi-node-parallel-jobs.html
Pitch
could be updated to initialize num_nodes from ClusterEnvironment if ClusterEnvironment is provided and implements a num_nodes method.
cc @borda @awaelchli @ananthsub