Lightning-AI/pytorch-lightning
Allow obtaining num_nodes from ClusterEnvironment
オープン
#7,361 opened on 2021/05/04
environmentfeaturegood first issuehelp wanted
Repository metrics
- Stars
- (26,687 個のスター)
- PR merge metrics
- (平均マージ 9d 15h) (30d で 3 merged PRs)
説明
🚀 Feature
num_nodes must currently be specified manually by the user. However, the number of nodes is generally known in a cluster environment [1] and could be provided by and initialized from ClusterEnvironment
[1] For example $AWS_BATCH_JOB_NUM_NODES in https://docs.aws.amazon.com/batch/latest/userguide/multi-node-parallel-jobs.html
Pitch
could be updated to initialize num_nodes from ClusterEnvironment if ClusterEnvironment is provided and implements a num_nodes method.
cc @borda @awaelchli @ananthsub