pytorch/vision

Classification references does not work without distributed setup

Open

#6,529 建立於 2022年9月1日

在 GitHub 查看
 (2 留言) (0 反應) (0 負責人)Python (15,050 star) (6,858 fork)batch import
bughelp wantedmodule: reference scripts

描述

If you don't set the respective env vars

https://github.com/pytorch/vision/blob/d5bd8b728f14c33b339fc45c90ca39be339bce3f/references/classification/utils.py#L255-L258

training will not be distributed and in turn the backend will not be initialized. However, during evaluation we check

https://github.com/pytorch/vision/blob/d5bd8b728f14c33b339fc45c90ca39be339bce3f/references/classification/train.py#L88

unguarded, which then fails with

RuntimeError: Default process group has not been initialized, please make sure to call init_process_group.

cc @datumbox

貢獻者指南

技術棧
pythonpytorch
領域
machine learningbackend
議題類型
bug
難度面向新貢獻者的預計實作難度，1 表示很小改動，5 表示專家級工作。
3
預計時間有經驗貢獻者完成調查、實作、測試並準備 pull request 的粗略時間範圍。
1-3 hours
活動狀態議題目前的可參與程度：新鮮、活躍、陳舊、阻塞或等待維護者輸入。
stale
清晰度議題是否清楚說明預期改動、驗收標準和下一步。
clear
前置要求
basic Pythonbasic PyTorchunderstanding of torch.distributed
新手友善度1-100 的估計分數，表示該議題對首次貢獻者的友善程度。
70
研究方向
The issue is in PyTorch Vision's classification reference scripts. The bug occurs when distributed training env vars are not set, causing an unguarded `dist.*` call in `references/classification/train.py` line 88. The fix should add a check like `if dist.is available() and dist.is initialized()` before using distributed utilities. Also ensure that `utils.py` lines 255-258 properly guard the distributed initialization. See the linked lines in the issue for exact locations.