kaldi-asr/kaldi
GitHub で見るMulti-GPU training capability for the Pytorch Transformer LM training script - https://github.com/kaldi-asr/kaldi/blob/master/egs/wsj/s5/local/pytorchnn/run_nnlm.sh
Open
#4,699 opened on 2022年2月16日
enhancementhelp wantedstale-exclude
Repository metrics
- Stars
- (15,392 stars)
- PR merge metrics
- (30d に merged PR はありません)
説明
I used the script ### https://github.com/kaldi-asr/kaldi/blob/master/egs/wsj/s5/local/pytorchnn/run_nnlm.sh, but I could not figure out how we could distribute the training of Transformer based LM on multiple GPUs in order to speed-up the Pytorch training. Please suggest if there is any way to do so.
Thanks!