kaldi-asr/kaldi
在 GitHub 查看Multi-GPU training capability for the Pytorch Transformer LM training script - https://github.com/kaldi-asr/kaldi/blob/master/egs/wsj/s5/local/pytorchnn/run_nnlm.sh
Open
#4,699 创建于 2022年2月16日
enhancementhelp wantedstale-exclude
仓库指标
- Star
- (15,392 star)
- PR 合并指标
- (30 天内没有已合并 PR)
描述
I used the script ### https://github.com/kaldi-asr/kaldi/blob/master/egs/wsj/s5/local/pytorchnn/run_nnlm.sh, but I could not figure out how we could distribute the training of Transformer based LM on multiple GPUs in order to speed-up the Pytorch training. Please suggest if there is any way to do so.
Thanks!