enhancementhelp wantedstale
Repository metrics
- Stars
- (29,107 stars)
- PR merge metrics
- (30d に merged PR はありません)
説明
I used log_output for training purpose, but pytorch complains about inplace operation on backward.
For lines 204 and 205: https://github.com/pytorch/fairseq/blob/e6422528dae0b899848469efe2dc404c1e639ce9/fairseq/modules/adaptive_softmax.py#L200-L208
- why doing a
copy_on tailout - why inplace add_
I changed to
tail_output = ...
... = self.lsm(tail_out) + tail_priors[idxs, i, None]
And it works for training.