Issues
Open
chooses 15% of token
good first issue
1 comment1 reaction0 assignees
Open
PositionalEmbedding
good first issue
3 comments4 reactions0 assignees
Open
Question about the loss of Masked LM
good first issue
5 comments13 reactions0 assignees
Open
Making Book Corpus
help wanted
5 comments2 reactions0 assignees
Open
Making Wikipedia Corpus
help wanted
1 comment2 reactions0 assignees
Open
Pretrained model transfer to pytorch
enhancementhelp wanted
8 comments11 reactions1 assignee
Open
pred_loss decrease fast while avg_acc stay at 50%
help wantedinvalidquestion
53 comments1 reaction0 assignees
Open
Is it possible to train BERT?
help wantedquestion
7 comments0 reactions1 assignee