localminimum/QANet

TODOs

Open

#13 aperta il 26 apr 2018

Vedi su GitHub
 (6 commenti) (0 reazioni) (0 assegnatari)Python (310 fork)batch import
help wanted

Metriche repository

Star
 (988 star)
Metriche merge PR
 (Nessuna PR mergiata in 30 g)

Descrizione

This is an umbrella issue where we can collectively tackled some problems and improve general open source reading comprehension quality.

Goal The network is already there. We just need to add more features on top of the current model.

  • Implement full features stated in the original paper
  • Achieve EM/F1 performance stated in the original paper with a single model settings

Model

  • Increase the hidden units to 128. #15 reported performance increase when the hidden units increased from 96 to 128
  • Increase the number of heads to 8
  • Add dropouts in better locations to maximize regularization
  • Train "unknown" word embedding

Data

  • Implement paraphrasing by back-translation to increase the data size

Contribution to any of these issues is welcome and please comment on this issue and let us know if you want to work on these problems.

Guida contributor