TODOs

This is an umbrella issue where we can collectively tackled some problems and improve general open source reading comprehension quality.

Goal The network is already there. We just need to add more features on top of the current model.

• Implement full features stated in the original paper
• Achieve EM/F1 performance stated in the original paper with a single model settings

Model

• Increase the hidden units to 128. #15 reported performance increase when the hidden units increased from 96 to 128
• Increase the number of heads to 8
• Add dropouts in better locations to maximize regularization
• Train "unknown" word embedding

Data

• Implement paraphrasing by back-translation to increase the data size

Contribution to any of these issues is welcome and please comment on this issue and let us know if you want to work on these problems.