datahelp wanted
倉庫指標
- Star
- (5,587 star)
- PR 合併指標
- (30 天內沒有已合併 PR)
描述
We should prepare datasets for All WMT'17 language pairs. This is also a change to try out google/sentencepiece as a preprocessor.
Each dataset should come in different configurations, i.e. different vocabulary sizes and also have a character-level version.
Together with the raw data files we also need the script that was used for the process.