datahelp wanted
倉庫指標
- 星標
- (5,587 顆星)
- PR 合併指標
- (PR 指標待抓取)
描述
We should prepare datasets for All WMT'17 language pairs. This is also a change to try out google/sentencepiece as a preprocessor.
Each dataset should come in different configurations, i.e. different vocabulary sizes and also have a character-level version.
Together with the raw data files we also need the script that was used for the process.