datahelp wanted
仓库指标
- 星标
- (5,587 个星标)
- PR 合并指标
- (PR 指标待抓取)
描述
We should prepare datasets for All WMT'17 language pairs. This is also a change to try out google/sentencepiece as a preprocessor.
Each dataset should come in different configurations, i.e. different vocabulary sizes and also have a character-level version.
Together with the raw data files we also need the script that was used for the process.