pytorch/text

Language modelling dataset only one sample

开放

#381 创建于 2018年9月12日

 (2 条评论) (0 个反应) (0 位负责人)Python (822 个派生)batch import
datasetshelp wanted

仓库指标

星标
 (3,396 个星标)
PR 合并指标
 (30 天内没有已合并 PR)

描述

from torchtext import data
from torchtext import datasets

TEXT = data.Field(lower=True, batch_first=True)

train, valid, test = datasets.WikiText2.splits(TEXT)

print('len(train)', len(train))

This returns a length of one. It should print the length of the whole dataset. I have tried both with version 0.2.3 and 0.3 and none of them worked.

贡献者指南