pytorch/text

Language modelling dataset only one sample

Open

#381 创建于 2018年9月12日

在 GitHub 查看
 (2 评论) (0 反应) (0 负责人)Python (822 fork)batch import
datasetshelp wanted

仓库指标

Star
 (3,396 star)
PR 合并指标
 (30 天内没有已合并 PR)

描述

from torchtext import data
from torchtext import datasets

TEXT = data.Field(lower=True, batch_first=True)

train, valid, test = datasets.WikiText2.splits(TEXT)

print('len(train)', len(train))

This returns a length of one. It should print the length of the whole dataset. I have tried both with version 0.2.3 and 0.3 and none of them worked.

贡献者指南