pytorch/text

Language modelling dataset only one sample

オープン

#381 opened on 2018/09/12

 (2 件のコメント) (0 件のリアクション) (0 人の担当者)Python (822 件のフォーク)batch import
datasetshelp wanted

Repository metrics

Stars
 (3,396 個のスター)
PR merge metrics
 (30d に merged PR はありません)

説明

from torchtext import data
from torchtext import datasets

TEXT = data.Field(lower=True, batch_first=True)

train, valid, test = datasets.WikiText2.splits(TEXT)

print('len(train)', len(train))

This returns a length of one. It should print the length of the whole dataset. I have tried both with version 0.2.3 and 0.3 and none of them worked.

コントリビューターガイド