pytorch/text

Vocab vectors using complete pretrained-embedding?

オープン

#446 opened on 2018/10/12

 (6 件のコメント) (0 件のリアクション) (0 人の担当者)Python (822 件のフォーク)batch import
enhancementhelp wanted

Repository metrics

Stars
 (3,396 個のスター)
PR merge metrics
 (30d に merged PR はありません)

説明

I am new to pytorch and nlp. I have a question when I tried to build a model.

Since my training dataset is not so big, the size of its vocab is relatively small (around 5000). However, I want to deal with any other user input which could be out of this vocabulary.

The problem is, in the model I trained, the embedding layer's weight is based on the vectors of the field, not the whole word2vec pretrained embeddings. So I cannot modified it after the training is done.

I wondered is there any better approach to do it? Thanks in advance!

コントリビューターガイド