pytorch/text

Vocab vectors using complete pretrained-embedding?

開放

#446 建立於 2018年10月12日

 (6 則留言) (0 個反應) (0 位負責人)Python (822 個分叉)batch import
enhancementhelp wanted

倉庫指標

星標
 (3,396 顆星)
PR 合併指標
 (30 天內沒有已合併 PR)

描述

I am new to pytorch and nlp. I have a question when I tried to build a model.

Since my training dataset is not so big, the size of its vocab is relatively small (around 5000). However, I want to deal with any other user input which could be out of this vocabulary.

The problem is, in the model I trained, the embedding layer's weight is based on the vectors of the field, not the whole word2vec pretrained embeddings. So I cannot modified it after the training is done.

I wondered is there any better approach to do it? Thanks in advance!

貢獻者指南