pytorch/text

Vocab vectors using complete pretrained-embedding?

开放

#446 创建于 2018年10月12日

 (6 条评论) (0 个反应) (0 位负责人)Python (822 个派生)batch import
enhancementhelp wanted

仓库指标

星标
 (3,396 个星标)
PR 合并指标
 (30 天内没有已合并 PR)

描述

I am new to pytorch and nlp. I have a question when I tried to build a model.

Since my training dataset is not so big, the size of its vocab is relatively small (around 5000). However, I want to deal with any other user input which could be out of this vocabulary.

The problem is, in the model I trained, the embedding layer's weight is based on the vectors of the field, not the whole word2vec pretrained embeddings. So I cannot modified it after the training is done.

I wondered is there any better approach to do it? Thanks in advance!

贡献者指南