pytorch/text

Vocab vectors using complete pretrained-embedding?

Open

#446 aberto em 12 de out. de 2018

Ver no GitHub
 (6 comments) (0 reactions) (0 assignees)Python (822 forks)batch import
enhancementhelp wanted

Métricas do repositório

Stars
 (3.396 stars)
Métricas de merge de PR
 (Nenhuma PRs mesclada em 30d)

Description

I am new to pytorch and nlp. I have a question when I tried to build a model.

Since my training dataset is not so big, the size of its vocab is relatively small (around 5000). However, I want to deal with any other user input which could be out of this vocabulary.

The problem is, in the model I trained, the embedding layer's weight is based on the vectors of the field, not the whole word2vec pretrained embeddings. So I cannot modified it after the training is done.

I wondered is there any better approach to do it? Thanks in advance!

Guia do colaborador