facebookresearch/fairseq

Is there any plans to support torch.export?

开放

#5,519 创建于 2024年7月5日

 (0 条评论) (0 个反应) (0 位负责人)Python (6,224 个派生)batch import
enhancementhelp wantedneeds triage

仓库指标

星标
 (29,107 个星标)
PR 合并指标
 (PR 指标待抓取)

描述

Hello.

Is there any plans to support torch.export? It would be awesome for developers who wants compilation of fairseq for backends or their deep learning accelerators.

The code would be like below.

from fairseq.models import FairseqEncoderDecoderModel
import torch

translator= FairseqEncoderDecoderModel.from_pretrained(
    # ..
)
example_inputs = translator.dummy_inputs

with torch.no_grad():
    ep = torch.export.export(translator_model, example_inputs)

贡献者指南