facebookresearch/fairseq

bf16 with A100 GPUs

开放

#4,696 创建于 2022年9月5日

 (2 条评论) (11 个反应) (0 位负责人)Python (6,224 个派生)batch import
enhancementhelp wantedneeds triage

仓库指标

星标
 (29,107 个星标)
PR 合并指标
 (PR 指标待抓取)

描述

A100 GPUs should support bf16 unless I am mistaken. I see it's currently only supported with TPUs. Are there any plans to support this?

贡献者指南