facebookresearch/fairseq

bf16 with A100 GPUs

開放

#4,696 建立於 2022年9月5日

 (2 則留言) (11 個反應) (0 位負責人)Python (6,224 個分叉)batch import
enhancementhelp wantedneeds triage

倉庫指標

星標
 (29,107 顆星)
PR 合併指標
 (PR 指標待抓取)

描述

A100 GPUs should support bf16 unless I am mistaken. I see it's currently only supported with TPUs. Are there any plans to support this?

貢獻者指南