facebookresearch/fairseq

bf16 with A100 GPUs

オープン

#4,696 opened on 2022/09/05

 (2 件のコメント) (11 件のリアクション) (0 人の担当者)Python (6,224 件のフォーク)batch import
enhancementhelp wantedneeds triage

Repository metrics

Stars
 (29,107 個のスター)
PR merge metrics
 (PR metrics pending)

説明

A100 GPUs should support bf16 unless I am mistaken. I see it's currently only supported with TPUs. Are there any plans to support this?

コントリビューターガイド