pytorch/ignite

enable automatic mixed precision for xla

開放

#1,931 建立於 2021年4月12日

 (9 則留言) (1 個反應) (0 位負責人)Python (602 個分叉)batch import
enhancementhelp wanted

倉庫指標

星標
 (4,313 顆星)
PR 合併指標
 (PR 指標待抓取)

描述

Feature

Automatic mixed precision for xla has landed in pytorch 1.8.1 and torch/xla nightly. We should enable it in create_supervised_* helper functions.

Suggested solution

Remove xla and amp checks in _check_arg().

  • For create_supervised_trainer, update supervised_training_step_tpu() function to accept scaler argument just like supervised_training_step_amp().
  • For create_supervised_evaluator, just removing xla and amp checks in _check_arg() should work.
  • For tests, we could remove xla checks and only run with pytorch 1.8.1.

Additional context

This feature should not be included in ignite release until the next torch and xla comes out.

貢獻者指南