pytorch/ignite

Support for TorchSnapshot for efficient checkpoint saving and loading

開放

#2,752 建立於 2022年10月24日

 (3 則留言) (0 個反應) (0 位負責人)Python (602 個分叉)batch import
enhancementhelp wanted

倉庫指標

星標
 (4,313 顆星)
PR 合併指標
 (平均合併 18天 23小時) (30 天內合併 19 個 PR)

描述

🚀 Feature

TorchSnapshot is a performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind. It includes many optimizations to control for memory usage and optimize checkpoint writing for DDP-style workloads over torch.save/torch.load. For more information, please check out the readme: https://github.com/pytorch/torchsnapshot#why-torchsnapshot

This could be a nice addition to Ignite, similar to the existing Checkpoint handler

cc @yifuwang

貢獻者指南