pytorch/ignite
Support for TorchSnapshot for efficient checkpoint saving and loading
開放
#2,752 建立於 2022年10月24日
enhancementhelp wanted
倉庫指標
- 星標
- (4,313 顆星)
- PR 合併指標
- (平均合併 18天 23小時) (30 天內合併 19 個 PR)
描述
🚀 Feature
TorchSnapshot is a performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind. It includes many optimizations to control for memory usage and optimize checkpoint writing for DDP-style workloads over torch.save/torch.load. For more information, please check out the readme: https://github.com/pytorch/torchsnapshot#why-torchsnapshot
This could be a nice addition to Ignite, similar to the existing Checkpoint handler
cc @yifuwang