pytorch/ignite
在 GitHub 查看Support for TorchSnapshot for efficient checkpoint saving and loading
Open
#2,752 创建于 2022年10月24日
enhancementhelp wanted
仓库指标
- Star
- (4,313 star)
- PR 合并指标
- (平均合并 18天 23小时) (30 天内合并 19 个 PR)
描述
🚀 Feature
TorchSnapshot is a performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind. It includes many optimizations to control for memory usage and optimize checkpoint writing for DDP-style workloads over torch.save/torch.load. For more information, please check out the readme: https://github.com/pytorch/torchsnapshot#why-torchsnapshot
This could be a nice addition to Ignite, similar to the existing Checkpoint handler
cc @yifuwang