pytorch/ignite

Support for TorchSnapshot for efficient checkpoint saving and loading

Open

#2,752 opened on 2022幎10月24日

GitHub で芋る
 (3 comments) (0 reactions) (0 assignees)Python (602 forks)batch import
enhancementhelp wanted

Repository metrics

Stars
 (4,313 stars)
PR merge metrics
 (平均マヌゞ 18d 23h) (30d で 19 merged PRs)

説明

🚀 Feature

TorchSnapshot is a performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind. It includes many optimizations to control for memory usage and optimize checkpoint writing for DDP-style workloads over torch.save/torch.load. For more information, please check out the readme: https://github.com/pytorch/torchsnapshot#why-torchsnapshot

This could be a nice addition to Ignite, similar to the existing Checkpoint handler

cc @yifuwang

コントリビュヌタヌガむド