pytorch/ignite

Support for TorchSnapshot for efficient checkpoint saving and loading

开放

#2,752 创建于 2022年10月24日

 (3 条评论) (0 个反应) (0 位负责人)Python (602 个派生)batch import
enhancementhelp wanted

仓库指标

星标
 (4,313 个星标)
PR 合并指标
 (PR 指标待抓取)

描述

🚀 Feature

TorchSnapshot is a performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind. It includes many optimizations to control for memory usage and optimize checkpoint writing for DDP-style workloads over torch.save/torch.load. For more information, please check out the readme: https://github.com/pytorch/torchsnapshot#why-torchsnapshot

This could be a nice addition to Ignite, similar to the existing Checkpoint handler

cc @yifuwang

贡献者指南