pytorch/ignite

Support for TorchSnapshot for efficient checkpoint saving and loading

Open

#2,752 建立於 2022年10月24日

在 GitHub 查看
 (3 留言) (0 反應) (0 負責人)Python (4,313 star) (602 fork)batch import
enhancementhelp wanted

描述

🚀 Feature

TorchSnapshot is a performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind. It includes many optimizations to control for memory usage and optimize checkpoint writing for DDP-style workloads over torch.save/torch.load. For more information, please check out the readme: https://github.com/pytorch/torchsnapshot#why-torchsnapshot

This could be a nice addition to Ignite, similar to the existing Checkpoint handler

cc @yifuwang

貢獻者指南

技術棧
python
領域
machine learning
議題類型
feature
難度面向新貢獻者的預計實作難度，1 表示很小改動，5 表示專家級工作。
3
預計時間有經驗貢獻者完成調查、實作、測試並準備 pull request 的粗略時間範圍。
3-5 days
活動狀態議題目前的可參與程度：新鮮、活躍、陳舊、阻塞或等待維護者輸入。
stale
清晰度議題是否清楚說明預期改動、驗收標準和下一步。
clear
前置要求
PyTorch Ignite basicsUnderstanding of checkpointing concepts
新手友善度1-100 的估計分數，表示該議題對首次貢獻者的友善程度。
30
研究方向
Start by reviewing the existing Checkpoint handler in pytorch/ignite (likely in ignite/handlers/checkpoint.py) to understand the current implementation. Then explore the TorchSnapshot documentation and examples to understand its API and how it could replace or augment the current checkpointing. Consider contributing by implementing a new handler or modifying the existing one to support TorchSnapshot, similar to how Ignite handles other saving methods. Discuss design in the issue comments with maintainers before proceeding.
Support for TorchSnapshot for efficient checkpoint saving and loading · pytorch/ignite#2752 | Good First Issue