Lightning-AI/pytorch-lightning

Load callback states while testing.

Open

#5.542 geöffnet am 16. Jan. 2021

Auf GitHub ansehen
 (21 Kommentare) (0 Reaktionen) (0 zugewiesene Personen)Python (3.233 Forks)batch import
checkpointingfeaturehelp wantedpriority: 1trainer: testtrainer: validate

Repository-Metriken

Stars
 (26.687 Stars)
PR-Merge-Metriken
 (Durchschn. Merge 9T 15h) (3 gemergte PRs in 30 T)

Beschreibung

🚀 Feature

Load callback states while testing.

Motivation

https://github.com/PyTorchLightning/pytorch-lightning/pull/5161#issuecomment-759083492

Pitch

Two possible API changes:

with an additional argument restore_states:

test(ckpt_path, restore_states=True/False)  # give an option whether to load states or not
test(model, ckpt_path, restore_states=True/False)  # same as above but will just load checkpoint states and not the model

# raise an error
test(ckpt_path=None, restore_states=True)

or without any additional argument:

test(ckpt_path)  # always load states
test(ckpt_path=None)  # don't load any states.
test(model, ckpt_path)  # reload checkpoint states only from ckpt_path

Alternatives

Alternatively, one can just reload checkpoints manually, call on_load_checkpoint for all the callbacks manually, and test.

PS: There may be a better solution. Open to suggestions :) cc: @ananthsub

cc @borda @awaelchli @ananthsub @ninginthecloud @rohitgr7 @tchaton @akihironitta

Contributor Guide