f-dangel/backobsPython
Use DeepOBS with BackPACK
(2 star) (3 fork) (1 issue indicizzata) (1 good first issue aperta)
Repository
Use DeepOBS with BackPACK
PyTorch linear operators for curvature matrices (Hessian, Fisher/GGN, KFAC, ...)
[ICML 2024] SINGD: KFAC-like Structured Inverse-Free Natural Gradient Descent (http://arxiv.org/abs/2312.05705)
Code and tutorial on integrating wandb sweeps with Slurm pre-emption