f-dangel/curvlinopsPython
PyTorch linear operators for curvature matrices (Hessian, Fisher/GGN, KFAC, ...)
(68 stars) (15 forks) (0 indexed issues) (0 open good first issues)
Repositories
PyTorch linear operators for curvature matrices (Hessian, Fisher/GGN, KFAC, ...)
[ICML 2024] SINGD: KFAC-like Structured Inverse-Free Natural Gradient Descent (http://arxiv.org/abs/2312.05705)
Code and tutorial on integrating wandb sweeps with Slurm pre-emption