f-dangel/curvlinopsPython
PyTorch linear operators for curvature matrices (Hessian, Fisher/GGN, KFAC, ...)
(68 stars) (15 forks) (0 件の索引済み issue) (0 件のオープンな good first issue)
リポジトリ
PyTorch linear operators for curvature matrices (Hessian, Fisher/GGN, KFAC, ...)
[ICML 2024] SINGD: KFAC-like Structured Inverse-Free Natural Gradient Descent (http://arxiv.org/abs/2312.05705)
Code and tutorial on integrating wandb sweeps with Slurm pre-emption