EnzymeAD/Enzyme.jl

API for Hessian

Open

#1,495 创建于 2024年6月6日

在 GitHub 查看
 (1 评论) (1 反应) (0 负责人)Julia (96 fork)batch import
good first issue

仓库指标

Star
 (563 star)
PR 合并指标
 (平均合并 5天 1小时) (30 天内合并 76 个 PR)

描述

A hessian / hessian! function in Enzyme would be cool!

Right now the method described in https://enzymead.github.io/Enzyme.jl/stable/generated/autodiff/#Forward-over-reverse uses BatchDuplicated. Am I correct in assuming that, like ForwardDiff's "chunks", Enzyme's "batches" are limited in size by memory bandwitch, typically to the order of 10 elements? If so, should there be a Hessian mode that computes HVPs in batches smaller than the size n?

贡献者指南