pyro-ppl/pyro

Implement Nonparametric Hamiltonian Monte Carlo

開放

#2,903 建立於 2021年7月15日

 (0 則留言) (0 個反應) (0 位負責人)Python (981 個分叉)batch import
discussionenhancementhelp wanted

倉庫指標

星標
 (8,211 顆星)
PR 合併指標
 (平均合併 10天 19小時) (30 天內合併 1 個 PR)

描述

This issue proposes adding an implementation of nonparametric Hamiltonian Monte Carlo, a modified version of HMC that provably correctly handles models with stochastic control flow, unlike vanilla HMC.

@fzaiser (one of the paper's authors) has open-sourced a PyTorch reference implementation, and turning this into a Pyro inference algorithm would be a great project for contributors with some preexisting interest in and knowledge of the line of research (on extensions of gradient-based approximate inference algorithms to discontinuous models) embodied in the paper.

Some questions for discussion:

  1. What extra information about the model is necessary to support the algorithms used in the paper's experiments?
  2. Can this information be extracted automatically, or would it require additional user-supplied annotations?
  3. Would it make more sense to implement this functionality in a new MCMC kernel or to modify our existing HMC kernels?
  4. Would NumPyro be a better substrate for this algorithm since Jax does not compile away control flow?

貢獻者指南