pytorch/examples

Actor critic example not using discount rate properly

オープン

#744 opened on 2020/03/27

 (3 件のコメント) (0 件のリアクション) (0 人の担当者)Python (9,429 件のフォーク)batch import
good first issuetriaged

Repository metrics

Stars
 (21,634 個のスター)
PR merge metrics
 (PR metrics pending)

説明

The Actor Critic example (which is actually an implementation of REINFORCE-with-baseline as pointed out in https://github.com/pytorch/examples/issues/573), does not use the discount rate properly.

The loss should include \gamma ^ t, as shown in the box on page 330 of Sutton & Barto:

image

コントリビューターガイド