rlworkgroup/garage

Add option to Evaluator for recording videos

开放

#1,862 创建于 2020年8月6日

 (1 条评论) (1 个反应) (0 位负责人)Python (297 个派生)batch import
featuregood first issue

仓库指标

星标
 (1,728 个星标)
PR 合并指标
 (30 天内没有已合并 PR)

描述

This is definitely a nice to have -- It'd be nice if as a part of snapshots, we could have the option to record the policy being rolled out deterministically for a few rollouts, so that we can watch its behavior in our various environments. I haven't had much success using the out of the box tool that open ai gym provides for this, called the gym Monitor wrapper. It requires that all environments internally return a Done signal after max_path_length steps. Perhaps we can get around this by wrapping environments with the open ai gymtimelimit wrapper.

Alternatively someone could look at the stable baselines vec video recorder wrapper. It seems that they have some type of video recorder, however it doesn't work out of the box with garage since stable baselines has pinned versions of TF and other libraries necessary to garage.

贡献者指南