thu-ml/tianshou

Need a flexible method to record training data in TensorBoard

Open

#895 创建于 2023年6月29日

在 GitHub 查看
 (5 评论) (0 反应) (1 负责人)Python (7,121 star) (1,072 fork)batch import
enhancementgood first issue

描述

  • I have marked all applicable categories:
    • exception-raising bug
    • RL algorithm bug
    • documentation request (i.e. "X is missing from the documentation.")
    • new feature request
  • I have visited the source website
  • I have searched through the issue tracker for duplicates
  • I have mentioned version numbers, operating system and environment, where applicable: 
    import tianshou, gymnasium as gym, torch, numpy, sys
print(tianshou.__version__, gym.__version__, torch.__version__, numpy.__version__, sys.version, sys.platform)
0.5.0 0.26.3 1.12.1 1.21.5 3.7.13 (default, Oct 18 2022, 18:57:03) 
[GCC 11.2.0] linux

Hello, Thanks for your brilliant work! While working with Tianshou, I encountered an issue related to recording training data in TensorBoard. Specifically, I need to record a value from the info dictionary, let's say info["key"], which is similar to an accumulated reward at the end of each episode.

贡献者指南

技术栈
pythonpytorch
领域
machine learning
议题类型
feature
难度面向新贡献者的预计实现难度，1 表示很小改动，5 表示专家级工作。
3
预计时间有经验贡献者完成调查、实现、测试并准备 pull request 的粗略时间范围。
1-2 days
活动状态议题当前的可参与程度：新鲜、活跃、陈旧、阻塞或等待维护者输入。
blocked
清晰度议题是否清楚说明期望改动、验收标准和下一步。
clear
前置要求
PythonPyTorchTianshou basicsTensorBoard logging
新手友好度1-100 的估计分数，表示该议题对首次贡献者的友好程度。
30
研究方向
Investigate the Tianshou logger module, specifically how TensorBoard logging is currently implemented in `tianshou/utils/logging.py` or similar. Look at the existing `TensorboardLogger` class and how it records data during training (e.g., in the trainer). The goal is to add a flexible method that allows users to log arbitrary values from the info dictionary on a per episode basis. Review the trainer loop in `tianshou/trainer/` to understand where logging hooks are called and how to extend them. Check any existing discussions in the issue comments for implementation ideas.