thu-ml/tianshou

Need a flexible method to record training data in TensorBoard

Open

#895 建立於 2023年6月29日

在 GitHub 查看
 (5 留言) (0 反應) (1 負責人)Python (7,121 star) (1,072 fork)batch import
enhancementgood first issue

描述

  • I have marked all applicable categories:
    • exception-raising bug
    • RL algorithm bug
    • documentation request (i.e. "X is missing from the documentation.")
    • new feature request
  • I have visited the source website
  • I have searched through the issue tracker for duplicates
  • I have mentioned version numbers, operating system and environment, where applicable: 
    import tianshou, gymnasium as gym, torch, numpy, sys
print(tianshou.__version__, gym.__version__, torch.__version__, numpy.__version__, sys.version, sys.platform)
0.5.0 0.26.3 1.12.1 1.21.5 3.7.13 (default, Oct 18 2022, 18:57:03) 
[GCC 11.2.0] linux

Hello, Thanks for your brilliant work! While working with Tianshou, I encountered an issue related to recording training data in TensorBoard. Specifically, I need to record a value from the info dictionary, let's say info["key"], which is similar to an accumulated reward at the end of each episode.

貢獻者指南

技術棧
pythonpytorch
領域
machine learning
議題類型
feature
難度面向新貢獻者的預計實作難度，1 表示很小改動，5 表示專家級工作。
3
預計時間有經驗貢獻者完成調查、實作、測試並準備 pull request 的粗略時間範圍。
1-2 days
活動狀態議題目前的可參與程度：新鮮、活躍、陳舊、阻塞或等待維護者輸入。
blocked
清晰度議題是否清楚說明預期改動、驗收標準和下一步。
clear
前置要求
PythonPyTorchTianshou basicsTensorBoard logging
新手友善度1-100 的估計分數，表示該議題對首次貢獻者的友善程度。
30
研究方向
Investigate the Tianshou logger module, specifically how TensorBoard logging is currently implemented in `tianshou/utils/logging.py` or similar. Look at the existing `TensorboardLogger` class and how it records data during training (e.g., in the trainer). The goal is to add a flexible method that allows users to log arbitrary values from the info dictionary on a per episode basis. Review the trainer loop in `tianshou/trainer/` to understand where logging hooks are called and how to extend them. Check any existing discussions in the issue comments for implementation ideas.