DLR-RM/stable-baselines3

[Feature Request] RAINBOW

Open

#622 创建于 2021年10月22日

在 GitHub 查看
 (8 评论) (2 反应) (0 负责人)Python (6,550 star) (1,407 fork)batch import
enhancementhelp wanted

描述

Important Note: We do not do technical support, nor consulting and don't answer personal questions per email. Please post your question on the RL Discord, Reddit or Stack Overflow in that case.

🚀 Feature

Implement RAINBOW (DQN + all extensions: noisy-net, double dqn, dueling, c51, prioritized experience replay).

closes #487 if it is implemented.

Motivation

This would allow to have DQN with all extensions while keeping DQN code simple.

  • I have checked that there is no similar issue in the repo (required)

贡献者指南

技术栈
pythonpytorch
领域
machine learningai
议题类型
feature
难度面向新贡献者的预计实现难度，1 表示很小改动，5 表示专家级工作。
5
预计时间有经验贡献者完成调查、实现、测试并准备 pull request 的粗略时间范围。
over 1 week
活动状态议题当前的可参与程度：新鲜、活跃、陈旧、阻塞或等待维护者输入。
stale
清晰度议题是否清楚说明期望改动、验收标准和下一步。
mostly clear
前置要求
reinforcement learningPyTorchstable baselines3DQN
新手友好度1-100 的估计分数，表示该议题对首次贡献者的友好程度。
15
研究方向
Review the existing DQN implementation in stable baselines3/dqn/. Examine referenced issue #487 for prior discussion. Understand each extension: noisy nets, double DQN, dueling network, C51 distributional RL, and prioritized experience replay. Plan modular integration into the DQN class. Consult the Rainbow paper for algorithmic details.