Kaixhin/Atari

Recurrent Dqn

Open

#8 opened on 2016年4月21日

GitHub で見る
 (31 comments) (0 reactions) (0 assignees)Lua (72 forks)github user discovery
enhancementhelp wanted

Repository metrics

Stars
 (263 stars)
PR merge metrics
 (30d に merged PR はありません)

説明

One central element of the Atari DQN is the use of 4 consecutive frames as input making the state more Markov, ie. having the vital dynamic movement information. This paper http://arxiv.org/abs/1507.06527v3 discusses DRQN: the multiframe input can be substituted with LSTM with the same effect (but no systematic advantage for one or the other). Also the Deepmind async paper mentions using LSTM instead of multi frame inputs for more challenging visual domains (Torcs and Labyrinth).

I think this would fit well in this codebase, I'll try to contribute this at one point.

コントリビューターガイド