Fail to converge for Breakout dqn

[yhcao6]

I have train the model for around 4 days, episode now is 14278, while the score is 40 ~ 50, what's the problem?

[zzing0907]

Did you change any parameters?
Changing parameters affect performance very much.

if you give us any other information (like tensorboard graph) than we can figure out more things.
But now we don't have any idea. Sorry.

[yhcao6]

Sorry for late replay. These are images. I don't change any parameters 2017-10-10 22:49 GMT+08:00 youngmoo <[email protected]>:

…

Did you change any parameters? Changing parameters affect performance very much. if you give us any other information (like tensorboard graph) than we can figure out more things. But now we don't have any idea. Sorry. — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#66 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AVnNGcALls8xU-ZgvL1DOLinyHR-chffks5sq4PlgaJpZM4PzP9X> .

[JUZI1]

Hello, I have been troubled by this problem for a long time. How can I solve it

[ppwwyyxx]

Use a better implementation.

e.g. https://github.com/tensorpack/tensorpack/tree/master/examples/DeepQNetwork