Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fine tune PER, fix bugs #131

Merged
merged 33 commits into from
Apr 27, 2017
Merged

fine tune PER, fix bugs #131

merged 33 commits into from
Apr 27, 2017

Commits on Apr 24, 2017

  1. use per for mountain ac

    @kengz
    kengz committed Apr 24, 2017
    Configuration menu
    Copy the full SHA
    32e0634 View commit details
    Browse the repository at this point in the history

  2. mountain per

    @kengz
    kengz committed Apr 24, 2017
    Configuration menu
    Copy the full SHA
    aea3a3f View commit details
    Browse the repository at this point in the history

Commits on Apr 25, 2017

  1. fix per, add missing memory update to ddpg

    @kengz
    kengz committed Apr 25, 2017
    Configuration menu
    Copy the full SHA
    763f78e View commit details
    Browse the repository at this point in the history

  2. add walker ddpg per

    @kengz
    kengz committed Apr 25, 2017
    Configuration menu
    Copy the full SHA
    22c1a2d View commit details
    Browse the repository at this point in the history

Commits on Apr 26, 2017

  1. size down per

    @kengz
    kengz committed Apr 26, 2017
    Configuration menu
    Copy the full SHA
    fc40e88 View commit details
    Browse the repository at this point in the history

  2. narrow down params

    @kengz
    kengz committed Apr 26, 2017
    Configuration menu
    Copy the full SHA
    a352c2e View commit details
    Browse the repository at this point in the history

  3. per for dqn v1

    @kengz
    kengz committed Apr 26, 2017
    Configuration menu
    Copy the full SHA
    9cd6f61 View commit details
    Browse the repository at this point in the history

  4. fix and generalize shape assert

    @kengz
    kengz committed Apr 26, 2017
    Configuration menu
    Copy the full SHA
    eeba6df View commit details
    Browse the repository at this point in the history

  5. fix assert in shape

    @kengz
    kengz committed Apr 26, 2017
    Configuration menu
    Copy the full SHA
    4156956 View commit details
    Browse the repository at this point in the history

  6. remove offset in botlzman qstate

    @kengz
    kengz committed Apr 26, 2017
    Configuration menu
    Copy the full SHA
    186cc08 View commit details
    Browse the repository at this point in the history

  7. import np in sarsa

    @kengz
    kengz committed Apr 26, 2017
    Configuration menu
    Copy the full SHA
    13f6f6e View commit details
    Browse the repository at this point in the history

  8. fix critic assert dim

    @kengz
    kengz committed Apr 26, 2017
    Configuration menu
    Copy the full SHA
    d2d2a9c View commit details
    Browse the repository at this point in the history

  9. clipval for boltzmann at 200

    @kengz
    kengz committed Apr 26, 2017
    Configuration menu
    Copy the full SHA
    e67cced View commit details
    Browse the repository at this point in the history

  10. guard overflow again

    @kengz
    kengz committed Apr 26, 2017
    Configuration menu
    Copy the full SHA
    77311ef View commit details
    Browse the repository at this point in the history

  11. restore underflow fix

    @kengz
    kengz committed Apr 26, 2017
    Configuration menu
    Copy the full SHA
    ef40317 View commit details
    Browse the repository at this point in the history

  12. minor refactor

    @kengz
    kengz committed Apr 26, 2017
    Configuration menu
    Copy the full SHA
    41f30a9 View commit details
    Browse the repository at this point in the history

  13. clear out unused specs

    @kengz
    kengz committed Apr 26, 2017
    Configuration menu
    Copy the full SHA
    f4cc428 View commit details
    Browse the repository at this point in the history

  14. drop index col from csv

    @kengz
    kengz committed Apr 26, 2017
    Configuration menu
    Copy the full SHA
    43d89ed View commit details
    Browse the repository at this point in the history

  15. mute per test

    @kengz
    kengz committed Apr 26, 2017
    Configuration menu
    Copy the full SHA
    7d5e692 View commit details
    Browse the repository at this point in the history

  16. fix sarsa test

    @kengz
    kengz committed Apr 26, 2017
    Configuration menu
    Copy the full SHA
    668729a View commit details
    Browse the repository at this point in the history

  17. boltzman fix overflow by np float64; remove offset minus

    @kengz
    kengz committed Apr 26, 2017
    Configuration menu
    Copy the full SHA
    d7f5cec View commit details
    Browse the repository at this point in the history

  18. schedule mountain dqn per

    @kengz
    kengz committed Apr 26, 2017
    Configuration menu
    Copy the full SHA
    efa048e View commit details
    Browse the repository at this point in the history

  19. auto memlen for PER as 1/3 epi * timestep

    @kengz
    kengz committed Apr 26, 2017
    Configuration menu
    Copy the full SHA
    8781232 View commit details
    Browse the repository at this point in the history

  20. auto mem len for walker, use PER for lunar

    @kengz
    kengz committed Apr 26, 2017
    Configuration menu
    Copy the full SHA
    071e13f View commit details
    Browse the repository at this point in the history

  21. fix assert size for ddpg

    @kengz
    kengz committed Apr 26, 2017
    Configuration menu
    Copy the full SHA
    0457845 View commit details
    Browse the repository at this point in the history

  22. reorganize tests

    @kengz
    kengz committed Apr 26, 2017
    Configuration menu
    Copy the full SHA
    2ea4b34 View commit details
    Browse the repository at this point in the history

  23. add more tests

    @kengz
    kengz committed Apr 26, 2017
    Configuration menu
    Copy the full SHA
    21d8578 View commit details
    Browse the repository at this point in the history

  24. mute atari to speed up test

    @kengz
    kengz committed Apr 26, 2017
    Configuration menu
    Copy the full SHA
    96cfcbf View commit details
    Browse the repository at this point in the history

Commits on Apr 27, 2017

  1. guard continuous action range in policy

    @kengz
    kengz committed Apr 27, 2017
    Configuration menu
    Copy the full SHA
    193ab59 View commit details
    Browse the repository at this point in the history

  2. add dqn_per to start per testing

    @kengz
    kengz committed Apr 27, 2017
    Configuration menu
    Copy the full SHA
    93dcb2d View commit details
    Browse the repository at this point in the history

  3. add epsilonnoise policy

    @kengz
    kengz committed Apr 27, 2017
    Configuration menu
    Copy the full SHA
    9d4ccd3 View commit details
    Browse the repository at this point in the history

  4. fix analytics param sourcing

    @kengz
    kengz committed Apr 27, 2017
    Configuration menu
    Copy the full SHA
    e9de40e View commit details
    Browse the repository at this point in the history

  5. use default mem_len for mountain per

    @kengz
    kengz committed Apr 27, 2017
    Configuration menu
    Copy the full SHA
    d54676e View commit details
    Browse the repository at this point in the history