Code

Soft Actor-Critic#398

Code

Merged

kengz merged 37 commits intomasterkengz/SLM-Lab:masterfrom sackengz/SLM-Lab:sacCopy head branch name to clipboardAug 4, 2019

+876-281

Commits

Commits on Aug 1, 2019

• add SAC class outline and spec

  kengz

  committed
  a347afa

  Copy full SHA for a347afa

• add calc_val_loss

  kengz

  committed
  c093d15

  Copy full SHA for c093d15

• finish first SAC implementation

  kengz

  committed
  e698b32

  Copy full SHA for e698b32

• allow use of num_envs by offsetting with training iter

  kengz

  committed
  d78827c

  Copy full SHA for d78827c

• expose training_iter to spec

  kengz

  committed
  795d13e

  Copy full SHA for 795d13e

• add async_sac spec

  kengz

  committed
  461d32e

  Copy full SHA for 461d32e

• add continuous action bound fix

  kengz

  committed
  1ea3582

  Copy full SHA for 1ea3582

• fix random_baseline env filter

  kengz

  committed
  b6636cf

  Copy full SHA for b6636cf

• update random baselines for roboschool

  kengz

  committed
  c5519a5

  Copy full SHA for c5519a5

• lower log freq

  kengz

  committed
  ff82344

  Copy full SHA for ff82344

• update enjoy mode doc

  kengz

  committed
  672672f

  Copy full SHA for 672672f

• add sac bipedalwalker spec

  kengz

  committed
  db7bd77

  Copy full SHA for db7bd77

• add tanh to action rsample

  kengz

  committed
  e9216bf

  Copy full SHA for e9216bf

Commits on Aug 2, 2019

• fix SAC

  kengz

  committed
  4234eba

  Copy full SHA for 4234eba

• update PER error term

  kengz

  committed
  63b4c6f

  Copy full SHA for 63b4c6f

• add SAC+PER spec

  kengz

  committed
  b8dc8a7

  Copy full SHA for b8dc8a7

• use body batch_size as default training_start_step

  kengz

  committed
  b4202d1

  Copy full SHA for b4202d1

• remove sac target net copy to follow the paper

  kengz

  committed
  782f1a8

  Copy full SHA for 782f1a8

• use purely random action before training sac

  kengz

  committed
  5e64e88

  Copy full SHA for 5e64e88

• fix sac random action shape

  kengz

  committed
  e18bae0

  Copy full SHA for e18bae0

• remove cont_hard specs

  kengz

  committed
  6e1dce9

  Copy full SHA for 6e1dce9

• move ac roboschool spec down

  kengz

  committed
  97f8db4

  Copy full SHA for 97f8db4

• add sac specs

  kengz

  committed
  a447ad8

  Copy full SHA for a447ad8

• split ac roboschool specs to new files

  kengz

  committed
  065f04b

  Copy full SHA for 065f04b

• add async_sac spec

  kengz

  committed
  7a4e19a

  Copy full SHA for 7a4e19a

• add SAC to README

  kengz

  committed
  59b6a0b

  Copy full SHA for 59b6a0b

• set session to 4

  kengz

  committed
  4a37762

  Copy full SHA for 4a37762

Commits on Aug 3, 2019

• wrap agent.act in no_grad for speedup

  kengz

  committed
  75d9f3e

  Copy full SHA for 75d9f3e

• add discrete action for SAC using RelaxedOneHotCategorical with rsample

  kengz

  committed
  5a126fc

  Copy full SHA for 5a126fc

Commits on Aug 4, 2019

• add default temperature for relaxed discrete policy dist

  kengz

  committed
  34c2e6f

  Copy full SHA for 34c2e6f

• fix analyze session min condition

  kengz

  committed
  10442f4

  Copy full SHA for 10442f4

• commit the best lunar spec found

  kengz

  committed
  1a891bd

  Copy full SHA for 1a891bd

• remove arbitrary action clamp

  kengz

  committed
  7a66dc0

  Copy full SHA for 7a66dc0

• fix policy loss to use q_preds instead of q1_preds. lunar working

  kengz

  committed
  c7fb22d

  Copy full SHA for c7fb22d

• commit lunar search spec

  kengz

  committed
  016618c

  Copy full SHA for 016618c

• add Roboschool benchmark table

  kengz

  committed
  9934616

  Copy full SHA for 9934616

• fix sac readme typo

  kengz

  committed
  a6c06e7

  Copy full SHA for a6c06e7