New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fix PPOLoss #396

Merged

trax-robot merged 1 commit into google:master from pkol:fix_ppo_loss

Mar 26, 2020

Contributor

pkol commented Mar 25, 2020

Clipped expression should be multiplied by loss.

Now ppo-loss looks more like in original PPO paper (https://arxiv.org/pdf/1707.06347.pdf)


          Fix PPOLoss

97ad708

Clipped expression should be multiplied by loss.

googlebot added the cla: yes label

Contributor

afrozenator commented Mar 25, 2020

Whoa! Many thanks!

afrozenator added the ready to pull label

trax-robot merged commit e2c6509 into google:master

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cla: yes ready to pull