Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a mathematical description of AdamW #894

Merged
merged 2 commits into from
Mar 28, 2024

Conversation

gbruno16
Copy link
Contributor

@gbruno16 gbruno16 commented Mar 28, 2024

I added the mathematical description of AdamW starting from Adam's docstring.
This is the result:
adamw

Copy link

google-cla bot commented Mar 28, 2024

Thanks for your pull request! It looks like this may be your first contribution to a Google open source project. Before we can look at your pull request, you'll need to sign a Contributor License Agreement (CLA).

View this failed invocation of the CLA check for more information.

For the most up to date status, view the checks section at the bottom of the pull request.

Copy link
Collaborator

@vroulet vroulet left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you very much! This looks great, and it will be very useful for newcomers and mathematicians. I left a few comments and it'll be ready to go!

optax/_src/alias.py Outdated Show resolved Hide resolved
optax/_src/alias.py Outdated Show resolved Hide resolved
@gbruno16 gbruno16 closed this Mar 28, 2024
@gbruno16 gbruno16 deleted the add-doc-adamw branch March 28, 2024 00:45
@gbruno16 gbruno16 restored the add-doc-adamw branch March 28, 2024 00:47
@gbruno16 gbruno16 reopened this Mar 28, 2024
@gbruno16
Copy link
Contributor Author

I've made the corrections suggested. Let me know if something else is missing!
adamw

@vroulet
Copy link
Collaborator

vroulet commented Mar 28, 2024

Good to go, thank you again!

@copybara-service copybara-service bot merged commit bb5d0c2 into google-deepmind:main Mar 28, 2024
11 checks passed
@fabianp
Copy link
Member

fabianp commented Mar 28, 2024

merging now, thanks @gbruno16 for the contribution!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants