Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix the default learning rate in prodigy #740

Merged
merged 2 commits into from
Feb 1, 2024

Conversation

konstmish
Copy link
Contributor

fixing the current version of Prodigy that has a typo: the learning was set to 0.1 instead of 1.0

@fabianp
Copy link
Member

fabianp commented Jan 28, 2024

Thanks Konstantin! The changes look good to me.

The tests are failing, seems to me for unrelated reasons .... i'm looking into it

Copy link
Member

@fabianp fabianp left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks Konstantin!

@vroulet
Copy link
Collaborator

vroulet commented Jan 28, 2024

Thanks @konstmish! The prodigy test fails with this default learning rate. To fix this, it suffices to change the test for the algorithm to run for 100 000 iterations instead of 10 000 iterations. Could you take care of it in this PR? Thanks!

@fabianp
Copy link
Member

fabianp commented Jan 29, 2024

There seems to be anyway something wrong with the CI. Everything is failing with an obscure ==== ERROR ../::tmp - PermissionError: [Errno 13] Permission denied: '/tmp/snap-private-tmp/__init__.py'

@fabianp
Copy link
Member

fabianp commented Jan 29, 2024

seems its a problem with the most recent release of pytest. Downgrading it seemed to solve the issue: #743

@fabianp
Copy link
Member

fabianp commented Jan 29, 2024

should be fixed now in main (2e69e7f). Please update this branch and 🤞🏼

@copybara-service copybara-service bot merged commit def75e9 into google-deepmind:main Feb 1, 2024
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants