Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Hyperparam callable improvements #42

Merged
merged 2 commits into from
Apr 14, 2022
Merged

Hyperparam callable improvements #42

merged 2 commits into from
Apr 14, 2022

Conversation

gpauloski
Copy link
Owner

Description

Hyperparam callables now take the current K-FAC step as input.
Added reference hyperparameter schedules.
Currently the only one is the exponentially decaying factor running average weight of Martens 2015.

Fixes N/A

Type of Change

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • Documentation update (no changes to the code)
  • CI change (changes to CI workflows, packages, templates, etc.)

Testing

Update existing unit tests and added new ones accordingly.

Pull Request Checklist

Please confirm the PR meets the following requirements.

  • Code changes pass pre-commit (e.g., black, flake8, mypy, etc.).
  • Tests have been added to show the fix is effective or that the new feature works.
  • New and existing unit tests pass locally with the changes.
  • Docs have been updated and reviewed if relevant.

@gpauloski gpauloski merged commit 77d256e into main Apr 14, 2022
@gpauloski gpauloski deleted the hyperparams branch April 14, 2022 16:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant