Skip to content

lr scheduler - update global states into optimizer #29

@lessw2020

Description

@lessw2020

lr scheduler currently maintains two global states to implement the full lr warmup and decay.
We want to remove these:
"nit: we can make these two arguments still as function arguments below, but we use:

functools.partial to pack these two arguments when adding to the optimizer.

global config works for now. This can be done as a follow up"

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions