Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Option to remove bias terms from Megatron transformers #3973

Merged
merged 23 commits into from
Apr 15, 2022
Merged

Option to remove bias terms from Megatron transformers #3973

merged 23 commits into from
Apr 15, 2022

Commits on Mar 28, 2022

  1. Temp 

    Signed-off-by: MaximumEntropy <[email protected]>
    @MaximumEntropy
    MaximumEntropy committed Mar 28, 2022
    Configuration menu
    Copy the full SHA
    99037b5 View commit details
    Browse the repository at this point in the history

  2. Merge 

    Signed-off-by: MaximumEntropy <[email protected]>
    @MaximumEntropy
    MaximumEntropy committed Mar 28, 2022
    Configuration menu
    Copy the full SHA
    f37fe52 View commit details
    Browse the repository at this point in the history

Commits on Mar 29, 2022

  1. Merge branch 'main' of github.com:NVIDIA/NeMo into main

    @MaximumEntropy
    MaximumEntropy committed Mar 29, 2022
    Configuration menu
    Copy the full SHA
    12e6574 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' of github.com:NVIDIA/NeMo into main

    @MaximumEntropy
    MaximumEntropy committed Mar 29, 2022
    Configuration menu
    Copy the full SHA
    5d2cdbb View commit details
    Browse the repository at this point in the history

Commits on Mar 31, 2022

  1. Merge branch 'main' of github.com:NVIDIA/NeMo into main

    @MaximumEntropy
    MaximumEntropy committed Mar 31, 2022
    Configuration menu
    Copy the full SHA
    db6a25b View commit details
    Browse the repository at this point in the history

Commits on Apr 3, 2022

  1. Merge branch 'main' of github.com:NVIDIA/NeMo into main

    @MaximumEntropy
    MaximumEntropy committed Apr 3, 2022
    Configuration menu
    Copy the full SHA
    15513e3 View commit details
    Browse the repository at this point in the history

Commits on Apr 4, 2022

  1. Merge branch 'main' of github.com:NVIDIA/NeMo into main

    @MaximumEntropy
    MaximumEntropy committed Apr 4, 2022
    Configuration menu
    Copy the full SHA
    06baa1c View commit details
    Browse the repository at this point in the history

Commits on Apr 6, 2022

  1. Merge branch 'main' of github.com:NVIDIA/NeMo into main

    @MaximumEntropy
    MaximumEntropy committed Apr 6, 2022
    Configuration menu
    Copy the full SHA
    3f6ed7e View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' of github.com:NVIDIA/NeMo into main

    @MaximumEntropy
    MaximumEntropy committed Apr 6, 2022
    Configuration menu
    Copy the full SHA
    c0b029e View commit details
    Browse the repository at this point in the history

Commits on Apr 7, 2022

  1. initial 

    Signed-off-by: MaximumEntropy <[email protected]>
    @MaximumEntropy
    MaximumEntropy committed Apr 7, 2022
    Configuration menu
    Copy the full SHA
    0932e31 View commit details
    Browse the repository at this point in the history

  2. More bias term changes 

    Signed-off-by: MaximumEntropy <[email protected]>
    @MaximumEntropy
    MaximumEntropy committed Apr 7, 2022
    Configuration menu
    Copy the full SHA
    b1a218c View commit details
    Browse the repository at this point in the history

Commits on Apr 12, 2022

  1. Fix merge 

    Signed-off-by: MaximumEntropy <[email protected]>
    @MaximumEntropy
    MaximumEntropy committed Apr 12, 2022
    Configuration menu
    Copy the full SHA
    feaafb6 View commit details
    Browse the repository at this point in the history

  2. Add an option to remove bias terms 

    Signed-off-by: MaximumEntropy <[email protected]>
    @MaximumEntropy
    MaximumEntropy committed Apr 12, 2022
    Configuration menu
    Copy the full SHA
    152601b View commit details
    Browse the repository at this point in the history

  3. change bart config 

    Signed-off-by: MaximumEntropy <[email protected]>
    @MaximumEntropy
    MaximumEntropy committed Apr 12, 2022
    Configuration menu
    Copy the full SHA
    a53d663 View commit details
    Browse the repository at this point in the history

  4. Style 

    Signed-off-by: MaximumEntropy <[email protected]>
    @MaximumEntropy
    MaximumEntropy committed Apr 12, 2022
    Configuration menu
    Copy the full SHA
    9784ec0 View commit details
    Browse the repository at this point in the history

  5. Style and move dropout_add to a separate func 

    Signed-off-by: MaximumEntropy <[email protected]>
    @MaximumEntropy
    MaximumEntropy committed Apr 12, 2022
    Configuration menu
    Copy the full SHA
    d506340 View commit details
    Browse the repository at this point in the history

Commits on Apr 13, 2022

  1. Merge branch 'main' into remove_bias_terms

    @MaximumEntropy
    MaximumEntropy authored Apr 13, 2022
    Configuration menu
    Copy the full SHA
    ce455f6 View commit details
    Browse the repository at this point in the history

Commits on Apr 14, 2022

  1. Style 

    Signed-off-by: MaximumEntropy <[email protected]>
    @MaximumEntropy
    MaximumEntropy committed Apr 14, 2022
    Configuration menu
    Copy the full SHA
    77d75d0 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into remove_bias_terms

    @MaximumEntropy
    MaximumEntropy authored Apr 14, 2022
    Configuration menu
    Copy the full SHA
    c9ffe41 View commit details
    Browse the repository at this point in the history

Commits on Apr 15, 2022

  1. Fix bias check condition 

    Signed-off-by: MaximumEntropy <[email protected]>
    @MaximumEntropy
    MaximumEntropy committed Apr 15, 2022
    Configuration menu
    Copy the full SHA
    e02c90f View commit details
    Browse the repository at this point in the history

  2. Merge branch 'remove_bias_terms' of github.com:NVIDIA/NeMo into remov… 

    …e_bias_terms
    @MaximumEntropy
    MaximumEntropy committed Apr 15, 2022
    Configuration menu
    Copy the full SHA
    1b998cd View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into remove_bias_terms

    @MaximumEntropy
    MaximumEntropy authored Apr 15, 2022
    Configuration menu
    Copy the full SHA
    fedb582 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into remove_bias_terms

    @MaximumEntropy
    MaximumEntropy authored Apr 15, 2022
    Configuration menu
    Copy the full SHA
    ae39532 View commit details
    Browse the repository at this point in the history