Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Virtual pipeline parallel support for MegatronGPTSFTModel #7964

Merged
merged 13 commits into from
Jan 17, 2024
Merged

Virtual pipeline parallel support for MegatronGPTSFTModel #7964

merged 13 commits into from
Jan 17, 2024

Commits on Dec 5, 2023

  1. Virtual pipeline parallel support for MegatronGPTSFTModel 

    Signed-off-by: Valerie Sarge <[email protected]>
    @vysarge
    vysarge committed Dec 5, 2023
    Configuration menu
    Copy the full SHA
    c1ad1ca View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into vsarge/gpt_sft_vp

    @ericharper
    ericharper committed Dec 5, 2023
    Configuration menu
    Copy the full SHA
    195aa3b View commit details
    Browse the repository at this point in the history

  3. Deduplicate word embedding init code in MegatronGPTModel and Megatron… 

    …GPTSFTModel into one method

Signed-off-by: Valerie Sarge <[email protected]>
    @vysarge
    vysarge committed Dec 5, 2023
    Configuration menu
    Copy the full SHA
    36c7e83 View commit details
    Browse the repository at this point in the history

  4. Correct TP group init call in MegatronGPTSFTModel to check for both T… 

    …E and MCore, as in MegatronGPTModel

Signed-off-by: Valerie Sarge <[email protected]>
    @vysarge
    vysarge committed Dec 5, 2023
    Configuration menu
    Copy the full SHA
    2d6dbe1 View commit details
    Browse the repository at this point in the history

  5. Correct accidental double pipeline parallel size check 

    Signed-off-by: Valerie Sarge <[email protected]>
    @vysarge
    vysarge committed Dec 5, 2023
    Configuration menu
    Copy the full SHA
    a2232ae View commit details
    Browse the repository at this point in the history

Commits on Dec 20, 2023

  1. Merge branch 'main' into vsarge/gpt_sft_vp 

    Signed-off-by: Valerie Sarge <[email protected]>
    @vysarge
    vysarge committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    6e30e01 View commit details
    Browse the repository at this point in the history

  2. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Dec 20, 2023
    Configuration menu
    Copy the full SHA
    3294988 View commit details
    Browse the repository at this point in the history

Commits on Jan 9, 2024

  1. Merge branch 'main' into vsarge/gpt_sft_vp

    @vysarge
    vysarge committed Jan 9, 2024
    Configuration menu
    Copy the full SHA
    4cd576d View commit details
    Browse the repository at this point in the history

Commits on Jan 11, 2024

  1. Merge branch 'main' into vsarge/gpt_sft_vp

    @vysarge
    vysarge committed Jan 11, 2024
    Configuration menu
    Copy the full SHA
    51ce674 View commit details
    Browse the repository at this point in the history

Commits on Jan 12, 2024

  1. Merge branch 'main' into vsarge/gpt_sft_vp

    @vysarge
    vysarge committed Jan 12, 2024
    Configuration menu
    Copy the full SHA
    0e95f00 View commit details
    Browse the repository at this point in the history

Commits on Jan 16, 2024

  1. Correct get_gpt_module_list -> get_model_module_list from SFT model 

    Signed-off-by: Valerie Sarge <[email protected]>
    @vysarge
    vysarge committed Jan 16, 2024
    Configuration menu
    Copy the full SHA
    cd8c603 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into vsarge/gpt_sft_vp

    @vysarge
    vysarge committed Jan 16, 2024
    Configuration menu
    Copy the full SHA
    728d5c2 View commit details
    Browse the repository at this point in the history

Commits on Jan 17, 2024

  1. Merge branch 'main' into vsarge/gpt_sft_vp

    @ericharper
    ericharper committed Jan 17, 2024
    Configuration menu
    Copy the full SHA
    df1c42b View commit details
    Browse the repository at this point in the history