Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support the parallel conversion from ZeRO checkpoints to FP32/FP16/BF16 param weight #6655

Open
wants to merge 7 commits into
base: master
Choose a base branch
from
Open

Support the parallel conversion from ZeRO checkpoints to FP32/FP16/BF16 param weight #6655

wants to merge 7 commits into from

Commits on Oct 23, 2024

  1. support the conversion from ZeRO checkpoints to FP32/FP16/BF16 parame… 

    …ter weights in parallel via UCP
    @xylian86
    xylian86 committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    7ee6734 View commit details
    Browse the repository at this point in the history

  2. not change the function name for compatibility

    @xylian86
    xylian86 committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    869c455 View commit details
    Browse the repository at this point in the history

  3. nit

    @xylian86
    xylian86 committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    7c55f33 View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2024

  1. Merge branch 'master' into parallel_zero_to_fp32_conversion

    @loadams
    loadams authored Oct 25, 2024
    Configuration menu
    Copy the full SHA
    cf2983b View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into parallel_zero_to_fp32_conversion

    @loadams
    loadams authored Oct 25, 2024
    Configuration menu
    Copy the full SHA
    55794d9 View commit details
    Browse the repository at this point in the history

  3. fix formatting issue

    @xylian86
    xylian86 committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    ff1083c View commit details
    Browse the repository at this point in the history

Commits on Oct 31, 2024

  1. Merge branch 'master' into parallel_zero_to_fp32_conversion

    @tjruwase
    tjruwase authored Oct 31, 2024
    Configuration menu
    Copy the full SHA
    d8fd142 View commit details
    Browse the repository at this point in the history