Skip to content

Specify rank ID for component to run only on some ranks #4056

@Nic-Ma

Description

@Nic-Ma

Is your feature request related to a problem? Please describe.
For multi-gpu training / inference, many some components only need to execute on specified ranks, so it would be nice to support the config for target rank ID.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    Status

    No status

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions