New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable autograd graph to propagate after multi-device syncing for loss functions in `ddp` #2754

Merged

Borda merged 35 commits into Lightning-AI:master from cw-tan:all_gather_ad

Oct 31, 2024

Merged

Enable autograd graph to propagate after multi-device syncing for loss functions in `ddp` #2754

caution

Azure Pipelines / TM.nuke-cache completed Oct 31, 2024 in 0s

This check was skipped

No pipeline path filters matched the file changes.

View more details on Azure Pipelines