New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable autograd graph to propagate after multi-device syncing for loss functions in `ddp` #2754

Merged

Borda merged 35 commits into Lightning-AI:master from cw-tan:all_gather_ad

Oct 31, 2024

Merged

Enable autograd graph to propagate after multi-device syncing for loss functions in `ddp` #2754

caution

Azure Pipelines / TM.unittests (unitest_GPU PyTorch | 2.0 oldest) succeeded Oct 31, 2024 in 1h 43m 38s

unitest_GPU PyTorch | 2.0 oldest succeeded

0 errors / 0 warnings

View more details on Azure Pipelines