[ROCm] Guard distributed usage with hasattr for Windows compatibility
#2208
0xDELUXA:fix/distributed/rocm was force-pushed and no longer has any new commits.
Pushing new commits will allow the pull request to be re-opened.