Wrong parameter order in all_to_all

[eee4017]

PR Category

Distributed Strategy

PR Types

Bug fixes

Description

The parameter order in PyBind differs from that in Python, causing a bug. By swapping the parameter order, this issue can be resolved.

Please refer to the PyBind C++ Interface (all_to_all_tensor_on_calc_stream and all_to_all_tensor.), where out_tensor should be the first parameter.

However, in the _all_to_all_tensor_in_dygraph, in_tensor is the first parameter.

Additionally, the parameter order in PaddlePaddle is not standardized, even in the highest-level APIs, which lack a consistent parameter sequence. Please check alltoall (stream) and alltoall (distributed)

[paddle-bot]

你的PR提交成功，感谢你对开源项目的贡献!
请关注后续CI自动化测试结果，详情请参考Paddle-CI手册。
Your PR has been submitted. Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

[jeng1220]

CI failed but it was NOT related to this PR

ERROR: test_simple_net_hybrid_strategy (__main__.TestSemiAutoParallelLlamaDataLoader)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/workspace/Paddle/test/collective/test_communication_api_base.py", line 79, in run_test_case
    self._launcher = subprocess.run(
  File "/usr/lib/python3.10/subprocess.py", line 526, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['/usr/bin/python', '-u', '-m', 'paddle.distributed.launch', '--log_dir', '/tmp/tmpkx_sv8w9', '--devices', '0,1,2,3,4,5,6,7', 'semi_auto_llama_dataloader.py']' returned non-zero exit status 1.
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/workspace/Paddle/test/auto_parallel/hybrid_strategy/test_semi_auto_parallel_llama_model.py", line 224, in test_simple_net_hybrid_strategy
    self.run_test_case(
  File "/workspace/Paddle/test/collective/test_communication_api_base.py", line 90, in run_test_case
    raise RuntimeError(
RuntimeError: Error occurs when running this test case. The return code of command ['/usr/bin/python', '-u', '-m', 'paddle.distributed.launch', '--log_dir', '/tmp/tmpkx_sv8w9', '--devices', '0,1,2,3,4,5,6,7', 'semi_auto_llama_dataloader.py'] is 1
----------------------------------------------------------------------
Ran 9 tests in 444.641s
FAILED (errors=1)

[tianshuo78520a]

这个问题还在修复中，修复后我会重新执行这个CI

[JZ-LIANG]

后续最好补一个单测吧
test/collective/process_group_nccl.py

[JZ-LIANG]

LGTM