Bump accelerate from 1.4.0 to 1.6.0

[dependabot]

Bumps accelerate from 1.4.0 to 1.6.0.

Release notes

Sourced from accelerate's releases.

v1.6.0: FSDPv2, DeepSpeed TP and XCCL backend support

FSDPv2 support

This release introduces the support for FSDPv2 thanks to @​S1ro1.

If you are using python code, you need to set fsdp_version=2 in FullyShardedDataParallelPlugin:

from accelerate import FullyShardedDataParallelPlugin, Accelerator
fsdp_plugin = FullyShardedDataParallelPlugin(
fsdp_version=2
# other options...
)
accelerator = Accelerator(fsdp_plugin=fsdp_plugin)

If want to convert a YAML config that contains the FSDPv1 config to FSDPv2 one , use our conversion tool:

accelerate to-fsdp2 --config_file config.yaml --output_file new_config.yaml`

To learn more about the difference between FSDPv1 and FSDPv2, read the following documentation.

DeepSpeed TP support

We have added initial support for DeepSpeed + TP. Not many changes were required as the DeepSpeed APIs was already compatible. We only needed to make sure that the dataloader was compatible with TP and that we were able to save the TP weights. Thanks @​inkcherry for the work ! huggingface/accelerate#3390.

To use TP with deepspeed, you need to update the setting in the deepspeed config file by including tensor_parallel key:

    ....
    "tensor_parallel":{
      "autotp_size": ${autotp_size}
    },
   ...

More details in this deepspeed PR.

Support for XCCL distributed backend

We've added support for XCCL which is an Intel distributed backend which can be used with XPU devices. More details in this torch PR. Thanks @​dvrogozh for the integration !

What's Changed

• Add log_artifact, log_artifacts and log_figure capabilities to the MLflowTracker. by @​luiz0992 in huggingface/accelerate#3419
• tensor parallel dataloder for deepspeed accelerator by @​inkcherry in huggingface/accelerate#3390
• Fix prod issues by @​muellerzr in huggingface/accelerate#3441
• Fix attribute issue with deepspeed tp by @​SunMarc in huggingface/accelerate#3443
• Fixed typo in the multi node FSDP slurm example script by @​JacobB33 in huggingface/accelerate#3447
• feat: Add no_ssh and slurm multinode launcher options for deepspeed by @​hsmallbone in huggingface/accelerate#3329
• Fixup ao module filter func by @​muellerzr in huggingface/accelerate#3450
• remove device index workaround on xpu since xpu supports integer device index as cuda now by @​yao-matrix in huggingface/accelerate#3448

... (truncated)

Commits

• 587bc68 Release: v1.6.0
• 3169339 Bump ruff to 0.11.2 (#3471)
• 67a768b remove use_xpu to fix ut issues, we don't need this since XPU is OOB … (#3460)
• 5316434 [MLU] fix deepspeed dependency (#3472)
• 83e09a9 Update ruff target-version to py39 and apply more fixes (#3470)
• 9c4eeb9 xpu: enable xccl distributed backend (#3401)
• a0edc8d Apply ruff py39 fixes (#3461)
• 11a3c00 Update CometMLTracker to allow re-using experiment (#3328)
• 8b31a2f Fix get_balanced_memory for MPS (#3464)
• 3f636d6 Fix seeding of new generator for multi GPU (#3459)
• Additional commits viewable in compare view

You can trigger a rebase of this PR by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

Note
Automatic rebases have been disabled on this pull request as it has been open for over 30 days.