{ai}[foss/2024a] accelerate v1.10.0

[smoors]

(created using eb --new-pr)

depends on

• {lib}[GCCcore/13.3.0] Transformers v4.55.0, tokenizers v0.21.4, Safetensors v0.6.2, ... w/ Rust 1.83.0, tokenizers 0.21.0 #23656

[github-actions]

Updated software accelerate-1.10.0-foss-2024a.eb

Diff against accelerate-1.3.0-foss-2023a-CUDA-12.1.1.eb

easybuild/easyconfigs/a/accelerate/accelerate-1.3.0-foss-2023a-CUDA-12.1.1.eb

diff --git a/easybuild/easyconfigs/a/accelerate/accelerate-1.3.0-foss-2023a-CUDA-12.1.1.eb b/easybuild/easyconfigs/a/accelerate/accelerate-1.10.0-foss-2024a.eb
index c6a8000ccd..104cf85722 100644
--- a/easybuild/easyconfigs/a/accelerate/accelerate-1.3.0-foss-2023a-CUDA-12.1.1.eb
+++ b/easybuild/easyconfigs/a/accelerate/accelerate-1.10.0-foss-2024a.eb
@@ -1,33 +1,27 @@
 easyblock = 'PythonBundle'
 
 name = 'accelerate'
-version = '1.3.0'
-versionsuffix = '-CUDA-%(cudaver)s'
+version = '1.10.0'
 
 homepage = 'https://github.com/huggingface/accelerate'
 description = """A simple way to launch, train, and use PyTorch models on almost any device and
 distributed configuration, automatic mixed precision (including fp8),
 and easy-to-configure FSDP and DeepSpeed support."""
 
-toolchain = {'name': 'foss', 'version': '2023a'}
+toolchain = {'name': 'foss', 'version': '2024a'}
 
 dependencies = [
-    ('Python', '3.11.3'),
-    ('Python-bundle-PyPI', '2023.06'),
-    ('SciPy-bundle', '2023.07'),
-    ('CUDA', '12.1.1', '', SYSTEM),
-    ('PyTorch-bundle', '2.1.2', versionsuffix),
-    ('PyYAML', '6.0'),
-    ('Safetensors', '0.4.3'),
+    ('Python', '3.12.3'),
+    ('SciPy-bundle', '2024.05'),
+    ('PyTorch', '2.6.0'),
+    ('PyYAML', '6.0.2'),
+    ('Safetensors', '0.6.2'),
+    ('huggingface_hub', '0.34.4'),
 ]
 
 exts_list = [
-    ('huggingface-hub', '0.30.2', {
-        'sources': ['huggingface_hub-%(version)s.tar.gz'],
-        'checksums': ['9a7897c5b6fd9dad3168a794a8998d6378210f5b9688d0dfc180b1a228dc2466'],
-    }),
     (name, version, {
-        'checksums': ['518631c0adb80bd3d42fb29e7e2dc2256bcd7c786b0ba9119bbaa08611b36d9c'],
+        'checksums': ['8270568fda9036b5cccdc09703fef47872abccd56eb5f6d53b54ea5fb7581496'],
     }),
 ]
 

Diff against accelerate-1.0.1-foss-2023b.eb

easybuild/easyconfigs/a/accelerate/accelerate-1.0.1-foss-2023b.eb

diff --git a/easybuild/easyconfigs/a/accelerate/accelerate-1.0.1-foss-2023b.eb b/easybuild/easyconfigs/a/accelerate/accelerate-1.10.0-foss-2024a.eb
index 726627abf3..104cf85722 100644
--- a/easybuild/easyconfigs/a/accelerate/accelerate-1.0.1-foss-2023b.eb
+++ b/easybuild/easyconfigs/a/accelerate/accelerate-1.10.0-foss-2024a.eb
@@ -1,32 +1,27 @@
 easyblock = 'PythonBundle'
 
 name = 'accelerate'
-version = '1.0.1'
+version = '1.10.0'
 
 homepage = 'https://github.com/huggingface/accelerate'
 description = """A simple way to launch, train, and use PyTorch models on almost any device and
 distributed configuration, automatic mixed precision (including fp8),
 and easy-to-configure FSDP and DeepSpeed support."""
 
-toolchain = {'name': 'foss', 'version': '2023b'}
+toolchain = {'name': 'foss', 'version': '2024a'}
 
 dependencies = [
-    ('Python', '3.11.5'),
-    ('Python-bundle-PyPI', '2023.10'),
-    ('SciPy-bundle', '2023.11'),
-    ('PyTorch', '2.1.2'),
-    ('PyYAML', '6.0.1'),
-    ('Safetensors', '0.4.4'),
-    ('tqdm', '4.66.2'),
+    ('Python', '3.12.3'),
+    ('SciPy-bundle', '2024.05'),
+    ('PyTorch', '2.6.0'),
+    ('PyYAML', '6.0.2'),
+    ('Safetensors', '0.6.2'),
+    ('huggingface_hub', '0.34.4'),
 ]
 
 exts_list = [
-    ('huggingface-hub', '0.26.2', {
-        'sources': ['huggingface_hub-%(version)s.tar.gz'],
-        'checksums': ['b100d853465d965733964d123939ba287da60a547087783ddff8a323f340332b'],
-    }),
     (name, version, {
-        'checksums': ['e8f95fc2db14915dc0a9182edfcf3068e5ddb2fa310b583717ad44e5c442399c'],
+        'checksums': ['8270568fda9036b5cccdc09703fef47872abccd56eb5f6d53b54ea5fb7581496'],
     }),
 ]
 

Diff against accelerate-0.33.0-foss-2023a-CUDA-12.1.1.eb

easybuild/easyconfigs/a/accelerate/accelerate-0.33.0-foss-2023a-CUDA-12.1.1.eb

diff --git a/easybuild/easyconfigs/a/accelerate/accelerate-0.33.0-foss-2023a-CUDA-12.1.1.eb b/easybuild/easyconfigs/a/accelerate/accelerate-1.10.0-foss-2024a.eb
index 494b6fe727..104cf85722 100644
--- a/easybuild/easyconfigs/a/accelerate/accelerate-0.33.0-foss-2023a-CUDA-12.1.1.eb
+++ b/easybuild/easyconfigs/a/accelerate/accelerate-1.10.0-foss-2024a.eb
@@ -1,33 +1,27 @@
 easyblock = 'PythonBundle'
 
 name = 'accelerate'
-version = '0.33.0'
-versionsuffix = '-CUDA-%(cudaver)s'
+version = '1.10.0'
 
 homepage = 'https://github.com/huggingface/accelerate'
 description = """A simple way to launch, train, and use PyTorch models on almost any device and
 distributed configuration, automatic mixed precision (including fp8),
 and easy-to-configure FSDP and DeepSpeed support."""
 
-toolchain = {'name': 'foss', 'version': '2023a'}
+toolchain = {'name': 'foss', 'version': '2024a'}
 
 dependencies = [
-    ('Python', '3.11.3'),
-    ('Python-bundle-PyPI', '2023.06'),
-    ('SciPy-bundle', '2023.07'),
-    ('CUDA', '12.1.1', '', SYSTEM),
-    ('PyTorch-bundle', '2.1.2', versionsuffix),
-    ('PyYAML', '6.0'),
-    ('Safetensors', '0.4.3'),
+    ('Python', '3.12.3'),
+    ('SciPy-bundle', '2024.05'),
+    ('PyTorch', '2.6.0'),
+    ('PyYAML', '6.0.2'),
+    ('Safetensors', '0.6.2'),
+    ('huggingface_hub', '0.34.4'),
 ]
 
 exts_list = [
-    ('huggingface-hub', '0.24.5', {
-        'sources': ['huggingface_hub-%(version)s.tar.gz'],
-        'checksums': ['7b45d6744dd53ce9cbf9880957de00e9d10a9ae837f1c9b7255fc8fa4e8264f3'],
-    }),
     (name, version, {
-        'checksums': ['11ba481ed6ea09191775df55ce464aeeba67a024bd0261a44b77b30fb439e26a'],
+        'checksums': ['8270568fda9036b5cccdc09703fef47872abccd56eb5f6d53b54ea5fb7581496'],
     }),
 ]
 

[smoors]

@boegelbot please test @ jsc-zen3

[boegelbot]

@smoors: Request for testing this PR well received on jsczen3l1.int.jsc-zen3.fz-juelich.de

PR test command 'if [[ develop != 'develop' ]]; then EB_BRANCH=develop ./easybuild_develop.sh 2> /dev/null 1>&2; EB_PREFIX=/home/boegelbot/easybuild/develop source init_env_easybuild_develop.sh; fi; EB_PR=23665 EB_ARGS= EB_CONTAINER= EB_REPO=easybuild-easyconfigs EB_BRANCH=develop /opt/software/slurm/bin/sbatch --job-name test_PR_23665 --ntasks=8 ~/boegelbot/eb_from_pr_upload_jsc-zen3.sh' executed!

• exit code: 0
• output:

Submitted batch job 7670

Test results coming soon (I hope)...

Details

- notification for comment with ID 3197582471 processed

Message to humans: this is just bookkeeping information for me,
it is of no use to you (unless you think I have a bug, which I don't).

[boegelbot]

Test report by @boegelbot
SUCCESS
Build succeeded for 1 out of 1 (1 easyconfigs in total)
jsczen3c2.int.jsc-zen3.fz-juelich.de - Linux Rocky Linux 9.6, x86_64, AMD EPYC-Milan Processor (zen3), Python 3.9.21
See https://gist.github.com/boegelbot/1c42c24af77741edbe2ff3c0e8b516d5 for a full test report.

[verdurin]

Test report by @verdurin
FAILED
Build succeeded for 26 out of 28 (1 easyconfigs in total)
easybuild-el8.cloud.in.bmrc.ox.ac.uk - Linux Rocky Linux 8.10 (Green Obsidian), x86_64, Intel Xeon Processor (Skylake, IBRS), Python 3.11.13
See https://gist.github.com/verdurin/57ad130f79d217929609bec2c168148d for a full test report.

[verdurin]

My build failed in PyTorch, not in accelerate.

[verdurin]

Test report by @verdurin
FAILED
Build succeeded for 0 out of 2 (1 easyconfigs in total)
easybuild-el8.cloud.in.bmrc.ox.ac.uk - Linux Rocky Linux 8.10 (Green Obsidian), x86_64, Intel Xeon Processor (Skylake, IBRS), Python 3.11.13
See https://gist.github.com/verdurin/a91da484625440a8bdaaef5ff6bf0dd4 for a full test report.

[verdurin]

Test report by @verdurin
Using easyblocks from PR(s) easybuilders/easybuild-easyblocks#3803
FAILED
Build succeeded for 0 out of 2 (1 easyconfigs in total)
easybuild-el8.cloud.in.bmrc.ox.ac.uk - Linux Rocky Linux 8.10 (Green Obsidian), x86_64, Intel Xeon Processor (Skylake, IBRS), Python 3.11.13
See https://gist.github.com/verdurin/803eca38031d6a9819793a10ff6d4bd7 for a full test report.

[WilleBell]

Test report by @WilleBell
SUCCESS
Build succeeded for 1 out of 1 (1 easyconfigs in total)
node705.hydra.os - Linux Rocky Linux 9.6, x86_64, AMD EPYC 9535 64-Core Processor, Python 3.9.21
See https://gist.github.com/WilleBell/2c0a501804b064677d509ad1e5466a96 for a full test report.

[WilleBell]

lgtm

[WilleBell]

Going in, thanks @smoors!