Skip to content

add custom easyconfig parameter for LLVM to ignore timed out tests#3903

Merged
boegel merged 1 commit intoeasybuilders:developfrom
Crivella:feature-LLVM-ignore_timeouts
Sep 10, 2025
Merged

add custom easyconfig parameter for LLVM to ignore timed out tests#3903
boegel merged 1 commit intoeasybuilders:developfrom
Crivella:feature-LLVM-ignore_timeouts

Conversation

@Crivella
Copy link
Copy Markdown
Contributor

See discussion in easybuilders/easybuild-easyconfigs#23144

This would allow to not treat timed out tests as failures by defining test_suite_ignore_timeouts = True in the EC file.
The default is kept to False to be consistent with previous behavior

@boegel boegel changed the title LLVM - Added config option to ignore timed out tests add custom easyconfig parameter for LLVM to ignore timed out tests Aug 27, 2025
@boegel boegel added this to the next release (5.1.2) milestone Aug 27, 2025
Copy link
Copy Markdown
Member

@boegel boegel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@Crivella let's get a couple of test reports for this?

@Crivella
Copy link
Copy Markdown
Contributor Author

I guess we would need this to be tested out either on easybuilders/easybuild-easyconfigs#23144 by @Micket since he was failing the build due to timeouts.
Can run some tests without the option in the meanwhile to see that everything still works

@Crivella
Copy link
Copy Markdown
Contributor Author

@boegelbot please test @ jsc-zen3
EB_ARGS="--installpath=/tmp/$USER/ebpr-3903 LLVM-14.0.3-GCCcore-11.3.0.eb LLVM-18.1.8-GCCcore-13.3.0-minimal.eb LLVM-18.1.8-GCCcore-13.3.0.eb LLVM-20.1.5-GCCcore-13.2.0.eb"
CORE_CNT=16

@boegelbot
Copy link
Copy Markdown

@Crivella: Request for testing this PR well received on jsczen3l1.int.jsc-zen3.fz-juelich.de

PR test command 'if [[ develop != 'develop' ]]; then EB_BRANCH=develop ./easybuild_develop.sh 2> /dev/null 1>&2; EB_PREFIX=/home/boegelbot/easybuild/develop source init_env_easybuild_develop.sh; fi; EB_PR=3903 EB_ARGS="--installpath=/tmp/$USER/ebpr-3903 LLVM-14.0.3-GCCcore-11.3.0.eb LLVM-18.1.8-GCCcore-13.3.0-minimal.eb LLVM-18.1.8-GCCcore-13.3.0.eb LLVM-20.1.5-GCCcore-13.2.0.eb" EB_CONTAINER= EB_REPO=easybuild-easyblocks EB_BRANCH=develop /opt/software/slurm/bin/sbatch --job-name test_PR_3903 --ntasks="16" ~/boegelbot/eb_from_pr_upload_jsc-zen3.sh' executed!

  • exit code: 0
  • output:
Submitted batch job 7774

Test results coming soon (I hope)...

Details

- notification for comment with ID 3233105778 processed

Message to humans: this is just bookkeeping information for me,
it is of no use to you (unless you think I have a bug, which I don't).

@boegelbot
Copy link
Copy Markdown

Test report by @boegelbot

Overview of tested easyconfigs (in order)

  • SUCCESS LLVM-14.0.3-GCCcore-11.3.0.eb
  • SUCCESS LLVM-18.1.8-GCCcore-13.3.0-minimal.eb
  • SUCCESS LLVM-18.1.8-GCCcore-13.3.0.eb
  • SUCCESS LLVM-20.1.5-GCCcore-13.2.0.eb

Build succeeded for 4 out of 4 (4 easyconfigs in total)
jsczen3c1.int.jsc-zen3.fz-juelich.de - Linux Rocky Linux 9.6, x86_64, AMD EPYC-Milan Processor (zen3), Python 3.9.21
See https://gist.github.com/boegelbot/7290d90a91d9a3c57b4d799440045bbe for a full test report.

@boegel boegel merged commit 28b38f5 into easybuilders:develop Sep 10, 2025
17 checks passed
@Crivella Crivella deleted the feature-LLVM-ignore_timeouts branch September 10, 2025 07:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants