update Clang easyblock to add support for new directory structure in Clang versions >= 14 + support Flang + fix --module-only + fix sanity check for Clang 11.x

[mboisson]

No description provided.

[mboisson]

:( apparently, this never got merged
#2264
and part of it is included in this PR.... can we go back and merge the above ?

[mboisson]

In fact, I am not able to get clang to build without downloading the full package llvm-project-%(version)s.src.tar.xz. The sum of components does not equal the whole thing, there are parts missing, see llvm/llvm-project#58320 .

I would suggest to drop the per-component download, and to select which component to install based on LLVM_ENABLE_PROJECTS

[ocaisa]

@mboisson This looks good, but there seems to be a conflict right now, can you fix that?

Is there a PR that uses this? I can add one based on your repos.

I'd like to do one which includes flang from v15 up. Can we add that to the sanity check step?

        if 'flang' in self.cfg['llvm_projects'] and LooseVersion(self.version) >= LooseVersion('15'):
            custom_paths['files'].extend(["bin/flang"])

[mboisson]

@mboisson This looks good, but there seems to be a conflict right now, can you fix that?

I have no clue how to merge that conflict... the code is completely different and is not in a single commit so I can't cherry-pick the change :( You will have to fix the conflict while merging

[mboisson]

@ocaisa the other changes are incorporated

[mboisson]

I am not sure why the tests are not actually running... Any idea @ocaisa ?

[ocaisa]

Test report by @ocaisa

Overview of tested easyconfigs (in order)

• SUCCESS Clang-13.0.1-GCCcore-11.2.0.eb

Build succeeded for 1 out of 1 (1 easyconfigs in total)
login1 - Linux Rocky Linux 8.5, x86_64, Intel(R) Xeon(R) CPU E5-2667 v3 @ 3.20GHz, Python 3.6.8
See https://gist.github.com/af457d88f14a98778665d5198d4c60dd for a full test report.

[ocaisa]

Test report by @ocaisa

Overview of tested easyconfigs (in order)

• SUCCESS Clang-13.0.1-GCCcore-11.2.0-CUDA-11.4.1.eb

Build succeeded for 1 out of 1 (1 easyconfigs in total)
cnx1 - Linux Rocky Linux 8.5, x86_64, Intel(R) Xeon(R) CPU E5-2690 v3 @ 2.60GHz, Python 3.6.8
See https://gist.github.com/30074b89aa9e6d4a981425783a822b46 for a full test report.

[ocaisa]

Test report by @ocaisa

Overview of tested easyconfigs (in order)

• SUCCESS Clang-12.0.1-GCCcore-10.3.0.eb

Build succeeded for 1 out of 1 (1 easyconfigs in total)
cnx2 - Linux Rocky Linux 8.5, x86_64, Intel(R) Xeon(R) CPU E5-2667 v3 @ 3.20GHz, Python 3.6.8
See https://gist.github.com/4ec3268d6cd33c8c1ade3b432a950111 for a full test report.

[ocaisa]

Test report by @ocaisa

Overview of tested easyconfigs (in order)

• SUCCESS Clang-11.0.1-GCCcore-10.2.0.eb

Build succeeded for 1 out of 1 (1 easyconfigs in total)
cnx4 - Linux Rocky Linux 8.5, x86_64, Intel(R) Xeon(R) CPU E5-2667 v3 @ 3.20GHz, Python 3.6.8
See https://gist.github.com/e8e353295db6af73e59a3d10c769c807 for a full test report.

[ocaisa]

Test report by @ocaisa

Overview of tested easyconfigs (in order)

• SUCCESS Clang-12.0.1-GCCcore-10.3.0.eb

Build succeeded for 1 out of 1 (1 easyconfigs in total)
cnx1 - Linux Rocky Linux 8.5, x86_64, Intel(R) Xeon(R) CPU E5-2690 v3 @ 2.60GHz, Python 3.6.8
See https://gist.github.com/f975e73b47250690c6927ef0fdd3fed6 for a full test report.

[ocaisa]

Test report by @ocaisa

Overview of tested easyconfigs (in order)

• SUCCESS Clang-13.0.1-GCCcore-11.2.0-CUDA-11.4.1.eb

Build succeeded for 1 out of 1 (1 easyconfigs in total)
cnx2 - Linux Rocky Linux 8.5, x86_64, Intel(R) Xeon(R) CPU E5-2667 v3 @ 3.20GHz, Python 3.6.8
See https://gist.github.com/c721ea8c70087972f3f580efd3f048ea for a full test report.

[ocaisa]

Test report by @ocaisa

Overview of tested easyconfigs (in order)

• SUCCESS Clang-13.0.1-GCCcore-11.2.0-CUDA-11.4.1.eb
• SUCCESS Clang-11.0.1-GCCcore-10.2.0.eb
• SUCCESS Clang-12.0.1-GCCcore-10.3.0.eb

Build succeeded for 3 out of 3 (3 easyconfigs in total)
login1 - Linux Rocky Linux 8.5, x86_64, Intel(R) Xeon(R) CPU E5-2667 v3 @ 3.20GHz, Python 3.6.8
See https://gist.github.com/e860f312fedad6fe181042367bc359dc for a full test report.

[ocaisa]

Last test was to ensure --module-only was also now working for Clang

[ocaisa]

Thanks for all the hard work @mboisson !

[mboisson]

Thanks for all the hard work @mboisson !

🥳

[boegel]

Doing this in the constructor doesn't work, since the modules for the dependencies are only loading in prepare_step => #2871

[ocaisa]

I guess the key is in the comment here, this should be like what is done in LAMMPS (https://github.com/easybuilders/easybuild-easyblocks/blob/develop/easybuild/easyblocks/l/lammps.py#L175-L177)

[boegel]

@ocaisa please mention that in #2871