Unable to install correct version w/ Slurm installed from source

[thsu-terraytx]

Hello,

I have Slurm 23.02.5 installed and I'm trying to install pyxsis from source.
Slurm was originally installed from source.

Pyxsis installs fine but it is not able to load since its compiling as version 21.08.5.

I tried to update the spank.h file with the 23.02.5 to /usr/include/slurm then rebuilding but I'm still getting the same error.

The system is running Ubuntu 22.04 LTS.

Any ideas?

[flx42]

Maybe an older version of the plugin is still being loaded?
You should be able to strace srun or slurmd to see which file is being loaded, we have an example here for srun:
https://github.com/NVIDIA/pyxis/wiki/Installation#verifying-srun

[thsu-terraytx]

Here's the output of the strace
Is there a way to check the plugin version?

I have deleted the plugin file it creates in the root directory each time I have tried to install it / updated the spank.h file.

[flx42]

It's telling you that /opt/slurm/lib/slurm/spank_pyxis.so is still the old version. If this is the location of the new plugin you are compiling, then what is probably happening is that you are picking up an old spank.h when compiling pyxis again. So you should check how many copies of spank.h you can find.

[thsu-terraytx]

Is there a way to specify which spank.h to use? I made sure there were no other spank.h files. And this system has only ever had slurm 23.02 installed so not sure why its installing as version 21.08.5.

[flx42]

You can do something like CPPFLAGS='-I /usr/local/include' make

[flx42]

Also make sure to make clean too.

[thsu-terraytx]

Thanks- that worked.