Pillow fails to build on Linux

[JD-ETH]

🐛 Bug

Same error appears when building the compiler_gym wheel or compiling from source. Clang misses a compiler flag: -fno-semantic-interposition

To Reproduce

Steps to reproduce the behavior:

1. On Linux, pip install compiler_gym
2. Or build from source gives the same error

  clang: error: unknown argument: '-fno-semantic-interposition'
  error: command '/usr/bin/clang' failed with exit code 1
  ----------------------------------------
  ERROR: Failed building wheel for Pillow

The error with -fno-semantic-interposition shows up a lot, omitted here.

Environment

• CompilerGym: current development
• How you installed CompilerGym (conda, pip, source): pip and source in a conda env.
• OS: Linux 18.04.5 LTS
• Python version: 3.9
• Build command you used (if compiling from source): as in documentation
• GCC/clang version (if compiling from source): as in documentation
• Bazel version (if compiling from source): as in documentation
• Versions of any other relevant libraries:

You may use the PyTorch
environment collection script
to generate most of this information. You can get the script and run it with:

wget https://raw.githubusercontent.com/pytorch/pytorch/master/torch/utils/collect_env.py
# For security purposes, please check the contents of collect_env.py before running it.
python collect_env.py

Additional context

Installing pip install Pillow works ok.

[ChrisCummins]

Hey @JD-ETH, that's odd! Could you please past the output of the following two commands:

1. git rev-parse HEAD
2. /usr/bin/clang --version

I did encounter errors with building Pillow when I switched from Python 3.8 to 3.9, but I was able to fix them by updating dependent library versions in #160. The problem you're experience looks new to me.

Cheers,
Chris

[JD-ETH]

The commit hash:
e6a53d3bc38a5f1a55ccf33bdff3ff1af3d76db8
clang version:

clang version 6.0.0-1ubuntu2 (tags/RELEASE_600/final)
Target: x86_64-pc-linux-gnu
Thread model: posix
InstalledDir: /usr/bin

@ChrisCummins yeah seems like a versioning issue?

[ChrisCummins]

Hmm. Your environment looks pretty close to the Linux CI runner. The only differences I see are an older ubuntu release (CI runner uses 20.04) and an older compiler (CI runner uses clang-9). Would it be possible to try building with a newer system compiler? I'm still not convinced that it is definitely the cause, but could help. I can't repro on any machine I have access to.

Cheers,
Chris

[JD-ETH]

Was able to install once clang++-9 was installed. Will update the Readme to include this. Thanks!

[JD-ETH]

#183

[ChrisCummins]

Great!