python3Packages.setuptools: add distutils patch to support cross-compilation

[lopsided98]

Description of changes

This is mostly the same patch applied to stdlib distutils, except rebased and reworked a bit. This fixes cross-compilation of Python packages with C extension modules now that setuptools uses bundled distutils. I will make another try at getting this patch upstreamed.

Fixes #168861.

Things done

• Built on platform(s)
  • x86_64-linux
  • aarch64-linux
  • x86_64-darwin
  • aarch64-darwin
• For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
• Tested, as applicable:
  • NixOS test(s) (look inside nixos/tests)
  • and/or package tests
  • or, for functions and "core" functionality, tests in lib/tests or pkgs/test
  • made sure NixOS tests are linked to the relevant packages
• Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
• Tested basic functionality of all binary files (usually in ./result/bin/)
• 22.05 Release Notes (or backporting 21.11 Release notes)
  • (Package updates) Added a release notes entry if the change is major or breaking
  • (Module updates) Added a release notes entry if the change is significant
  • (Module addition) Added a release notes entry if adding a new NixOS module
  • (Release notes changes) Ran nixos/doc/manual/md-to-db.sh to update generated release notes
• Fits CONTRIBUTING.md.

[lopsided98]

I'm running into a strange issue (not obviously related to this PR) where packages that depend on cffi as a native build input (such as brotlicffi) are attempting to build a version of cffi that is built for build platform but depends on host platform libffi. This obviously fails to build, with the following error:

gcc -shared -L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-zlib-1.2.12/lib -L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-bzip2-1.0.6.0.2/lib -L/nix/store/eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee-expat-2.4.8/lib -L/nix/store/eeeeeeeeeeeeeeeeeeeeee>
/nix/store/rs684lgm8k7akkgbisb49z4vpxxc2zns-binutils-2.38/bin/ld: skipping incompatible /nix/store/b7p34l2l1w21b6kvpv31kr65v0pdfyzh-libffi-armv6l-unknown-linux-gnueabihf-3.4.2/lib/libffi.so when searching for -lffi
/nix/store/rs684lgm8k7akkgbisb49z4vpxxc2zns-binutils-2.38/bin/ld: skipping incompatible /nix/store/b7p34l2l1w21b6kvpv31kr65v0pdfyzh-libffi-armv6l-unknown-linux-gnueabihf-3.4.2/lib/libffi.so when searching for -lffi
/nix/store/rs684lgm8k7akkgbisb49z4vpxxc2zns-binutils-2.38/bin/ld: cannot find -lffi: No such file or directory
/nix/store/rs684lgm8k7akkgbisb49z4vpxxc2zns-binutils-2.38/bin/ld: skipping incompatible /nix/store/b7p34l2l1w21b6kvpv31kr65v0pdfyzh-libffi-armv6l-unknown-linux-gnueabihf-3.4.2/lib/libffi.so when searching for -lffi
/nix/store/rs684lgm8k7akkgbisb49z4vpxxc2zns-binutils-2.38/bin/ld: skipping incompatible /nix/store/b7p34l2l1w21b6kvpv31kr65v0pdfyzh-libffi-armv6l-unknown-linux-gnueabihf-3.4.2/lib/libffi.so when searching for -lffi
collect2: error: ld returned 1 exit status
error: command '/nix/store/bg35nfwn6zd616facdywiysgpprfvsji-gcc-wrapper-11.3.0/bin/gcc' failed with exit code 1

[Mindavi]

That ffi issue is an issue I observed before already, so I'd say it's unrelated.

[lopsided98]

Yes, I bisected it and found that #169475 was responsible.

[lopsided98]

@ofborg build pkgsCross.armv7l-hf-multiplatform.python3Packages.numpy

[Mindavi]

Is fetchpatch allowed here? Think this is somewhere in the bootstrap, hence causing the eval failure?

[lopsided98]

I was wondering about that as well. I'm not sure how to know whether that is the case.

[FRidh]

The Python interpreter is a bootstrap package, but setuptools is not (and should not be).

[Artturin]

The eval failure is unrelated and is due to ofborg timing out building something

[Artturin]

Cross built on ofborg

[ck3d]

@lopsided98 I had the same problem in nixos-22.05, do you want to backport this PR or should I open a new PR?

[Artturin]

cross-compilation is usually in the best shape on master so I recommend using nixos-unstable (afaik all of the people interested in cross-compilation are on nixos-unstable)

you can add labels yourself if you want since you're a member of the org

[ck3d]

I want to migrate from NixOS-21.11 to NixOS-22.05 but I hit this issue. It is frustrating if we loose capabilities between NixOS releases. I try to find a workaround on my production side. We will see if more people are interested to fix this issue for NixOS-22.05.

[Mindavi]

We can backport this, but it depends on what you're doing if this is sufficient

[github-actions]

Successfully created backport PR #181734 for staging-22.05.

[ck3d]

Thanks. Yes this PR is sufficient to cross compile a lot of Python packages (e.g. lxml, btrfs-progs, ...) for NixOS-22.05.