python3Packages.torch: Disable duplicate openmp inclusion#424873
python3Packages.torch: Disable duplicate openmp inclusion#424873NickCao merged 8 commits intoNixOS:masterfrom
Conversation
This comment was marked as outdated.
This comment was marked as outdated.
8a1093f to
cb5324e
Compare
da42033 to
ec53a40
Compare
This comment was marked as outdated.
This comment was marked as outdated.
c899fd3 to
a7230eb
Compare
apparent intel build failure was triggered when building under Rosetta due to torch ARM issue.
… Darwin Tests cannot find numpy.float128 as it's not supported on 64-bit Darwin.
… Darwin Depends on optional osascript app which isn't in nixpkgs.
a7230eb to
73f686d
Compare
These throw IPv6 network errors and/or hang until timed out.
|
|
Broken packages in review:
|
|
@reckenrode and @GaetanLepage This is ready for review. |
|
jherland
left a comment
There was a problem hiding this comment.
optuna-dashboard parts lgtm.
GaetanLepage
left a comment
There was a problem hiding this comment.
LGTM! Thanks for the thorough investigation!
|
@Aleksanaa Please take a look |
| ]; | ||
|
|
||
| disabledTests = lib.optionals stdenv.hostPlatform.isDarwin [ | ||
| # AttributeError: module 'numpy' has no attribute 'float128' ==> not available on 64-bit Darwin |
There was a problem hiding this comment.
Out of curiosity: are there non 64-bit darwin in the wild?
There was a problem hiding this comment.
Ah, I mentioned "64-bit" to make it explicit that 64 != 128
|
Thank you @NickCao |
Recently, several packages that depended on torch (directly or indirectly) began to segfault during the check phase on Darwin. Bisecting found that this began with the last torch update.
The Darwin crash logs showed a failure while calling
libopenmp.dylib(OpenMP). Randy Eckenrode identified this as an issue with pytorch and FAISS on ARM (pytorch/pytorch#149201), later refined as happening when there are two copies of OpenMP in use.Changes made
llvmPackages.openmpto the build inputs. (This turned out to be a duplicate copy.) This only affects Darwin.python3Packages.optuna-dashboardthat were masked by a segfault.python3Packages.compressai,python3Packages.pylance, andpython3Packages.torcheval.Fixes #423831
Things done
sandbox=falsefor nixpkgs-reviewnix.conf? (See Nix manual)sandbox = relaxedsandbox = truenix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage./result/bin/)Add a 👍 reaction to pull requests you find important.