python3Packages.vllm: disable Blackwell GPU support to fix CUDA build

[daniel-fahey]

Fixes type of build failure seen here.

• vLLM v0.11.0's FlashMLA kernels for Blackwell (SM100+) GPUs require CUTLASS v4.2.1+ APIs that are not available in the bundled v4.0.0
• Temporarily disable these architectures until upstream upgrades CUTLASS

Things done

• Built on platform:
  • x86_64-linux
  • aarch64-linux
  • x86_64-darwin
  • aarch64-darwin
• Tested, as applicable:
  • NixOS tests in nixos/tests.
  • Package tests at passthru.tests.
  • Tests in lib/tests or pkgs/test for functions and "core" functionality.
• Ran nixpkgs-review on this PR. See nixpkgs-review usage.
• Tested basic functionality of all binary files, usually in ./result/bin/.
• Nixpkgs Release Notes
  • Package update: when the change is major or breaking.
• NixOS Release Notes
  • Module addition: when adding a new NixOS module.
  • Module update: when the change is significant.
• Fits CONTRIBUTING.md, pkgs/README.md, maintainers/README.md and other READMEs.

---

Add a 👍 reaction to pull requests you find important.

[GaetanLepage]

Have you tried bumping cutlass to 4.2.1 instead?

[daniel-fahey]

Have you tried bumping cutlass to 4.2.1 instead?

Not yet, definitely worth a go.

[daniel-fahey]

Attempt 0da1974

nix-build -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/0da19742a9d0b7041c791cb043ffaaccffb6090d.tar.gz --arg config '{ allowUnfree = true; cudaSupport = true; }' -A python313Packages.vllm

this derivation will be built:
  /nix/store/f2bxd9hgy6gdhyqf3a6wyrii4kpy5zc1-python3.13-vllm-0.11.0.drv
building '/nix/store/f2bxd9hgy6gdhyqf3a6wyrii4kpy5zc1-python3.13-vllm-0.11.0.drv' on 'ssh://eu.nixbuild.net'...

failing

[nixbuild.net] Build 4586852 finished in 27 minutes with status 'build_failed'. Max memory usage was 73.0 of 128.5 GB. Average CPU utilization was 84% of 15 CPUs.

See this link for more details and logs.

[daniel-fahey]

Earlier attempt cd48d25 also failed.

nix-build -I nixpkgs=https://github.com/NixOS/nixpkgs/archive/2dad10142fae482e3b7859118467bfbf38fbb4d5.tar.gz --arg config '{ allowUnfree = true; cudaSupport = true; }' -A python313Packages.vllm

[nixbuild.net] Build 4588139 finished in 38 minutes with status 'build_failed'. Max memory usage was 73.7 of 128.5 GB. Average CPU utilization was 84% of 15 CPUs.

See this link for more details and logs.

[daniel-fahey]

b1cef6c

nix-build --pure https://github.com/NixOS/nixpkgs/archive/b1cef6ca8d5dc66099a5f17f26724a1175a0ed72.tar.gz --arg config '{ allowUnfree = true; cudaSupport = true; }' --attr python313Packages.vllm

unpacking 'https://github.com/NixOS/nixpkgs/archive/b1cef6ca8d5dc66099a5f17f26724a1175a0ed72.tar.gz' into the Git cache...
this derivation will be built:
  /nix/store/1hqrs2hflnpppacgmwgghndqsk6f55mb-python3.13-vllm-0.11.0.drv
building '/nix/store/1hqrs2hflnpppacgmwgghndqsk6f55mb-python3.13-vllm-0.11.0.drv' on 'ssh://eu.nixbuild.net'...
copying 2 paths...
copying path '/nix/store/02mndfh9j65g9g3dg3y76yvfwik0539s-vllm-flash-attn-2.7.2.post1' to 'ssh://eu.nixbuild.net'...
copying path '/nix/store/a1vglvbl2lg951y0izm6bmzp8ggggxfq-flashmla-1.0.0' to 'ssh://eu.nixbuild.net'...
[nixbuild.net] Build 4590363 queued at 25-10-06 15:54:26Z. Allocated 15 CPUs, 128.5 GB memory.

Successfully built:

[nixbuild.net] Build 4590363 finished in an hour with status 'built'. Max memory usage was 84.8 of 128.5 GB. Average CPU utilization was 93% of 15 CPUs.[....]
copying 2 paths...
copying path '/nix/store/bnc6a9ds9hbcsaxdkrh1mwdnjrf24fb5-python3.13-vllm-0.11.0' from 'ssh://eu.nixbuild.net'...
copying path '/nix/store/djhlaai2s38dax2i85zasxffffjjgbn7-python3.13-vllm-0.11.0-dist' from 'ssh://eu.nixbuild.net'...
/nix/store/bnc6a9ds9hbcsaxdkrh1mwdnjrf24fb5-python3.13-vllm-0.11.0

See this link for more details and logs.

[GaetanLepage]

nixpkgs-review result

Generated using nixpkgs-review.

Command: nixpkgs-review pr 448965 --extra-nixpkgs-config '{ allowUnfree = true; cudaSupport = true; }'
Commit: b1cef6ca8d5dc66099a5f17f26724a1175a0ed72

---

x86_64-linux

✅ 13 packages built:

• nixpkgs-manual
• python312Packages.kserve
• python312Packages.kserve.dist
• python312Packages.torchrl
• python312Packages.torchrl.dist
• vllm (python312Packages.vllm)
• vllm.dist (python312Packages.vllm.dist)
• python313Packages.kserve
• python313Packages.kserve.dist
• python313Packages.torchrl
• python313Packages.torchrl.dist
• python313Packages.vllm
• python313Packages.vllm.dist

[GaetanLepage]

Thanks