Add `extra-build-dependencies` by zanieb · Pull Request #14735 · astral-sh/uv

zanieb · 2025-07-18T17:37:54Z

Replaces #14092

Adds tool.uv.extra-build-dependencies = {package = [dependency, ...]} which extends build-system.requires during package builds.

These are lowered via workspace sources, are applied to transitive dependencies, and are included in the wheel cache shard hash.

There are some features we need to follow-up on, but are out of scope here:

Preferring locked versions for build dependencies
Settings for requiring locked versions for build depencies

There are some quality of life follow-ups we should also do:

Warn on extra-build-dependencies that do not apply to any packages
Add test cases and improve error messaging when the extra-build-dependencies resolve fails

There ~~are~~ were a few open decisions to be made here

Should we resolve these dependencies alongside the build-system.requires dependencies? Or should we resolve separately? (I think the latter is more powerful? because you can override things? but it opens the door to breaking your build)
Should we install these dependencies into the same environment? Or should we layer it on top as we do elsewhere? (I think it's fine to install into the same environment)
Should we respect sources defined in the parent project? (I think yes, but then we need to lower the dependencies earlier — I don't think that's a big deal, but it's not implemented)
Should we respect sources defined in the child project? (I think no, this gets really complicated and seems weird to allow)
Should we apply this to transitive dependencies? (I think so)

crates/uv-build-frontend/src/lib.rs

zanieb · 2025-07-18T17:46:27Z

crates/uv/tests/it/sync.rs

+fn sync_extra_build_dependencies() -> Result<()> {
+    let context = TestContext::new("3.12").with_filtered_counts();
+
+    // Write a test package that arbitrarily requires `anyio` at build time


Thank you <3 @konstin for the deranged test case

charliermarsh · 2025-07-20T17:23:12Z

Should we resolve these dependencies alongside the build-system.requires dependencies? Or should we resolve separately? (I think the latter is more powerful? because you can override things? but it opens the door to breaking your build)

I would probably resolve them together. At least until we see a use-case to resolve them separately. (We could add build dependency overrides to allow explicit overrides, like we have build dependency constraints.)

Should we install these dependencies into the same environment? Or should we layer it on top as we do elsewhere. (I think it's fine to install into the same environment)

Same environment IMO.

Should we respect sources defined in the parent project? (I think yes, but then we need to lower the dependencies earlier)

I think yes... I think we should respect the sources defined in the same file as the extra-build-dependencies definition, for consistency.

Should we respect sources defined in the child project? (I think no)

I don't think so.

Should we apply this to transitive dependencies? (I think so)

I think so, yeah. Similar to other settings, like --config-settings-package.

crates/uv-bench/benches/uv.rs

crates/uv-dispatch/src/lib.rs

charliermarsh · 2025-07-30T01:20:06Z

crates/uv-distribution/src/metadata/build_requires.rs

+    }
+
+    /// Create from pre-lowered dependencies (for non-workspace contexts).
+    pub fn from_lowered(extra_build_dependencies: ExtraBuildDependencies) -> Self {


Should this just be a From<ExtraBuildDependencies> impl?

This separate method avoids accidentally converting them without lowering

Yeah I think a dedicated method makes sense here.

crates/uv-pep508/src/lib.rs

charliermarsh · 2025-07-30T01:21:55Z

crates/uv-pep508/src/lib.rs

+                }
+                VersionOrUrl::Url(url) => {
+                    1u8.cache_key(state);
+                    url.to_string().cache_key(state);


Is the to_string because it's generic? I wonder if we could require Pep508Url to impl CacheKey?

Yeah I think so, I looked at it briefly and it the generic aspect seemed tricky.

crates/uv-settings/src/settings.rs

crates/uv/src/commands/project/mod.rs

scripts/packages/anyio_local/anyio/__init__.py

charliermarsh

Nice work.

docs/reference/settings.md

crates/uv-workspace/src/pyproject.rs

crates/uv-build-frontend/src/lib.rs

konstin · 2025-07-30T09:34:00Z

crates/uv-distribution/src/metadata/build_requires.rs

+    }
+
+    /// Create from pre-lowered dependencies (for non-workspace contexts).
+    pub fn from_lowered(extra_build_dependencies: ExtraBuildDependencies) -> Self {


This separate method avoids accidentally converting them without lowering

This MR contains the following updates: | Package | Update | Change | |---|---|---| | [astral-sh/uv](https://github.com/astral-sh/uv) | patch | `0.8.3` -> `0.8.4` | MR created with the help of [el-capitano/tools/renovate-bot](https://gitlab.com/el-capitano/tools/renovate-bot). **Proposed changes to behavior should be submitted there as MRs.** --- ### Release Notes <details> <summary>astral-sh/uv (astral-sh/uv)</summary> ### [`v0.8.4`](https://github.com/astral-sh/uv/blob/HEAD/CHANGELOG.md#084) [Compare Source](astral-sh/uv@0.8.3...0.8.4) ##### Enhancements - Improve styling of warning cause chains ([#14934](astral-sh/uv#14934)) - Extend wheel filtering to Android tags ([#14977](astral-sh/uv#14977)) - Perform wheel lockfile filtering based on platform and OS intersection ([#14976](astral-sh/uv#14976)) - Clarify messaging when a new resolution needs to be performed ([#14938](astral-sh/uv#14938)) ##### Preview features - Add support for extending package's build dependencies with `extra-build-dependencies` ([#14735](astral-sh/uv#14735)) - Split preview mode into separate feature flags ([#14823](astral-sh/uv#14823)) ##### Configuration - Add support for package specific `exclude-newer` dates via `exclude-newer-package` ([#14489](astral-sh/uv#14489)) ##### Bug fixes - Avoid invalidating lockfile when path or workspace dependencies define explicit indexes ([#14876](astral-sh/uv#14876)) - Copy entrypoints that have a shebang that differs in `python` vs `python3` ([#14970](astral-sh/uv#14970)) - Fix incorrect file permissions in wheel packages ([#14930](astral-sh/uv#14930)) - Update validation for `environments` and `required-environments` in `uv.toml` ([#14905](astral-sh/uv#14905)) ##### Documentation - Show `uv_build` in projects documentation ([#14968](astral-sh/uv#14968)) - Add `UV_` prefix to installer environment variables ([#14964](astral-sh/uv#14964)) - Un-hide `uv` from `--build-backend` options ([#14939](astral-sh/uv#14939)) - Update documentation for preview flags ([#14902](astral-sh/uv#14902)) </details> --- ### Configuration 📅 **Schedule**: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined). 🚦 **Automerge**: Disabled by config. Please merge this manually once you are satisfied. ♻ **Rebasing**: Whenever MR becomes conflicted, or you tick the rebase/retry checkbox. 🔕 **Ignore**: Close this MR and you won't be reminded about this update again. --- - [ ] If you want to rebase/retry this MR, check this box --- This MR has been generated by [Renovate Bot](https://github.com/renovatebot/renovate).

Gankra and others added 6 commits July 18, 2025 08:14

WIP extra-build-dependencies

74c5064

snapshot regens

5108c1e

Use faster test case

190a40c

Update JSON schema

4ca5770

Never apply sources

a0876c4

Never apply sources

c337cea

zanieb added enhancement New feature or improvement to existing functionality preview Experimental behavior labels Jul 18, 2025

zanieb temporarily deployed to uv-test-registries July 18, 2025 17:40 — with GitHub Actions Inactive

zanieb commented Jul 18, 2025

View reviewed changes

crates/uv-build-frontend/src/lib.rs Outdated Show resolved Hide resolved

zanieb commented Jul 18, 2025

View reviewed changes

zanieb added 5 commits July 22, 2025 08:24

Add preview warnings

fa21bf0

Lower sources

6fb8618

Use in cache shards

8b5d931

Revert some noise

a06aa47

Merge branch 'main' into zb/extra-build-dependencies

1d2d9aa

zanieb force-pushed the zb/extra-build-dependencies branch from ae3d08f to 1d2d9aa Compare July 23, 2025 18:39

zanieb temporarily deployed to uv-test-registries July 23, 2025 18:43 — with GitHub Actions Inactive

zanieb temporarily deployed to uv-test-registries July 23, 2025 23:25 — with GitHub Actions Inactive

Add script sources support

db10dcb

zanieb force-pushed the zb/extra-build-dependencies branch from 9b52574 to db10dcb Compare July 23, 2025 23:57

zanieb temporarily deployed to uv-test-registries July 23, 2025 23:59 — with GitHub Actions Inactive

Update snapshot

c1020e6

zanieb temporarily deployed to uv-test-registries July 24, 2025 22:37 — with GitHub Actions Inactive

zanieb temporarily deployed to uv-test-registries July 25, 2025 19:18 — with GitHub Actions Inactive

zanieb temporarily deployed to uv-test-publish July 25, 2025 19:19 — with GitHub Actions Inactive

Merge branch 'main' into zb/extra-build-dependencies

bd55fda

zanieb force-pushed the zb/extra-build-dependencies branch from b44584e to bd55fda Compare July 25, 2025 19:25

zanieb temporarily deployed to uv-test-registries July 25, 2025 19:27 — with GitHub Actions Inactive

Use (&script).into() consistently

6c61c7f

zanieb force-pushed the zb/extra-build-dependencies branch from 6d46b63 to 6c61c7f Compare July 29, 2025 23:16

zanieb temporarily deployed to uv-test-registries July 29, 2025 23:20 — with GitHub Actions Inactive

Regenerate reference

33bb91a

zanieb had a problem deploying to uv-test-registries July 29, 2025 23:34 — with GitHub Actions Failure