Repository navigation
Widen decided versions in dependency clauses - #357
Merged
Merged
Conversation
notatallshaw
force-pushed
the
perf/widen-decided-versions
branch
from
July 11, 2026 05:31
1c00d45 to
7b3cf0b
Compare
notatallshaw
force-pushed
the
perf/widen-decided-versions
branch
from
July 11, 2026 05:47
7b3cf0b to
ce60e8b
Compare
notatallshaw
marked this pull request as ready for review
July 11, 2026 05:52
notatallshaw
enabled auto-merge
July 11, 2026 05:52
charliermarsh
pushed a commit
to astral-sh/uv
that referenced
this pull request
Aug 8, 2026
This is a partial port of a technique I am adopting in nab, I have been following @konstin's lead in astral-sh/pubgrub#75 and extending the approach into more places (notatallshaw/nab#357, notatallshaw/nab#590, notatallshaw/nab#592, notatallshaw/nab#604). This speeds up `uv lock` with `requires-python >= 3.8` over boto3 + awscli by ~20% wall time, and the largest accumulated range in the run drops from 287 segments to 2. `add_unavailable_version` records one singleton incompatibility per rejected version, so consecutive rejections never coalesce and the accumulated range grows a hole per version. This widens each singleton to the gap between its neighbors in the known versions, the same interval decided-version dependencies use. The win needs long runs of rejected versions. The main source is a Python floor below the ecosystem's support boundary: boto3 and awscli dropped 3.8 in April 2025 and now require >= 3.10, so a 3.8 floor rejects hundreds of releases in one run, while a 3.10 floor rejects almost nothing (14 rounds, 2 segments either way) and the change is a no-op. The first commit keys the pre-release hint on the requesting requirement instead of the derived set's bounds: widened bounds land on whatever the registry lists next, and a pre-release neighbor used to read as a pre-release marker nobody wrote. Rejection widening makes that routine, so the fix leads the series. The second commit merges unavailable versions that are causes of the same derivation, and the third is the widening itself. The fourth keeps the subsequent-index hint, which was suppressed whenever the set covered all versions; after widening that also covers "the index listed versions and none of them worked", which is the case the hint is for. The last two commits are #20809, merged in here so the error messages land as one change. With the widening, uv no longer asks for a version in a gap it created, so the `no_versions` incompatibility behind "only the following versions of X are available" is no longer created there, and steps that cross a gap stop following from the premises next to them. The fifth commit adds that clause back while the tree is reduced, on whichever cause rules the package out, or on the step itself when neither does. The sixth reports the one version a package has as that version rather than as a range over it, so a rejected `sphinx 7.2.6` reads `sphinx==7.2.6` and not `sphinx>=7.2.6`. Neither touches the solver. <details> <summary>MRE</summary> ```toml [project] name = "mre" version = "0.1.0" requires-python = ">=3.8" dependencies = ["boto3", "awscli"] ``` Max accumulated segments (287 on main, 2 with this PR; `uv.lock` identical): ```console $ uv lock --exclude-newer 2026-07-01 -v 2>&1 | grep 'Searching for a compatible version' | awk -F'|' '{print NF}' | sort -n | tail -1 ``` Wall (run without `-v`, which prints the accumulated ranges and dominates the time): ```console $ hyperfine --warmup 3 --min-runs 20 --prepare 'rm -f uv.lock' 'uv lock --exclude-newer 2026-07-01' ``` </details>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Ports uv's decided-version widening (astral-sh/pubgrub PR 75) to nab. A positive term over an already-decided package is widened to the open gap between its listed neighbours, cutting intersection and range work in conflict-heavy backtracking.
Wall time across scenarios that pass on both sides: about -23% (kedro 21s to 4s, langchain 15s to 4s). Net +4 successes (six FAIL to OK, including pandas-with-aws-s3 and apache-airflow-311-full).
Widening changes which derivation satisfies a decided term, which starved nab's conflict crediting, so the credit moves to the dependency parent (second commit). Open item: pdm-skypilot-dvc regresses under the current crediting shape, which is why this is a draft.