Skip to content

Revert #77#13176

Merged
edolstra merged 1 commit intoNixOS:masterfrom
obsidiansystems:revert-incomplete-closure-feature
May 15, 2025
Merged

Revert #77#13176
edolstra merged 1 commit intoNixOS:masterfrom
obsidiansystems:revert-incomplete-closure-feature

Conversation

@Ericson2314
Copy link
Member

Motivation

As summarized in
#77 (comment) the motivation is that the complicated retry logic this introduced was making the cleanup task #12628 harder to accomplish. It was not easy to ascertain just what policy / semantics the extra control-flow was implementing, in order to figure out a different way to implementing it either.

After talking to Eelco about it, he decided we could just....get rid of the feature entirely! It's a bit scary removing a decade+ old feature, but I think he is right. See the release notes for more explanation.

Context

In practice, when remote stores fail to implement the closure property (have object -> have all its dependencies), it is usually not due to arbitrary corruption, but due to the fact that the remote store was intended to act as an "overlay" store, often over cache.nixos.org. In that case, the right fix is not do some sort of "franken-building" (as this feature implemented) but to make sure both substituters are configured.

(In the future, we should make it easier for remote stores to indicate this to clients, to catch settings that won't work in general before a missing dependency is actually encountered.)

Any non-intentional case of stores missing dependencies, by contrast, I do not know about.

This reverts commit 299141e.


Add 👍 to pull requests you find important.

The Nix maintainer team uses a GitHub project board to schedule and track reviews.

@github-actions github-actions bot added the with-tests Issues related to testing. PRs with tests have some priority label May 13, 2025
@Ericson2314 Ericson2314 force-pushed the revert-incomplete-closure-feature branch from 0156535 to eb89e44 Compare May 13, 2025 18:38
@Ericson2314 Ericson2314 marked this pull request as ready for review May 13, 2025 18:38
@Ericson2314 Ericson2314 requested a review from edolstra as a code owner May 13, 2025 18:38
@Ericson2314 Ericson2314 force-pushed the revert-incomplete-closure-feature branch from eb89e44 to 5b0ed7d Compare May 13, 2025 18:40
@Ericson2314 Ericson2314 force-pushed the revert-incomplete-closure-feature branch 2 times, most recently from 88f5e5e to ea02e93 Compare May 14, 2025 18:36
In practice, however, we doubt even the more building is very likely to happen.
Remote stores that are missing dependencies in arbitrary ways (e.g. corruption) don't seem to be very common.

On the contrary, when remote stores fail to implement the [closure property](@docroot@/store/store-object.md#closure-property), it is usually an *intentional* choice on the part of the remote store, because it wishes to serve as an "overlay" store over another store, such as `https://cache.nixos.org`.
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

OK it's a link now. Thank you @Mic92 for merging the other PR so quickly!

…en retry the substituter"

As summarized in
NixOS#77 (comment) the
motivation is that the complicated retry logic this introduced was
making the cleanup task NixOS#12628 harder to accomplish. It was not easy to
ascertain just what policy / semantics the extra control-flow was
implementing, in order to figure out a different way to implementing it
either.

After talking to Eelco about it, he decided we could just....get rid of
the feature entirely! It's a bit scary removing a decade+ old feature,
but I think he is right. See the release notes for more explanation.

This reverts commit 299141e.

Co-authored-by: Eelco Dolstra <edolstra@gmail.com>
@Ericson2314 Ericson2314 force-pushed the revert-incomplete-closure-feature branch from ea02e93 to 99cb85c Compare May 15, 2025 00:20
@edolstra edolstra merged commit 3285b68 into NixOS:master May 15, 2025
12 checks passed
@Ericson2314 Ericson2314 deleted the revert-incomplete-closure-feature branch May 15, 2025 16:51
@nixos-discourse
Copy link

This pull request has been mentioned on NixOS Discourse. There might be relevant details there:

https://discourse.nixos.org/t/nix-2-30-0-released/66449/1

@roberth roberth added the backports rejected PR should not be backported (or at least not in full, or unless an overriding need arises) label Jul 30, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backports rejected PR should not be backported (or at least not in full, or unless an overriding need arises) documentation with-tests Issues related to testing. PRs with tests have some priority

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants