Skip to content

Comments

feat(libstore): add builtin fetchurl S3 credential pre-resolution#14206

Merged
xokdvium merged 1 commit intoNixOS:masterfrom
lovesegfault:curl-based-s3-pieces
Oct 14, 2025
Merged

feat(libstore): add builtin fetchurl S3 credential pre-resolution#14206
xokdvium merged 1 commit intoNixOS:masterfrom
lovesegfault:curl-based-s3-pieces

Conversation

@lovesegfault
Copy link
Member

Motivation

Add support for pre-resolving AWS credentials in the parent process
before forking for builtin:fetchurl. This avoids recreating credential
providers in the forked child process.

Context

Carve out of #13752


Add 👍 to pull requests you find important.

The Nix maintainer team uses a GitHub project board to schedule and track reviews.

Copy link
Member

@Ericson2314 Ericson2314 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. But let's wait for @xokdvium again, especially because he caught a lot of things last time that I didn't notice.

@lovesegfault lovesegfault requested a review from xokdvium October 10, 2025 17:54
lovesegfault added a commit to lovesegfault/nix that referenced this pull request Oct 12, 2025
Add `curl-s3-binary-cache-store.nix` with comprehensive test coverage
for the curl-based S3 implementation.

Some tests are commented out pending NixOS#14206 (builtin fetchurl S3
credential pre-resolution):
- test_fork_credential_preresolution
- test_concurrent_fetches

Also, this will fail while NixOS#14222 does not land.
lovesegfault added a commit to lovesegfault/nix that referenced this pull request Oct 12, 2025
Add `curl-s3-binary-cache-store.nix` with comprehensive test coverage
for the curl-based S3 implementation.

Some tests are commented out pending NixOS#14206 (builtin fetchurl S3
credential pre-resolution):
- test_fork_credential_preresolution
- test_concurrent_fetches

Also, this will fail while NixOS#14222 does not land.
lovesegfault added a commit to lovesegfault/nix that referenced this pull request Oct 12, 2025
Add `curl-s3-binary-cache-store.nix` with comprehensive test coverage
for the curl-based S3 implementation.

Some tests are commented out pending NixOS#14206 (builtin fetchurl S3
credential pre-resolution):
- test_fork_credential_preresolution
- test_concurrent_fetches

Also, this will fail while NixOS#14222 does not land.
lovesegfault added a commit to lovesegfault/nix that referenced this pull request Oct 12, 2025
Add `curl-s3-binary-cache-store.nix` with comprehensive test coverage
for the curl-based S3 implementation.

Some tests are commented out pending NixOS#14206 (builtin fetchurl S3
credential pre-resolution):
- test_fork_credential_preresolution
- test_concurrent_fetches

Also, this will fail while NixOS#14222 does not land.
lovesegfault added a commit to lovesegfault/nix that referenced this pull request Oct 12, 2025
Add `curl-s3-binary-cache-store.nix` with comprehensive test coverage
for the curl-based S3 implementation.

Some tests are commented out pending NixOS#14206 (builtin fetchurl S3
credential pre-resolution):
- test_fork_credential_preresolution
- test_concurrent_fetches

Also, this will fail while NixOS#14222 does not land.
Add support for pre-resolving AWS credentials in the parent process
before forking for builtin:fetchurl. This avoids recreating credential
providers in the forked child process.
@xokdvium xokdvium added this pull request to the merge queue Oct 14, 2025
Merged via the queue into NixOS:master with commit 4041bfd Oct 14, 2025
18 checks passed
lovesegfault added a commit to lovesegfault/nix that referenced this pull request Oct 14, 2025
Add `curl-s3-binary-cache-store.nix` with comprehensive test coverage
for the curl-based S3 implementation.

Some tests are commented out pending NixOS#14206 (builtin fetchurl S3
credential pre-resolution):
- test_fork_credential_preresolution
- test_concurrent_fetches

Also, this will fail while NixOS#14222 does not land.
lovesegfault added a commit to lovesegfault/nix that referenced this pull request Oct 14, 2025
Add `curl-s3-binary-cache-store.nix` with comprehensive test coverage
for the curl-based S3 implementation.

Depends-On: NixOS#14206, NixOS#14222
@edolstra edolstra mentioned this pull request Dec 9, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants