Skip to content

fix: remove trailing slash in --test-package-url URLs causing CI 404 errors#36535

Merged
k8s-ci-robot merged 1 commit intokubernetes:masterfrom
damdo:fix-stage-address-slash-part-2
Feb 27, 2026
Merged

fix: remove trailing slash in --test-package-url URLs causing CI 404 errors#36535
k8s-ci-robot merged 1 commit intokubernetes:masterfrom
damdo:fix-stage-address-slash-part-2

Conversation

@damdo
Copy link
Copy Markdown
Member

@damdo damdo commented Feb 27, 2026

A follow up to #36528 as the job got further but still broke afterwards.

--

Remove trailing slashes from --test-package-url URLs in kubetest2 ec2 job configurations. When combined in these spots

these trailing slashes resulted in double slashes in download URLs (e.g. https://dl.k8s.io//ci/fast/latest-fast.txt).

Causing the following error:

I0226 13:35:18.842783   26057 package.go:51] Test package version was not specified. Defaulting to version from latest-fast.txt: <?xml version='1.0' encoding='UTF-8'?><Error><Code>NoSuchKey</Code><Message>The specified key does not exist.</Message><Details>No such object: 767373bbdcb8270361b96548387bf2a9ad0d48758c35//ci/fast/latest-fast.txt</Details></Error>
I0226 13:35:18.842890   26057 package.go:201] Downloading test tar ball from: https://dl.k8s.io//ci/fast/NoSuchKeyThe specified key does not exist.
Details
No such object: 767373bbdcb8270361b96548387bf2a9ad0d48758c35//ci/fast/latest-fast.txt
/kubernetes-test-linux-amd64.tar.gz
F0226 13:35:18.854134   26057 ginkgo.go:259] failed to run ginkgo tester: failed to get ginkgo test package from published releases: failed to create gzip reader: EOF

This previously worked because the dl.k8s.io CDN would redirect malformed URLs, but as of Feb 16, 2026, the CDN serves directly from the origin, causing 404 errors for URLs with double slashes.

Affected jobs:

  • cloud-provider-aws periodics and presubmits
  • sig-node presubmits

Fixes CI failures observed since mid-February in pull-cloud-provider-aws-e2e-kubetest2-quick and related jobs.

Context on thread here: https://kubernetes.slack.com/archives/C09QZ4DQB/p1772041962062339

A follow up to kubernetes#36528
as the job got further but still broke afterwards.

Remove trailing slashes from --test-package-url URLs in kubetest2 ec2 job configurations.
When combined in these spots
- https://github.com/kubernetes-sigs/kubetest2/blob/beaf896881019d46bdf961228a117993c1d813db/pkg/testers/ginkgo/package.go#L42
- https://github.com/kubernetes-sigs/kubetest2/blob/beaf896881019d46bdf961228a117993c1d813db/pkg/testers/ginkgo/package.go#L183-L200

these trailing slashes resulted in double slashes in download URLs (e.g. `https://dl.k8s.io//ci/fast/latest-fast.txt`).

Causing the following error:
```
I0226 13:35:18.842783   26057 package.go:51] Test package version was not specified. Defaulting to version from latest-fast.txt: <?xml version='1.0' encoding='UTF-8'?><Error><Code>NoSuchKey</Code><Message>The specified key does not exist.</Message><Details>No such object: 767373bbdcb8270361b96548387bf2a9ad0d48758c35//ci/fast/latest-fast.txt</Details></Error>
I0226 13:35:18.842890   26057 package.go:201] Downloading test tar ball from: https://dl.k8s.io//ci/fast/NoSuchKeyThe specified key does not exist.
Details
No such object: 767373bbdcb8270361b96548387bf2a9ad0d48758c35//ci/fast/latest-fast.txt
/kubernetes-test-linux-amd64.tar.gz
F0226 13:35:18.854134   26057 ginkgo.go:259] failed to run ginkgo tester: failed to get ginkgo test package from published releases: failed to create gzip reader: EOF
```

This previously worked because the dl.k8s.io CDN would redirect
malformed URLs, but as of Feb 16, 2026, the CDN serves directly from
the origin, causing 404 errors for URLs with double slashes.

Affected jobs:
- cloud-provider-aws periodics and presubmits
- sig-node presubmits

Fixes CI failures observed since mid-February in pull-cloud-provider-aws-e2e-kubetest2-quick and related jobs.

Context on thread here: https://kubernetes.slack.com/archives/C09QZ4DQB/p1772041962062339
@k8s-ci-robot k8s-ci-robot added cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. area/config Issues or PRs related to code in /config size/XS Denotes a PR that changes 0-9 lines, ignoring generated files. area/jobs area/provider/aws Issues or PRs related to aws provider labels Feb 27, 2026
@k8s-ci-robot k8s-ci-robot added sig/cloud-provider Categorizes an issue or PR as relevant to SIG Cloud Provider. sig/node Categorizes an issue or PR as relevant to SIG Node. sig/testing Categorizes an issue or PR as relevant to SIG Testing. labels Feb 27, 2026
@damdo
Copy link
Copy Markdown
Member Author

damdo commented Feb 27, 2026

/assign @upodroid @dims

@github-project-automation github-project-automation bot moved this from Triage to PRs - Needs Approver in SIG Node CI/Test Board Feb 27, 2026
@k8s-ci-robot k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Feb 27, 2026
@k8s-ci-robot
Copy link
Copy Markdown
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: damdo, upodroid

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@k8s-ci-robot k8s-ci-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Feb 27, 2026
@k8s-ci-robot k8s-ci-robot merged commit 0fad520 into kubernetes:master Feb 27, 2026
6 checks passed
@github-project-automation github-project-automation bot moved this from PRs - Needs Approver to Done in SIG Node CI/Test Board Feb 27, 2026
@k8s-ci-robot
Copy link
Copy Markdown
Contributor

@damdo: Updated the job-config configmap in namespace default at cluster test-infra-trusted using the following files:

  • key cloud-provider-aws-periodics.yaml using file config/jobs/kubernetes/cloud-provider-aws/cloud-provider-aws-periodics.yaml
  • key cloud-provider-aws-presubmit.yaml using file config/jobs/kubernetes/cloud-provider-aws/cloud-provider-aws-presubmit.yaml
  • key sig-node-presubmit.yaml using file config/jobs/kubernetes/sig-node/sig-node-presubmit.yaml
Details

In response to this:

A follow up to #36528 as the job got further but still broke afterwards.

--

Remove trailing slashes from --test-package-url URLs in kubetest2 ec2 job configurations. When combined in these spots

these trailing slashes resulted in double slashes in download URLs (e.g. https://dl.k8s.io//ci/fast/latest-fast.txt).

Causing the following error:

I0226 13:35:18.842783   26057 package.go:51] Test package version was not specified. Defaulting to version from latest-fast.txt: <?xml version='1.0' encoding='UTF-8'?><Error><Code>NoSuchKey</Code><Message>The specified key does not exist.</Message><Details>No such object: 767373bbdcb8270361b96548387bf2a9ad0d48758c35//ci/fast/latest-fast.txt</Details></Error>
I0226 13:35:18.842890   26057 package.go:201] Downloading test tar ball from: https://dl.k8s.io//ci/fast/NoSuchKeyThe specified key does not exist.
Details
No such object: 767373bbdcb8270361b96548387bf2a9ad0d48758c35//ci/fast/latest-fast.txt
/kubernetes-test-linux-amd64.tar.gz
F0226 13:35:18.854134   26057 ginkgo.go:259] failed to run ginkgo tester: failed to get ginkgo test package from published releases: failed to create gzip reader: EOF

This previously worked because the dl.k8s.io CDN would redirect malformed URLs, but as of Feb 16, 2026, the CDN serves directly from the origin, causing 404 errors for URLs with double slashes.

Affected jobs:

  • cloud-provider-aws periodics and presubmits
  • sig-node presubmits

Fixes CI failures observed since mid-February in pull-cloud-provider-aws-e2e-kubetest2-quick and related jobs.

Context on thread here: https://kubernetes.slack.com/archives/C09QZ4DQB/p1772041962062339

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by an approver from all required OWNERS files. area/config Issues or PRs related to code in /config area/jobs area/provider/aws Issues or PRs related to aws provider cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. lgtm "Looks good to me", indicates that a PR is ready to be merged. sig/cloud-provider Categorizes an issue or PR as relevant to SIG Cloud Provider. sig/node Categorizes an issue or PR as relevant to SIG Node. sig/testing Categorizes an issue or PR as relevant to SIG Testing. size/XS Denotes a PR that changes 0-9 lines, ignoring generated files.

Projects

Development

Successfully merging this pull request may close these issues.

4 participants