Skip to content

fix: remove trailing slash in --stage URLs causing 404 errors#36528

Merged
k8s-ci-robot merged 1 commit intokubernetes:masterfrom
damdo:fix-stage-address-slash
Feb 26, 2026
Merged

fix: remove trailing slash in --stage URLs causing 404 errors#36528
k8s-ci-robot merged 1 commit intokubernetes:masterfrom
damdo:fix-stage-address-slash

Conversation

@damdo
Copy link
Copy Markdown
Member

@damdo damdo commented Feb 26, 2026

Remove trailing slashes from --stage URLs in kubetest2 ec2 job configurations. When combined with the version path, these trailing slashes resulted in double slashes in download URLs (e.g., dl.k8s.io/ci/fast//v1.36.0-alpha...).

This previously worked because the dl.k8s.io CDN would redirect malformed URLs, but as of Feb 16, 2026, the CDN serves directly from the origin, causing 404 errors for URLs with double slashes.

Affected jobs:

  • cloud-provider-aws periodics and presubmits
  • sig-cloud-provider/aws ec2-e2e presubmits
  • sig-cloud-provider periodic-e2e
  • sig-node presubmits

Fixes CI failures observed since mid-February in pull-cloud-provider-aws-e2e-kubetest2-quick and related jobs.

Context on thread here: https://kubernetes.slack.com/archives/C09QZ4DQB/p1772041962062339

Remove trailing slashes from --stage URLs in kubetest2 ec2 job
configurations. When combined with the version path, these trailing
slashes resulted in double slashes in download URLs (e.g.,
`dl.k8s.io/ci/fast//v1.36.0-alpha...`).

This previously worked because the dl.k8s.io CDN would redirect
malformed URLs, but as of Feb 16, 2026, the CDN serves directly from
the origin, causing 404 errors for URLs with double slashes.

Affected jobs:
- cloud-provider-aws periodics and presubmits
- sig-cloud-provider/aws ec2-e2e presubmits
- sig-cloud-provider periodic-e2e
- sig-node presubmits

Fixes CI failures observed since mid-February in pull-cloud-provider-aws-e2e-kubetest2-quick and related jobs.

Context on thread here: https://kubernetes.slack.com/archives/C09QZ4DQB/p1772041962062339
@k8s-ci-robot k8s-ci-robot added cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. size/S Denotes a PR that changes 10-29 lines, ignoring generated files. labels Feb 26, 2026
@k8s-ci-robot k8s-ci-robot added area/config Issues or PRs related to code in /config area/jobs area/provider/aws Issues or PRs related to aws provider sig/cloud-provider Categorizes an issue or PR as relevant to SIG Cloud Provider. sig/node Categorizes an issue or PR as relevant to SIG Node. sig/testing Categorizes an issue or PR as relevant to SIG Testing. labels Feb 26, 2026
@github-project-automation github-project-automation bot moved this from Triage to PRs - Needs Approver in SIG Node CI/Test Board Feb 26, 2026
@k8s-ci-robot k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Feb 26, 2026
@k8s-ci-robot
Copy link
Copy Markdown
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: damdo, upodroid

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@k8s-ci-robot k8s-ci-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Feb 26, 2026
@k8s-ci-robot k8s-ci-robot merged commit 2cec64b into kubernetes:master Feb 26, 2026
6 checks passed
@github-project-automation github-project-automation bot moved this from PRs - Needs Approver to Done in SIG Node CI/Test Board Feb 26, 2026
@k8s-ci-robot
Copy link
Copy Markdown
Contributor

@damdo: Updated the job-config configmap in namespace default at cluster test-infra-trusted using the following files:

  • key cloud-provider-aws-periodics.yaml using file config/jobs/kubernetes/cloud-provider-aws/cloud-provider-aws-periodics.yaml
  • key cloud-provider-aws-presubmit.yaml using file config/jobs/kubernetes/cloud-provider-aws/cloud-provider-aws-presubmit.yaml
  • key ec2-e2e.yaml using file config/jobs/kubernetes/sig-cloud-provider/aws/ec2-e2e.yaml
  • key periodic-e2e.yaml using file config/jobs/kubernetes/sig-cloud-provider/periodic-e2e.yaml
  • key sig-node-presubmit.yaml using file config/jobs/kubernetes/sig-node/sig-node-presubmit.yaml
Details

In response to this:

Remove trailing slashes from --stage URLs in kubetest2 ec2 job configurations. When combined with the version path, these trailing slashes resulted in double slashes in download URLs (e.g., dl.k8s.io/ci/fast//v1.36.0-alpha...).

This previously worked because the dl.k8s.io CDN would redirect malformed URLs, but as of Feb 16, 2026, the CDN serves directly from the origin, causing 404 errors for URLs with double slashes.

Affected jobs:

  • cloud-provider-aws periodics and presubmits
  • sig-cloud-provider/aws ec2-e2e presubmits
  • sig-cloud-provider periodic-e2e
  • sig-node presubmits

Fixes CI failures observed since mid-February in pull-cloud-provider-aws-e2e-kubetest2-quick and related jobs.

Context on thread here: https://kubernetes.slack.com/archives/C09QZ4DQB/p1772041962062339

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

damdo added a commit to damdo/test-infra that referenced this pull request Feb 27, 2026
A follow up to kubernetes#36528
as the job got further but still broke afterwards.

Remove trailing slashes from --test-package-url URLs in kubetest2 ec2 job configurations.
When combined in these spots
- https://github.com/kubernetes-sigs/kubetest2/blob/beaf896881019d46bdf961228a117993c1d813db/pkg/testers/ginkgo/package.go#L42
- https://github.com/kubernetes-sigs/kubetest2/blob/beaf896881019d46bdf961228a117993c1d813db/pkg/testers/ginkgo/package.go#L183-L200

these trailing slashes resulted in double slashes in download URLs (e.g. `https://dl.k8s.io//ci/fast/latest-fast.txt`).

Causing the following error:
```
I0226 13:35:18.842783   26057 package.go:51] Test package version was not specified. Defaulting to version from latest-fast.txt: <?xml version='1.0' encoding='UTF-8'?><Error><Code>NoSuchKey</Code><Message>The specified key does not exist.</Message><Details>No such object: 767373bbdcb8270361b96548387bf2a9ad0d48758c35//ci/fast/latest-fast.txt</Details></Error>
I0226 13:35:18.842890   26057 package.go:201] Downloading test tar ball from: https://dl.k8s.io//ci/fast/NoSuchKeyThe specified key does not exist.
Details
No such object: 767373bbdcb8270361b96548387bf2a9ad0d48758c35//ci/fast/latest-fast.txt
/kubernetes-test-linux-amd64.tar.gz
F0226 13:35:18.854134   26057 ginkgo.go:259] failed to run ginkgo tester: failed to get ginkgo test package from published releases: failed to create gzip reader: EOF
```

This previously worked because the dl.k8s.io CDN would redirect
malformed URLs, but as of Feb 16, 2026, the CDN serves directly from
the origin, causing 404 errors for URLs with double slashes.

Affected jobs:
- cloud-provider-aws periodics and presubmits
- sig-node presubmits

Fixes CI failures observed since mid-February in pull-cloud-provider-aws-e2e-kubetest2-quick and related jobs.

Context on thread here: https://kubernetes.slack.com/archives/C09QZ4DQB/p1772041962062339
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by an approver from all required OWNERS files. area/config Issues or PRs related to code in /config area/jobs area/provider/aws Issues or PRs related to aws provider cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. lgtm "Looks good to me", indicates that a PR is ready to be merged. sig/cloud-provider Categorizes an issue or PR as relevant to SIG Cloud Provider. sig/node Categorizes an issue or PR as relevant to SIG Node. sig/testing Categorizes an issue or PR as relevant to SIG Testing. size/S Denotes a PR that changes 10-29 lines, ignoring generated files.

Projects

Development

Successfully merging this pull request may close these issues.

3 participants