Skip to content

Add conditional release-checking system test #2631

Merged
mtrmac merged 1 commit into
podman-container-tools:mainfrom
cevich:add_release_test
Jun 23, 2025
Merged

Add conditional release-checking system test #2631
mtrmac merged 1 commit into
podman-container-tools:mainfrom
cevich:add_release_test

Conversation

@cevich

@cevich cevich commented Jun 20, 2025

Copy link
Copy Markdown
Contributor

Unfortunately on a number of occasions, Skopeo has been released
officially with a -dev suffix in the version number. Assist in
catching this mistake at release time by the addition of a simple
conditional test. Note that it must be positively enabled by a
magic env. var. before executing the system tests.

@mtrmac mtrmac left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

Test implementation LGTM, although we clearly can’t have it enabled on the main branch the way it is now.

@cevich

cevich commented Jun 20, 2025

Copy link
Copy Markdown
Contributor Author

Thanks!

Test implementation LGTM, although we clearly can’t have it enabled on the main branch the way it is now.

Great thanks for taking a look. Yep, was just verifying that it works 😁

@cevich
cevich force-pushed the add_release_test branch from efadaf0 to 538ffca Compare June 20, 2025 15:43
@cevich

cevich commented Jun 20, 2025

Copy link
Copy Markdown
Contributor Author

Hey @lsm5 (not sure if you're still the one to ask) - Is there a way in packit or tmt or (buried in Fedora CI somewhere) to have RELEASE_TESTING set true for CI testing prior to release of official Fedora packages?

(If it's not obvious, we definitely don't want it set true by default, only for CI on official builds which must NEVER have a -dev version)

@jnovy Similar question, do you know how to get make this change in CentOS CI?

@cevich cevich changed the title [WIP] Add conditional release-checking system test Add conditional release-checking system test Jun 20, 2025
@cevich
cevich marked this pull request as ready for review June 20, 2025 15:50
@lsm5

lsm5 commented Jun 20, 2025

Copy link
Copy Markdown
Contributor

hey hey @cevich

Hey @lsm5 (not sure if you're still the one to ask) - Is there a way in packit or tmt or (buried in Fedora CI somewhere) to have RELEASE_TESTING set true for CI testing prior to release of official Fedora packages?

(If it's not obvious, we definitely don't want it set true by default, only for CI on official builds which must NEVER have a -dev version)

I think this should work with a conditional setting of RELEASE_TESTING var based on the initiator. enable everywhere that's not packit. Give me a bit for that. I guess it need not block this PR, unless we are very close to a new release.

@jnovy Similar question, do you know how to get make this change in CentOS CI?

We now have TMT tests running on CentOS as well, so one change should fix all. But we'll need downstream testing. Also, CentOS Stream doesn't get updates via packit atm, so the change will have to be manually propagated.

@lsm5

lsm5 commented Jun 20, 2025

Copy link
Copy Markdown
Contributor

fedora dist-git trial

@cevich

cevich commented Jun 20, 2025

Copy link
Copy Markdown
Contributor Author

I guess it need not block this PR, unless we are very close to a new release.

It shouldn't hurt to get it ready ahead of time. My intention is to backport this to all the RHEL release branches and make the envvar change there as well. Then rinse and repeat with Buildah and Podman.

@lsm5

lsm5 commented Jun 20, 2025

Copy link
Copy Markdown
Contributor

fedora dist-git trial

passed: https://artifacts.dev.testing-farm.io/228c9fb6-708e-4cf8-b183-c41990fbc885/

@cevich could you include this change in systemtest/tmt/main.fmf in this PR? That'll automatically propagate to Fedora with the next release.

@cevich
cevich force-pushed the add_release_test branch from 538ffca to 4c6c597 Compare June 20, 2025 18:06
@lsm5

lsm5 commented Jun 20, 2025

Copy link
Copy Markdown
Contributor

@cevich could you include this change in systemtest/tmt/main.fmf in this PR? That'll automatically propagate to Fedora with the next release.

@jnovy need this change in test/tmt/main.fmf in skopeo dist-git on centos stream

@lsm5 lsm5 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@lsm5

lsm5 commented Jun 20, 2025

Copy link
Copy Markdown
Contributor

ignore the osh-diff-scan #2632

@lsm5

lsm5 commented Jun 20, 2025

Copy link
Copy Markdown
Contributor

Test implementation LGTM, although we clearly can’t have it enabled on the main branch the way it is now.

@mtrmac do you see this still being a problem?

@mtrmac mtrmac left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

@mtrmac
mtrmac enabled auto-merge June 23, 2025 15:45
Unfortunately on a number of occasions, Skopeo has been released
officially with a `-dev` suffix in the version number.  Assist in
catching this mistake at release time by the addition of a simple
conditional test.  Note that it must be positively enabled by a
magic env. var. before executing the system tests.

Also (as suggested by @lsm5) update the TMT test to trigger the new
condition for future Fedora releases.

Signed-off-by: Chris Evich <cevich@redhat.com>
@mtrmac
mtrmac force-pushed the add_release_test branch from 4c6c597 to 3ddcdee Compare June 23, 2025 15:45
@mtrmac
mtrmac merged commit 54077f5 into podman-container-tools:main Jun 23, 2025
22 checks passed
cevich added a commit to cevich/skopeo that referenced this pull request Jul 2, 2025
Unfortunately on a number of occasions, Skopeo has been released
officially with a `-dev` suffix in the version number.  Assist in
catching this mistake at release time by the addition of a simple
conditional test.  Note that it must be positively enabled by a
magic env. var. before executing the system tests.

Original PR: podman-container-tools#2631

Signed-off-by: Chris Evich <cevich@redhat.com>
cevich added a commit to cevich/skopeo that referenced this pull request Jul 2, 2025
Unfortunately on a number of occasions, Skopeo has been released
officially with a `-dev` suffix in the version number.  Assist in
catching this mistake at release time by the addition of a simple
conditional test.  Note that it must be positively enabled by a
magic env. var. before executing the system tests.

Original PR: podman-container-tools#2631

Signed-off-by: Chris Evich <cevich@redhat.com>
cevich added a commit to cevich/skopeo that referenced this pull request Jul 2, 2025
Unfortunately on a number of occasions, Skopeo has been released
officially with a `-dev` suffix in the version number.  Assist in
catching this mistake at release time by the addition of a simple
conditional test.  Note that it must be positively enabled by a
magic env. var. before executing the system tests.

Original PR: podman-container-tools#2631

Signed-off-by: Chris Evich <cevich@redhat.com>
@stale-locking-app stale-locking-app Bot locked as resolved and limited conversation to collaborators Sep 22, 2025
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants