RHOSDT-3.10: configure Tempo stage CI jobs for RHOSDT 3.10 release testing - #80345
Conversation
|
Note Reviews pausedIt looks like this branch is under active development. To avoid overwhelming you with review comments due to an influx of new commits, CodeRabbit has automatically paused this review. You can configure this behavior by changing the Use the following commands to manage reviews:
Use the checkboxes below for quick actions:
WalkthroughUpdates Grafana Tempo operator CI stage jobs (OCP 4.12–4.21) to add QE-agent and multistage tempo env vars, insert post-run observability/deprovision/gather chains, set some env defaults, and extend the QE-agent step timeout to 1h30m. ChangesTempo Stage CI Configuration and QE Agent Orchestration
Sequence Diagram(s)sequenceDiagram
participant Tempo as tempo-stage-tests
participant QE as openshift-observability-qe-agent
participant Chain as Deprovision/GatherChain
Tempo->>QE: invoke QE agent ref via steps.post
QE->>Chain: chain platform-specific deprovision/gather run
Estimated code review effort🎯 3 (Moderate) | ⏱️ ~20 minutes Possibly related PRs
Suggested labels
Suggested reviewers
Important Pre-merge checks failedPlease resolve all errors before merging. Addressing warnings is optional. ❌ Failed checks (1 error)
✅ Passed checks (14 passed)
✨ Finishing Touches🧪 Generate unit tests (beta)
Comment |
openshift-ci
Bot
added
the
approved
|
/pj-rehearse periodic-ci-openshift-grafana-tempo-operator-main-tempo-product-ocp-4.21-stage-tempo-stage-tests periodic-ci-openshift-grafana-tempo-operator-main-tempo-product-ocp-4.20-stage-tempo-stage-tests periodic-ci-openshift-grafana-tempo-operator-main-tempo-product-ocp-4.19-stage-tempo-stage-tests |
|
@IshwarKanse: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel. |
|
/pj-rehearse periodic-ci-openshift-grafana-tempo-operator-main-tempo-product-ocp-4.21-stage-tempo-stage-tests periodic-ci-openshift-grafana-tempo-operator-main-tempo-product-ocp-4.20-stage-tempo-stage-tests periodic-ci-openshift-grafana-tempo-operator-main-tempo-product-ocp-4.19-stage-tempo-stage-tests |
|
@IshwarKanse: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel. |
|
/pj-rehearse periodic-ci-openshift-grafana-tempo-operator-main-tempo-product-ocp-4.21-stage-tempo-stage-tests periodic-ci-openshift-grafana-tempo-operator-main-tempo-product-ocp-4.20-stage-tempo-stage-tests periodic-ci-openshift-grafana-tempo-operator-main-tempo-product-ocp-4.17-fips-stage-tempo-stage-tests |
|
@IshwarKanse: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel. |
|
/pj-rehearse periodic-ci-openshift-grafana-tempo-operator-main-tempo-product-ocp-4.17-fips-stage-tempo-stage-tests periodic-ci-openshift-grafana-tempo-operator-main-tempo-product-ocp-4.21-stage-tempo-stage-tests |
|
@IshwarKanse: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel. |
d158aed to
79bb98f
Compare
|
/pj-rehearse periodic-ci-openshift-grafana-tempo-operator-main-tempo-product-ocp-4.12-stage-tempo-stage-tests periodic-ci-openshift-grafana-tempo-operator-main-tempo-product-ocp-4.17-fips-stage-tempo-stage-tests |
|
@IshwarKanse: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel. |
79bb98f to
10ac7e9
Compare
|
/pj-rehearse periodic-ci-openshift-grafana-tempo-operator-main-tempo-product-ocp-4.14-arm-stage-tempo-stage-tests periodic-ci-openshift-grafana-tempo-operator-main-tempo-product-ocp-4.12-stage-tempo-stage-tests |
|
@IshwarKanse: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel. |
|
/pj-rehearse periodic-ci-openshift-grafana-tempo-operator-main-tempo-product-ocp-4.14-arm-stage-tempo-stage-tests periodic-ci-openshift-grafana-tempo-operator-main-tempo-product-ocp-4.12-stage-tempo-stage-tests |
|
@IshwarKanse: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel. |
|
/pj-rehearse periodic-ci-openshift-distributed-tracing-qe-main-ocp-4.16-disconnected-distributed-tracing-tests-disconnected |
|
@IshwarKanse: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel. |
|
/pj-rehearse periodic-ci-openshift-distributed-tracing-qe-main-ocp-4.16-disconnected-distributed-tracing-tests-disconnected |
|
@IshwarKanse: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel. |
|
/pj-rehearse periodic-ci-openshift-distributed-tracing-qe-main-ocp-4.16-disconnected-distributed-tracing-tests-disconnected |
|
@IshwarKanse: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel. |
|
/pj-rehearse periodic-ci-openshift-distributed-tracing-qe-main-ocp-4.16-disconnected-distributed-tracing-tests-disconnected |
|
@IshwarKanse: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel. |
e7d4317 to
6683c93
Compare
|
/pj-rehearse periodic-ci-openshift-distributed-tracing-qe-main-ocp-4.16-disconnected-distributed-tracing-tests-disconnected |
openshift-merge-bot
Bot
removed
the
rehearsals-ack
|
[REHEARSALNOTIFIER]
A total of 1149 jobs have been affected by this change. The above listing is non-exhaustive and limited to 25 jobs. A full list of affected jobs can be found here Interacting with pj-rehearseComment: Once you are satisfied with the results of the rehearsals, comment: |
|
/pj-rehearse ack |
|
@IshwarKanse: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel. |
openshift-merge-bot
Bot
added
the
rehearsals-ack
|
/approve |
|
/lgtm |
| echo "Remote Command: ${cmd}" | ||
| # shellcheck disable=SC2090 | ||
| ssh ${ssh_options} ${BASTION_SSH_USER}@${BASTION_IP} "${cmd}" | ||
| max_attempts=3 |
There was a problem hiding this comment.
Hi @aguidirh @r4f4 can you help to approve this PR. I aded retry logic to this step so that the step don't fail on transient issues. This is our disconnected test job run with the fix. https://qe-private-deck-ci.apps.ci.l2s4.p1.openshiftapps.com/view/gs/qe-private-deck/pr-logs/pull/openshift_release/80345/rehearse-80345-periodic-ci-openshift-distributed-tracing-qe-main-ocp-4.16-disconnected-distributed-tracing-tests-disconnected/2065460478926131200
|
/approve |
|
[APPROVALNOTIFIER] This PR is APPROVED This pull-request has been approved by: bear-redhat, DavidRajnoha, IshwarKanse, r4f4 The full list of commands accepted by this bot can be found here. The pull request process is described here DetailsNeeds approval from an approver in each of these files:
Approvers can indicate their approval by writing |
openshift-ci
Bot
added
the
approved
|
@IshwarKanse: Updated the
DetailsIn response to this:
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. |
…sting (openshift#80345) * RHOSDT-3.10: configure Tempo stage CI jobs for RHOSDT 3.10 release testing * Bump the lease for azure-observability cluster profile
…sting (openshift#80345) * RHOSDT-3.10: configure Tempo stage CI jobs for RHOSDT 3.10 release testing * Bump the lease for azure-observability cluster profile
…sting (openshift#80345) * RHOSDT-3.10: configure Tempo stage CI jobs for RHOSDT 3.10 release testing * Bump the lease for azure-observability cluster profile
…sting (openshift#80345) * RHOSDT-3.10: configure Tempo stage CI jobs for RHOSDT 3.10 release testing * Bump the lease for azure-observability cluster profile
…sting (openshift#80345) * RHOSDT-3.10: configure Tempo stage CI jobs for RHOSDT 3.10 release testing * Bump the lease for azure-observability cluster profile
…sting (openshift#80345) * RHOSDT-3.10: configure Tempo stage CI jobs for RHOSDT 3.10 release testing * Bump the lease for azure-observability cluster profile
…sting (openshift#80345) * RHOSDT-3.10: configure Tempo stage CI jobs for RHOSDT 3.10 release testing * Bump the lease for azure-observability cluster profile
![openshift-prow[bot]](https://github.githubassets.com/images/gravatars/gravatar-user-420.png){kind=avatar}
…sting (openshift#80345) * RHOSDT-3.10: configure Tempo stage CI jobs for RHOSDT 3.10 release testing * Bump the lease for azure-observability cluster profile
…sting (openshift#80345) * RHOSDT-3.10: configure Tempo stage CI jobs for RHOSDT 3.10 release testing * Bump the lease for azure-observability cluster profile
The step derives the QE optional-operators index tag from the cluster's Kubernetes version, giving aosqe-index:v1.29 for OCP 4.16. That image is not present in the mirror registry, so the step fails: reading manifest v1.29 in <mirror>/openshift-qe-optional-operators/ aosqe-index: manifest unknown This has broken every periodic run of this job; the last green run was the rehearsal of openshift#80345 in June. The step accepts an OO_INDEX parameter that bypasses the tag derivation. In this job the QE index only provides amq-streams — Tempo and OTEL come from their own catalog sources built from the index images above — so the released operator index serves the same purpose and is available. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01MWrVkBmYnGwnuSfaK6d1cK
4 participants
Summary
openshift-observability-qe-agent(1h30m timeout) to all 9 Tempo stage jobs for autonomous test failure triagebrew.registry.redhat.io/rh-osbs/iib:*) for catalog-based jobs (4.12, 4.14, 4.17-fips, 4.19, 4.20, 4.21) and the bundle image for multiarch jobs (4.14-ARM, 4.16-IBM Z, 4.17-IBM P)rhosdt-3.10on all 9 jobs to run stage tests from the correct branchMULTISTAGE_PARAM_OVERRIDE_TEMPO_INDEX_IMAGEin the inlineinstall-tempo-operatorstep for multiarch jobs soci-operator-checkconfigvalidation passesIIB / bundle image mapping (from RHOSDT 3.10 Konflux release payload)
brew.registry.redhat.io/rh-osbs/iib:1157117brew.registry.redhat.io/rh-osbs/iib:1157123quay.io/.../tempo-bundle@sha256:90cfc733...quay.io/.../tempo-bundle@sha256:90cfc733...brew.registry.redhat.io/rh-osbs/iib:1157124quay.io/.../tempo-bundle@sha256:90cfc733...brew.registry.redhat.io/rh-osbs/iib:1157126brew.registry.redhat.io/rh-osbs/iib:1157128brew.registry.redhat.io/rh-osbs/iib:1157127Test plan
make updatepasses with no validation errors (done locally)🤖 Generated with Claude Code
Summary by CodeRabbit
This PR updates OpenShift CI configuration for the Grafana Tempo stage jobs to prepare RHOSDT 3.10 release testing across nine stage variants (OCP 4.12–4.21, including multiarch variants). Changes are configuration-only and affect ci-operator job configs and one step-registry entry.
What this changes in practical terms
Affected files / areas
Notes / test plan