[Infra UI] Stabilize Infra Custom Dashboards stateful API tests - #265679
[Infra UI] Stabilize Infra Custom Dashboards stateful API tests#265679awahab07 merged 2 commits into
Flaky Test Runner nudge: comment posted
This PR introduces new timing-based retry logic (waitForEnabledCustomDashboardsSetting with retry.tryForTime, a 12 s propagation delay, and a 20 s timeout) and restructures shared before/after hooks in x-pack/solutions/observability/test/api_integration_deployment_agnostic/apis/infra/infra_custom_dashboards.ts. These changes introduce non-determinism that a single CI pass may not reliably catch.
A comment was posted on the PR recommending a 30-run flaky test runner execution for both resolved FTR configs:
x-pack/solutions/observability/test/api_integration_deployment_agnostic/configs/stateful/oblt.stateful.config.tsx-pack/solutions/observability/test/api_integration_deployment_agnostic/configs/serverless/oblt.serverless.config.ts
Details
Note
Your check run agent prompt is: .macroscope/flaky-test-runner-nudge.md
More information about how Check Run Agents work can be found in our Help Center.
Analysis
Changed file: x-pack/solutions/observability/test/api_integration_deployment_agnostic/apis/infra/infra_custom_dashboards.ts
Non-determinism signals detected:
- New
retry.tryForTimeusage withCUSTOM_DASHBOARDS_SETTING_PROPAGATION_TIMEOUT_MS(20 s) - Artificial minimum wait via
CUSTOM_DASHBOARDS_SETTING_PROPAGATION_DELAY_MS(12 s) — throws to keep retrying until 12 s have elapsed - Shared
before/afterhooks replacing per-testuiSettings.updatecalls, introducing shared mutable state across tests
Config resolution chain:
infra_custom_dashboards.ts←loadTestFileinapis/infra/index.ts←loadTestFileinconfigs/*/oblt.index.ts←testFilesin both leaf configs
Duplicate check: No prior flaky-nudge comments found on the PR.