[ResponseOps] Cases analytics integration tests by adcoelho · Pull Request #225231 · elastic/kibana

adcoelho · 2025-06-25T08:49:33Z

Summary

Integration tests for the cases analytics indexes.

Backfill tests minus activity index remove sync test

elasticmachine · 2025-06-25T08:49:37Z

Pinging @elastic/response-ops (Team:ResponseOps)

…-fix'

js-jankisalvi

Great coverage! 🎉

x-pack/test/cases_api_integration/spaces_only/tests/common/cases/analytics_index/backfill.ts

x-pack/platform/test/cases_api_integration/common/plugins/cases/server/plugin.ts

…-fix'

…to cai-integration-tests

kibanamachine · 2025-06-30T18:35:32Z

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#8495

[❌] x-pack/platform/test/cases_api_integration/security_and_spaces/config_trial_common.ts: 0/200 tests passed.

see run history

…no-cache --fix'

davismcphee · 2025-07-08T18:46:27Z

@adcoelho I meant to open a PR against your branch with fixes for the search tests, but accidentally pushed directly to this branch, sorry. In any case, we believe the issue was due to timeouts because of how those integration tests were running searches (no index pattern with per-shard shard_delay aggs to simulate slow requests). The changes I pushed should hopefully get this PR to pass CI 🤞

kibanamachine · 2025-07-09T11:12:44Z

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#8565

[❌] x-pack/platform/test/cases_api_integration/security_and_spaces/config_trial_common.ts: 170/200 tests passed.

see run history

kibanamachine · 2025-07-09T16:05:30Z

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#8568

[❌] x-pack/platform/test/cases_api_integration/security_and_spaces/config_trial_common.ts: 169/200 tests passed.

see run history

kibanamachine · 2025-07-09T16:19:35Z

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#8567

[❌] x-pack/platform/test/cases_api_integration/security_and_spaces/config_trial_common.ts: 0/200 tests passed.

see run history

kibanamachine · 2025-07-09T23:45:42Z

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#8573

[❌] x-pack/platform/test/cases_api_integration/security_and_spaces/config_trial_common.ts: 166/200 tests passed.

see run history

kibanamachine · 2025-07-10T10:30:41Z

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#8578

[❌] x-pack/platform/test/cases_api_integration/security_and_spaces/config_trial_common.ts: 174/200 tests passed.

see run history

kibanamachine · 2025-07-10T13:33:12Z

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#8585

[❌] x-pack/platform/test/cases_api_integration/security_and_spaces/config_trial_common.ts: 173/200 tests passed.

see run history

elasticmachine · 2025-07-10T14:59:32Z

💚 Build Succeeded

Buildkite Build
Commit: 5d38fc6

Metrics [docs]

✅ unchanged

History

💚 Build #317538 succeeded d0b619e
💛 Build #317263 was flaky 3af660d
💔 Build #317103 failed 5987b11
💔 Build #316980 failed eb48c58
💔 Build #316701 failed f5bd029
💔 Build #316134 failed b637012

cc @adcoelho

kibanamachine · 2025-07-10T15:19:17Z

Flaky Test Runner Stats

🎉 All tests passed! - kibana-flaky-test-suite-runner#8590

[✅] x-pack/platform/test/cases_api_integration/security_and_spaces/config_trial_common.ts: 100/100 tests passed.

see run history

kibanamachine · 2025-07-11T07:11:06Z

Starting backport for target branches: 8.19, 9.1

https://github.com/elastic/kibana/actions/runs/16214095665

kibanamachine · 2025-07-11T07:17:32Z

💔 All backports failed

Status	Branch	Result
❌	8.19	Backport failed because of merge conflicts
❌	9.1	Backport failed because of merge conflicts

Manual backport

To create the backport manually run:

node scripts/backport --pr 225231

Questions ?

Please refer to the Backport tool documentation

adcoelho · 2025-07-11T07:59:15Z

💚 All backports created successfully

Status	Branch	Result
✅	9.1
✅	8.19

Note: Successful backport PRs will be merged automatically after passing CI.

Questions ?

Please refer to the Backport tool documentation

kibanamachine · 2025-07-14T10:49:02Z

Looks like this PR has backport PRs but they still haven't been merged. Please merge them ASAP to keep the branches relatively in sync.
cc: @adcoelho

kibanamachine · 2025-07-15T10:49:11Z

Looks like this PR has backport PRs but they still haven't been merged. Please merge them ASAP to keep the branches relatively in sync.
cc: @adcoelho

kibanamachine · 2025-07-16T10:50:06Z

Looks like this PR has backport PRs but they still haven't been merged. Please merge them ASAP to keep the branches relatively in sync.
cc: @adcoelho

kibanamachine · 2025-07-17T11:49:08Z

Looks like this PR has backport PRs but they still haven't been merged. Please merge them ASAP to keep the branches relatively in sync.
cc: @adcoelho

adcoelho added 2 commits June 24, 2025 12:51

CAI creation tests

4226d11

Backfill tests minus activity index remove sync test

Updated snapshots

cb0c246

adcoelho self-assigned this Jun 25, 2025

adcoelho requested review from a team as code owners June 25, 2025 08:49

adcoelho added release_note:skip Skip the PR/issue when compiling release notes Team:ResponseOps Platform ResponseOps team (formerly the Cases and Alerting teams) t// labels Jun 25, 2025

adcoelho added backport:version Backport to applied version labels v9.1.0 v8.19.0 labels Jun 25, 2025

adcoelho and others added 3 commits June 25, 2025 12:05

add activity index backfill tests

86d0a2c

[CI] Auto-commit changed files from 'node scripts/eslint --no-cache -…

7b1f51c

…-fix'

Synchronization integration tests.

000f993

adcoelho changed the title ~~[ResponseOps][WIP] Cases analytics integration tests~~ [ResponseOps] Cases analytics integration tests Jun 25, 2025

js-jankisalvi approved these changes Jun 27, 2025

View reviewed changes

x-pack/test/cases_api_integration/spaces_only/tests/common/cases/analytics_index/backfill.ts Show resolved Hide resolved

cnasikas added the v9.2.0 label Jun 27, 2025

Merge remote-tracking branch 'upstream/main' into cai-integration-tests

a30bd01

cnasikas reviewed Jun 27, 2025

View reviewed changes

x-pack/platform/test/cases_api_integration/common/plugins/cases/server/plugin.ts Outdated Show resolved Hide resolved

adcoelho and others added 6 commits June 30, 2025 10:40

test changes

3c1cf93

[CI] Auto-commit changed files from 'node scripts/eslint --no-cache -…

1948293

…-fix'

Fix bug with config

95187f8

Merge branch 'main' into cai-integration-tests

1a1be3e

Merge branch 'cai-integration-tests' of github.com:adcoelho/kibana in…

6cfde6f

…to cai-integration-tests

fixed types

f81f440

cnasikas approved these changes Jun 30, 2025

View reviewed changes

adcoelho added 3 commits July 1, 2025 10:53

update snapshots

08143b5

Merge remote-tracking branch 'upstream/main' into cai-integration-tests

e6aa3a5

updated snapshots

ba8dd66

elasticmachine and others added 3 commits July 8, 2025 06:55

Merge branch 'main' into cai-integration-tests

64ec6cc

[CI] Auto-commit changed files from 'node scripts/eslint_all_files --…

f5bd029

…no-cache --fix'

[Search] Fix search tests timeout failures

eb48c58

cnasikas and others added 4 commits July 9, 2025 09:56

Merge branch 'main' into cai-integration-tests

6b73576

Fix snapshots

e4d77a5

Remove snapshots

5987b11

Merge branch 'main' into cai-integration-tests

6b7dd82

Increase timeout in specific tests.

3af660d

davismcphee approved these changes Jul 9, 2025

View reviewed changes

skip flaky tests

5d38fc6

This was referenced Jul 11, 2025

[9.1] [ResponseOps] Cases analytics integration tests (#225231) #227573

Merged

[8.19] [ResponseOps] Cases analytics integration tests (#225231) #227575

Merged

kibanamachine mentioned this pull request Jul 15, 2025

[ResponseOps][Cases] Skip the execution of the CAI tasks when the feature is disabled #227860

Merged

kibanamachine mentioned this pull request Jul 16, 2025

[Cases] Reverts the introduction of the incremental_id service #228002

Merged

Conversation

adcoelho commented Jun 25, 2025 • edited by kibanamachine Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Uh oh!

elasticmachine commented Jun 25, 2025

Uh oh!

js-jankisalvi left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

kibanamachine commented Jun 30, 2025

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#8495

Uh oh!

davismcphee commented Jul 8, 2025

Uh oh!

kibanamachine commented Jul 9, 2025

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#8565

Uh oh!

kibanamachine commented Jul 9, 2025

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#8568

Uh oh!

kibanamachine commented Jul 9, 2025

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#8567

Uh oh!

kibanamachine commented Jul 9, 2025

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#8573

Uh oh!

kibanamachine commented Jul 10, 2025

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#8578

Uh oh!

kibanamachine commented Jul 10, 2025

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#8585

Uh oh!

elasticmachine commented Jul 10, 2025

💚 Build Succeeded

Metrics [docs]

History

Uh oh!

kibanamachine commented Jul 10, 2025

Flaky Test Runner Stats

🎉 All tests passed! - kibana-flaky-test-suite-runner#8590

Uh oh!

kibanamachine commented Jul 11, 2025

Uh oh!

kibanamachine commented Jul 11, 2025

💔 All backports failed

Manual backport

Questions ?

Uh oh!

adcoelho commented Jul 11, 2025

💚 All backports created successfully

Questions ?

Uh oh!

kibanamachine commented Jul 14, 2025

Uh oh!

kibanamachine commented Jul 15, 2025

Uh oh!

kibanamachine commented Jul 16, 2025

Uh oh!

kibanamachine commented Jul 17, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

adcoelho commented Jun 25, 2025 •

edited by kibanamachine

Loading