Skip to content

[CI] Reduce FTR and Jest bench runtime#252198

Merged
Ikuni17 merged 23 commits intoelastic:mainfrom
Ikuni17:ci/reduce-ftr-bench-time
Feb 12, 2026
Merged

[CI] Reduce FTR and Jest bench runtime#252198
Ikuni17 merged 23 commits intoelastic:mainfrom
Ikuni17:ci/reduce-ftr-bench-time

Conversation

@Ikuni17
Copy link
Copy Markdown
Contributor

@Ikuni17 Ikuni17 commented Feb 7, 2026

Summary

The FTR Bench step can block the build from finishing, so we want to get the run time down and start sooner. It currently takes ~90 minutes to finish. After these changes, it is ~45 minutes.

  • Reverts [CI] Disable file based changes for benchmarks #252437
  • Upgrade machine to c2d -> c4d and use hyperdisk. This reduces runtime by ~6 minutes.
  • Removes fleet config from being benchmarked. This reduces runtime by ~17 minutes.
  • Removes one iteration of testing in FTR Bench. This reduces runtime by ~25 minutes.
  • Due to [CI] Move faster beta build to default #252200, the benchmarking steps now start with the pre checks. This will start them ~25 minutes sooner.
    • FTR Bench builds it's own distributables, and thus has no other step dependencies. If these builds fail, the bench doesn't run.
    • Jest Bench has no dependencies.
  • Upgrade Jest Bench machine from n2-highmem-16 to c4d-standard-16 and adds hyperdisk.
    • Reduces runtime from 51 min to 26 min.

@Ikuni17 Ikuni17 self-assigned this Feb 7, 2026
@Ikuni17 Ikuni17 added release_note:skip Skip the PR/issue when compiling release notes backport:version Backport to applied version labels v9.3.1 v9.2.6 labels Feb 7, 2026
@Ikuni17 Ikuni17 added the ci:bench-jest Add Jest benchmark step in CI. Compares merge base and PR commits. label Feb 7, 2026
Ikuni17 added a commit that referenced this pull request Feb 10, 2026
## Summary

Temporarily remove file based changes that add FTR and Jest benchmark
steps to avoid blocking builds. They can still be triggered with labels.
Proper solution will be added in #252198.
kibanamachine pushed a commit to kibanamachine/kibana that referenced this pull request Feb 10, 2026
## Summary

Temporarily remove file based changes that add FTR and Jest benchmark
steps to avoid blocking builds. They can still be triggered with labels.
Proper solution will be added in elastic#252198.

(cherry picked from commit e90547a)
kibanamachine pushed a commit to kibanamachine/kibana that referenced this pull request Feb 10, 2026
## Summary

Temporarily remove file based changes that add FTR and Jest benchmark
steps to avoid blocking builds. They can still be triggered with labels.
Proper solution will be added in elastic#252198.

(cherry picked from commit e90547a)
Ikuni17 added a commit that referenced this pull request Feb 10, 2026
# Backport

This will backport the following commits from `main` to `9.3`:
- [[CI] Disable file based changes for benchmarks
(#252437)](#252437)

<!--- Backport version: 9.6.6 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)

<!--BACKPORT [{"author":{"name":"Brad
White","email":"Ikuni17@users.noreply.github.com"},"sourceCommit":{"committedDate":"2026-02-10T03:57:46Z","message":"[CI]
Disable file based changes for benchmarks (#252437)\n\n##
Summary\n\nTemporarily remove file based changes that add FTR and Jest
benchmark\nsteps to avoid blocking builds. They can still be triggered
with labels.\nProper solution will be added in
#252198.","sha":"e90547ab11e3138d28a4575f52697608aca1a05d","branchLabelMapping":{"^v9.4.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","skip-ci","backport:version","v9.4.0","v9.3.1","v9.2.6"],"title":"[CI]
Disable file based changes for
benchmarks","number":252437,"url":"https://github.com/elastic/kibana/pull/252437","mergeCommit":{"message":"[CI]
Disable file based changes for benchmarks (#252437)\n\n##
Summary\n\nTemporarily remove file based changes that add FTR and Jest
benchmark\nsteps to avoid blocking builds. They can still be triggered
with labels.\nProper solution will be added in
#252198.","sha":"e90547ab11e3138d28a4575f52697608aca1a05d"}},"sourceBranch":"main","suggestedTargetBranches":["9.3","9.2"],"targetPullRequestStates":[{"branch":"main","label":"v9.4.0","branchLabelMappingKey":"^v9.4.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/252437","number":252437,"mergeCommit":{"message":"[CI]
Disable file based changes for benchmarks (#252437)\n\n##
Summary\n\nTemporarily remove file based changes that add FTR and Jest
benchmark\nsteps to avoid blocking builds. They can still be triggered
with labels.\nProper solution will be added in
#252198.","sha":"e90547ab11e3138d28a4575f52697608aca1a05d"}},{"branch":"9.3","label":"v9.3.1","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"9.2","label":"v9.2.6","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}]
BACKPORT-->

Co-authored-by: Brad White <Ikuni17@users.noreply.github.com>
Ikuni17 added a commit that referenced this pull request Feb 10, 2026
# Backport

This will backport the following commits from `main` to `9.2`:
- [[CI] Disable file based changes for benchmarks
(#252437)](#252437)

<!--- Backport version: 9.6.6 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)

<!--BACKPORT [{"author":{"name":"Brad
White","email":"Ikuni17@users.noreply.github.com"},"sourceCommit":{"committedDate":"2026-02-10T03:57:46Z","message":"[CI]
Disable file based changes for benchmarks (#252437)\n\n##
Summary\n\nTemporarily remove file based changes that add FTR and Jest
benchmark\nsteps to avoid blocking builds. They can still be triggered
with labels.\nProper solution will be added in
#252198.","sha":"e90547ab11e3138d28a4575f52697608aca1a05d","branchLabelMapping":{"^v9.4.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","skip-ci","backport:version","v9.4.0","v9.3.1","v9.2.6"],"title":"[CI]
Disable file based changes for
benchmarks","number":252437,"url":"https://github.com/elastic/kibana/pull/252437","mergeCommit":{"message":"[CI]
Disable file based changes for benchmarks (#252437)\n\n##
Summary\n\nTemporarily remove file based changes that add FTR and Jest
benchmark\nsteps to avoid blocking builds. They can still be triggered
with labels.\nProper solution will be added in
#252198.","sha":"e90547ab11e3138d28a4575f52697608aca1a05d"}},"sourceBranch":"main","suggestedTargetBranches":["9.3","9.2"],"targetPullRequestStates":[{"branch":"main","label":"v9.4.0","branchLabelMappingKey":"^v9.4.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/252437","number":252437,"mergeCommit":{"message":"[CI]
Disable file based changes for benchmarks (#252437)\n\n##
Summary\n\nTemporarily remove file based changes that add FTR and Jest
benchmark\nsteps to avoid blocking builds. They can still be triggered
with labels.\nProper solution will be added in
#252198.","sha":"e90547ab11e3138d28a4575f52697608aca1a05d"}},{"branch":"9.3","label":"v9.3.1","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"9.2","label":"v9.2.6","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}]
BACKPORT-->

Co-authored-by: Brad White <Ikuni17@users.noreply.github.com>
@elasticmachine
Copy link
Copy Markdown
Contributor

💛 Build succeeded, but was flaky

Failed CI Steps

Test Failures

  • [job] [logs] FTR Configs #28 / serverless observability UI - telemetry discover/observabilitySolution/context_awareness/telemetry telemetry context should set EBT context for telemetry events when logs data source profile and reset

Metrics [docs]

✅ unchanged

History

cc @Ikuni17

@Ikuni17 Ikuni17 marked this pull request as ready for review February 12, 2026 04:23
@Ikuni17 Ikuni17 requested a review from a team as a code owner February 12, 2026 04:23
@Ikuni17 Ikuni17 requested a review from tylersmalley February 12, 2026 04:23
@Ikuni17 Ikuni17 changed the title [CI] Reduce FTR bench time [CI] Reduce FTR and Jest bench runtime Feb 12, 2026
@Ikuni17 Ikuni17 merged commit 2e33182 into elastic:main Feb 12, 2026
19 checks passed
@Ikuni17 Ikuni17 deleted the ci/reduce-ftr-bench-time branch February 12, 2026 05:55
@kibanamachine
Copy link
Copy Markdown
Contributor

Starting backport for target branches: 9.2, 9.3

https://github.com/elastic/kibana/actions/runs/21935339183

kibanamachine pushed a commit to kibanamachine/kibana that referenced this pull request Feb 12, 2026
## Summary

The `FTR Bench` step can block the build from finishing, so we want to
get the run time down and start sooner. It currently takes ~90 minutes
to finish. After these changes, it is ~45 minutes.

- Reverts elastic#252437
- Upgrade machine to `c2d -> c4d` and use hyperdisk. This reduces
runtime by ~6 minutes.
- Removes `fleet` config from being benchmarked. This reduces runtime by
~17 minutes.
- Removes one iteration of testing in FTR Bench. This reduces runtime by
~25 minutes.
- Due to elastic#252200, the benchmarking steps now start with the pre checks.
This will start them ~25 minutes sooner.
- `FTR Bench` builds it's own distributables, and thus has no other step
dependencies. If these builds fail, the bench doesn't run.
  - `Jest Bench` has no dependencies.
- Upgrade `Jest Bench` machine from `n2-highmem-16` to `c4d-standard-16`
and adds hyperdisk.
  - Reduces runtime from 51 min to 26 min.

(cherry picked from commit 2e33182)
kibanamachine pushed a commit to kibanamachine/kibana that referenced this pull request Feb 12, 2026
## Summary

The `FTR Bench` step can block the build from finishing, so we want to
get the run time down and start sooner. It currently takes ~90 minutes
to finish. After these changes, it is ~45 minutes.

- Reverts elastic#252437
- Upgrade machine to `c2d -> c4d` and use hyperdisk. This reduces
runtime by ~6 minutes.
- Removes `fleet` config from being benchmarked. This reduces runtime by
~17 minutes.
- Removes one iteration of testing in FTR Bench. This reduces runtime by
~25 minutes.
- Due to elastic#252200, the benchmarking steps now start with the pre checks.
This will start them ~25 minutes sooner.
- `FTR Bench` builds it's own distributables, and thus has no other step
dependencies. If these builds fail, the bench doesn't run.
  - `Jest Bench` has no dependencies.
- Upgrade `Jest Bench` machine from `n2-highmem-16` to `c4d-standard-16`
and adds hyperdisk.
  - Reduces runtime from 51 min to 26 min.

(cherry picked from commit 2e33182)
@kibanamachine
Copy link
Copy Markdown
Contributor

💚 All backports created successfully

Status Branch Result
9.2
9.3

Note: Successful backport PRs will be merged automatically after passing CI.

Questions ?

Please refer to the Backport tool documentation

kibanamachine added a commit that referenced this pull request Feb 12, 2026
# Backport

This will backport the following commits from `main` to `9.3`:
- [[CI] Reduce FTR and Jest bench runtime
(#252198)](#252198)

<!--- Backport version: 9.6.6 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)

<!--BACKPORT [{"author":{"name":"Brad
White","email":"Ikuni17@users.noreply.github.com"},"sourceCommit":{"committedDate":"2026-02-12T05:55:01Z","message":"[CI]
Reduce FTR and Jest bench runtime (#252198)\n\n## Summary\n\nThe `FTR
Bench` step can block the build from finishing, so we want to\nget the
run time down and start sooner. It currently takes ~90 minutes\nto
finish. After these changes, it is ~45 minutes.\n\n- Reverts #252437\n-
Upgrade machine to `c2d -> c4d` and use hyperdisk. This reduces\nruntime
by ~6 minutes.\n- Removes `fleet` config from being benchmarked. This
reduces runtime by\n~17 minutes.\n- Removes one iteration of testing in
FTR Bench. This reduces runtime by\n~25 minutes.\n- Due to #252200, the
benchmarking steps now start with the pre checks.\nThis will start them
~25 minutes sooner.\n- `FTR Bench` builds it's own distributables, and
thus has no other step\ndependencies. If these builds fail, the bench
doesn't run.\n - `Jest Bench` has no dependencies.\n- Upgrade `Jest
Bench` machine from `n2-highmem-16` to `c4d-standard-16`\nand adds
hyperdisk.\n - Reduces runtime from 51 min to 26
min.","sha":"2e33182d5ddaf7073df2d493d78cfe6b1bf606b8","branchLabelMapping":{"^v9.4.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","backport:version","ci:bench-jest","v9.4.0","v9.3.1","v9.2.6"],"title":"[CI]
Reduce FTR and Jest bench
runtime","number":252198,"url":"https://github.com/elastic/kibana/pull/252198","mergeCommit":{"message":"[CI]
Reduce FTR and Jest bench runtime (#252198)\n\n## Summary\n\nThe `FTR
Bench` step can block the build from finishing, so we want to\nget the
run time down and start sooner. It currently takes ~90 minutes\nto
finish. After these changes, it is ~45 minutes.\n\n- Reverts #252437\n-
Upgrade machine to `c2d -> c4d` and use hyperdisk. This reduces\nruntime
by ~6 minutes.\n- Removes `fleet` config from being benchmarked. This
reduces runtime by\n~17 minutes.\n- Removes one iteration of testing in
FTR Bench. This reduces runtime by\n~25 minutes.\n- Due to #252200, the
benchmarking steps now start with the pre checks.\nThis will start them
~25 minutes sooner.\n- `FTR Bench` builds it's own distributables, and
thus has no other step\ndependencies. If these builds fail, the bench
doesn't run.\n - `Jest Bench` has no dependencies.\n- Upgrade `Jest
Bench` machine from `n2-highmem-16` to `c4d-standard-16`\nand adds
hyperdisk.\n - Reduces runtime from 51 min to 26
min.","sha":"2e33182d5ddaf7073df2d493d78cfe6b1bf606b8"}},"sourceBranch":"main","suggestedTargetBranches":["9.3","9.2"],"targetPullRequestStates":[{"branch":"main","label":"v9.4.0","branchLabelMappingKey":"^v9.4.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/252198","number":252198,"mergeCommit":{"message":"[CI]
Reduce FTR and Jest bench runtime (#252198)\n\n## Summary\n\nThe `FTR
Bench` step can block the build from finishing, so we want to\nget the
run time down and start sooner. It currently takes ~90 minutes\nto
finish. After these changes, it is ~45 minutes.\n\n- Reverts #252437\n-
Upgrade machine to `c2d -> c4d` and use hyperdisk. This reduces\nruntime
by ~6 minutes.\n- Removes `fleet` config from being benchmarked. This
reduces runtime by\n~17 minutes.\n- Removes one iteration of testing in
FTR Bench. This reduces runtime by\n~25 minutes.\n- Due to #252200, the
benchmarking steps now start with the pre checks.\nThis will start them
~25 minutes sooner.\n- `FTR Bench` builds it's own distributables, and
thus has no other step\ndependencies. If these builds fail, the bench
doesn't run.\n - `Jest Bench` has no dependencies.\n- Upgrade `Jest
Bench` machine from `n2-highmem-16` to `c4d-standard-16`\nand adds
hyperdisk.\n - Reduces runtime from 51 min to 26
min.","sha":"2e33182d5ddaf7073df2d493d78cfe6b1bf606b8"}},{"branch":"9.3","label":"v9.3.1","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"9.2","label":"v9.2.6","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}]
BACKPORT-->

Co-authored-by: Brad White <Ikuni17@users.noreply.github.com>
kibanamachine added a commit that referenced this pull request Feb 12, 2026
# Backport

This will backport the following commits from `main` to `9.2`:
- [[CI] Reduce FTR and Jest bench runtime
(#252198)](#252198)

<!--- Backport version: 9.6.6 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)

<!--BACKPORT [{"author":{"name":"Brad
White","email":"Ikuni17@users.noreply.github.com"},"sourceCommit":{"committedDate":"2026-02-12T05:55:01Z","message":"[CI]
Reduce FTR and Jest bench runtime (#252198)\n\n## Summary\n\nThe `FTR
Bench` step can block the build from finishing, so we want to\nget the
run time down and start sooner. It currently takes ~90 minutes\nto
finish. After these changes, it is ~45 minutes.\n\n- Reverts #252437\n-
Upgrade machine to `c2d -> c4d` and use hyperdisk. This reduces\nruntime
by ~6 minutes.\n- Removes `fleet` config from being benchmarked. This
reduces runtime by\n~17 minutes.\n- Removes one iteration of testing in
FTR Bench. This reduces runtime by\n~25 minutes.\n- Due to #252200, the
benchmarking steps now start with the pre checks.\nThis will start them
~25 minutes sooner.\n- `FTR Bench` builds it's own distributables, and
thus has no other step\ndependencies. If these builds fail, the bench
doesn't run.\n - `Jest Bench` has no dependencies.\n- Upgrade `Jest
Bench` machine from `n2-highmem-16` to `c4d-standard-16`\nand adds
hyperdisk.\n - Reduces runtime from 51 min to 26
min.","sha":"2e33182d5ddaf7073df2d493d78cfe6b1bf606b8","branchLabelMapping":{"^v9.4.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","backport:version","ci:bench-jest","v9.4.0","v9.3.1","v9.2.6"],"title":"[CI]
Reduce FTR and Jest bench
runtime","number":252198,"url":"https://github.com/elastic/kibana/pull/252198","mergeCommit":{"message":"[CI]
Reduce FTR and Jest bench runtime (#252198)\n\n## Summary\n\nThe `FTR
Bench` step can block the build from finishing, so we want to\nget the
run time down and start sooner. It currently takes ~90 minutes\nto
finish. After these changes, it is ~45 minutes.\n\n- Reverts #252437\n-
Upgrade machine to `c2d -> c4d` and use hyperdisk. This reduces\nruntime
by ~6 minutes.\n- Removes `fleet` config from being benchmarked. This
reduces runtime by\n~17 minutes.\n- Removes one iteration of testing in
FTR Bench. This reduces runtime by\n~25 minutes.\n- Due to #252200, the
benchmarking steps now start with the pre checks.\nThis will start them
~25 minutes sooner.\n- `FTR Bench` builds it's own distributables, and
thus has no other step\ndependencies. If these builds fail, the bench
doesn't run.\n - `Jest Bench` has no dependencies.\n- Upgrade `Jest
Bench` machine from `n2-highmem-16` to `c4d-standard-16`\nand adds
hyperdisk.\n - Reduces runtime from 51 min to 26
min.","sha":"2e33182d5ddaf7073df2d493d78cfe6b1bf606b8"}},"sourceBranch":"main","suggestedTargetBranches":["9.3","9.2"],"targetPullRequestStates":[{"branch":"main","label":"v9.4.0","branchLabelMappingKey":"^v9.4.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/252198","number":252198,"mergeCommit":{"message":"[CI]
Reduce FTR and Jest bench runtime (#252198)\n\n## Summary\n\nThe `FTR
Bench` step can block the build from finishing, so we want to\nget the
run time down and start sooner. It currently takes ~90 minutes\nto
finish. After these changes, it is ~45 minutes.\n\n- Reverts #252437\n-
Upgrade machine to `c2d -> c4d` and use hyperdisk. This reduces\nruntime
by ~6 minutes.\n- Removes `fleet` config from being benchmarked. This
reduces runtime by\n~17 minutes.\n- Removes one iteration of testing in
FTR Bench. This reduces runtime by\n~25 minutes.\n- Due to #252200, the
benchmarking steps now start with the pre checks.\nThis will start them
~25 minutes sooner.\n- `FTR Bench` builds it's own distributables, and
thus has no other step\ndependencies. If these builds fail, the bench
doesn't run.\n - `Jest Bench` has no dependencies.\n- Upgrade `Jest
Bench` machine from `n2-highmem-16` to `c4d-standard-16`\nand adds
hyperdisk.\n - Reduces runtime from 51 min to 26
min.","sha":"2e33182d5ddaf7073df2d493d78cfe6b1bf606b8"}},{"branch":"9.3","label":"v9.3.1","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"9.2","label":"v9.2.6","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}]
BACKPORT-->

Co-authored-by: Brad White <Ikuni17@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport:version Backport to applied version labels ci:bench-jest Add Jest benchmark step in CI. Compares merge base and PR commits. release_note:skip Skip the PR/issue when compiling release notes v9.2.6 v9.3.0 v9.3.1 v9.4.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants