[CI] Reduce FTR and Jest bench runtime#252198
Merged
Ikuni17 merged 23 commits intoelastic:mainfrom Feb 12, 2026
Merged
Conversation
tylersmalley
approved these changes
Feb 7, 2026
Ikuni17
added a commit
that referenced
this pull request
Feb 10, 2026
## Summary Temporarily remove file based changes that add FTR and Jest benchmark steps to avoid blocking builds. They can still be triggered with labels. Proper solution will be added in #252198.
kibanamachine
pushed a commit
to kibanamachine/kibana
that referenced
this pull request
Feb 10, 2026
## Summary Temporarily remove file based changes that add FTR and Jest benchmark steps to avoid blocking builds. They can still be triggered with labels. Proper solution will be added in elastic#252198. (cherry picked from commit e90547a)
kibanamachine
pushed a commit
to kibanamachine/kibana
that referenced
this pull request
Feb 10, 2026
## Summary Temporarily remove file based changes that add FTR and Jest benchmark steps to avoid blocking builds. They can still be triggered with labels. Proper solution will be added in elastic#252198. (cherry picked from commit e90547a)
Ikuni17
added a commit
that referenced
this pull request
Feb 10, 2026
# Backport This will backport the following commits from `main` to `9.3`: - [[CI] Disable file based changes for benchmarks (#252437)](#252437) <!--- Backport version: 9.6.6 --> ### Questions ? Please refer to the [Backport tool documentation](https://github.com/sorenlouv/backport) <!--BACKPORT [{"author":{"name":"Brad White","email":"Ikuni17@users.noreply.github.com"},"sourceCommit":{"committedDate":"2026-02-10T03:57:46Z","message":"[CI] Disable file based changes for benchmarks (#252437)\n\n## Summary\n\nTemporarily remove file based changes that add FTR and Jest benchmark\nsteps to avoid blocking builds. They can still be triggered with labels.\nProper solution will be added in #252198.","sha":"e90547ab11e3138d28a4575f52697608aca1a05d","branchLabelMapping":{"^v9.4.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","skip-ci","backport:version","v9.4.0","v9.3.1","v9.2.6"],"title":"[CI] Disable file based changes for benchmarks","number":252437,"url":"https://github.com/elastic/kibana/pull/252437","mergeCommit":{"message":"[CI] Disable file based changes for benchmarks (#252437)\n\n## Summary\n\nTemporarily remove file based changes that add FTR and Jest benchmark\nsteps to avoid blocking builds. They can still be triggered with labels.\nProper solution will be added in #252198.","sha":"e90547ab11e3138d28a4575f52697608aca1a05d"}},"sourceBranch":"main","suggestedTargetBranches":["9.3","9.2"],"targetPullRequestStates":[{"branch":"main","label":"v9.4.0","branchLabelMappingKey":"^v9.4.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/252437","number":252437,"mergeCommit":{"message":"[CI] Disable file based changes for benchmarks (#252437)\n\n## Summary\n\nTemporarily remove file based changes that add FTR and Jest benchmark\nsteps to avoid blocking builds. They can still be triggered with labels.\nProper solution will be added in #252198.","sha":"e90547ab11e3138d28a4575f52697608aca1a05d"}},{"branch":"9.3","label":"v9.3.1","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"9.2","label":"v9.2.6","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}] BACKPORT--> Co-authored-by: Brad White <Ikuni17@users.noreply.github.com>
Ikuni17
added a commit
that referenced
this pull request
Feb 10, 2026
# Backport This will backport the following commits from `main` to `9.2`: - [[CI] Disable file based changes for benchmarks (#252437)](#252437) <!--- Backport version: 9.6.6 --> ### Questions ? Please refer to the [Backport tool documentation](https://github.com/sorenlouv/backport) <!--BACKPORT [{"author":{"name":"Brad White","email":"Ikuni17@users.noreply.github.com"},"sourceCommit":{"committedDate":"2026-02-10T03:57:46Z","message":"[CI] Disable file based changes for benchmarks (#252437)\n\n## Summary\n\nTemporarily remove file based changes that add FTR and Jest benchmark\nsteps to avoid blocking builds. They can still be triggered with labels.\nProper solution will be added in #252198.","sha":"e90547ab11e3138d28a4575f52697608aca1a05d","branchLabelMapping":{"^v9.4.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","skip-ci","backport:version","v9.4.0","v9.3.1","v9.2.6"],"title":"[CI] Disable file based changes for benchmarks","number":252437,"url":"https://github.com/elastic/kibana/pull/252437","mergeCommit":{"message":"[CI] Disable file based changes for benchmarks (#252437)\n\n## Summary\n\nTemporarily remove file based changes that add FTR and Jest benchmark\nsteps to avoid blocking builds. They can still be triggered with labels.\nProper solution will be added in #252198.","sha":"e90547ab11e3138d28a4575f52697608aca1a05d"}},"sourceBranch":"main","suggestedTargetBranches":["9.3","9.2"],"targetPullRequestStates":[{"branch":"main","label":"v9.4.0","branchLabelMappingKey":"^v9.4.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/252437","number":252437,"mergeCommit":{"message":"[CI] Disable file based changes for benchmarks (#252437)\n\n## Summary\n\nTemporarily remove file based changes that add FTR and Jest benchmark\nsteps to avoid blocking builds. They can still be triggered with labels.\nProper solution will be added in #252198.","sha":"e90547ab11e3138d28a4575f52697608aca1a05d"}},{"branch":"9.3","label":"v9.3.1","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"9.2","label":"v9.2.6","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}] BACKPORT--> Co-authored-by: Brad White <Ikuni17@users.noreply.github.com>
Contributor
💛 Build succeeded, but was flaky
Failed CI StepsTest Failures
Metrics [docs]
History
cc @Ikuni17 |
tylersmalley
approved these changes
Feb 12, 2026
Contributor
|
Starting backport for target branches: 9.2, 9.3 https://github.com/elastic/kibana/actions/runs/21935339183 |
kibanamachine
pushed a commit
to kibanamachine/kibana
that referenced
this pull request
Feb 12, 2026
## Summary The `FTR Bench` step can block the build from finishing, so we want to get the run time down and start sooner. It currently takes ~90 minutes to finish. After these changes, it is ~45 minutes. - Reverts elastic#252437 - Upgrade machine to `c2d -> c4d` and use hyperdisk. This reduces runtime by ~6 minutes. - Removes `fleet` config from being benchmarked. This reduces runtime by ~17 minutes. - Removes one iteration of testing in FTR Bench. This reduces runtime by ~25 minutes. - Due to elastic#252200, the benchmarking steps now start with the pre checks. This will start them ~25 minutes sooner. - `FTR Bench` builds it's own distributables, and thus has no other step dependencies. If these builds fail, the bench doesn't run. - `Jest Bench` has no dependencies. - Upgrade `Jest Bench` machine from `n2-highmem-16` to `c4d-standard-16` and adds hyperdisk. - Reduces runtime from 51 min to 26 min. (cherry picked from commit 2e33182)
kibanamachine
pushed a commit
to kibanamachine/kibana
that referenced
this pull request
Feb 12, 2026
## Summary The `FTR Bench` step can block the build from finishing, so we want to get the run time down and start sooner. It currently takes ~90 minutes to finish. After these changes, it is ~45 minutes. - Reverts elastic#252437 - Upgrade machine to `c2d -> c4d` and use hyperdisk. This reduces runtime by ~6 minutes. - Removes `fleet` config from being benchmarked. This reduces runtime by ~17 minutes. - Removes one iteration of testing in FTR Bench. This reduces runtime by ~25 minutes. - Due to elastic#252200, the benchmarking steps now start with the pre checks. This will start them ~25 minutes sooner. - `FTR Bench` builds it's own distributables, and thus has no other step dependencies. If these builds fail, the bench doesn't run. - `Jest Bench` has no dependencies. - Upgrade `Jest Bench` machine from `n2-highmem-16` to `c4d-standard-16` and adds hyperdisk. - Reduces runtime from 51 min to 26 min. (cherry picked from commit 2e33182)
Contributor
💚 All backports created successfully
Note: Successful backport PRs will be merged automatically after passing CI. Questions ?Please refer to the Backport tool documentation |
kibanamachine
added a commit
that referenced
this pull request
Feb 12, 2026
# Backport This will backport the following commits from `main` to `9.3`: - [[CI] Reduce FTR and Jest bench runtime (#252198)](#252198) <!--- Backport version: 9.6.6 --> ### Questions ? Please refer to the [Backport tool documentation](https://github.com/sorenlouv/backport) <!--BACKPORT [{"author":{"name":"Brad White","email":"Ikuni17@users.noreply.github.com"},"sourceCommit":{"committedDate":"2026-02-12T05:55:01Z","message":"[CI] Reduce FTR and Jest bench runtime (#252198)\n\n## Summary\n\nThe `FTR Bench` step can block the build from finishing, so we want to\nget the run time down and start sooner. It currently takes ~90 minutes\nto finish. After these changes, it is ~45 minutes.\n\n- Reverts #252437\n- Upgrade machine to `c2d -> c4d` and use hyperdisk. This reduces\nruntime by ~6 minutes.\n- Removes `fleet` config from being benchmarked. This reduces runtime by\n~17 minutes.\n- Removes one iteration of testing in FTR Bench. This reduces runtime by\n~25 minutes.\n- Due to #252200, the benchmarking steps now start with the pre checks.\nThis will start them ~25 minutes sooner.\n- `FTR Bench` builds it's own distributables, and thus has no other step\ndependencies. If these builds fail, the bench doesn't run.\n - `Jest Bench` has no dependencies.\n- Upgrade `Jest Bench` machine from `n2-highmem-16` to `c4d-standard-16`\nand adds hyperdisk.\n - Reduces runtime from 51 min to 26 min.","sha":"2e33182d5ddaf7073df2d493d78cfe6b1bf606b8","branchLabelMapping":{"^v9.4.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","backport:version","ci:bench-jest","v9.4.0","v9.3.1","v9.2.6"],"title":"[CI] Reduce FTR and Jest bench runtime","number":252198,"url":"https://github.com/elastic/kibana/pull/252198","mergeCommit":{"message":"[CI] Reduce FTR and Jest bench runtime (#252198)\n\n## Summary\n\nThe `FTR Bench` step can block the build from finishing, so we want to\nget the run time down and start sooner. It currently takes ~90 minutes\nto finish. After these changes, it is ~45 minutes.\n\n- Reverts #252437\n- Upgrade machine to `c2d -> c4d` and use hyperdisk. This reduces\nruntime by ~6 minutes.\n- Removes `fleet` config from being benchmarked. This reduces runtime by\n~17 minutes.\n- Removes one iteration of testing in FTR Bench. This reduces runtime by\n~25 minutes.\n- Due to #252200, the benchmarking steps now start with the pre checks.\nThis will start them ~25 minutes sooner.\n- `FTR Bench` builds it's own distributables, and thus has no other step\ndependencies. If these builds fail, the bench doesn't run.\n - `Jest Bench` has no dependencies.\n- Upgrade `Jest Bench` machine from `n2-highmem-16` to `c4d-standard-16`\nand adds hyperdisk.\n - Reduces runtime from 51 min to 26 min.","sha":"2e33182d5ddaf7073df2d493d78cfe6b1bf606b8"}},"sourceBranch":"main","suggestedTargetBranches":["9.3","9.2"],"targetPullRequestStates":[{"branch":"main","label":"v9.4.0","branchLabelMappingKey":"^v9.4.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/252198","number":252198,"mergeCommit":{"message":"[CI] Reduce FTR and Jest bench runtime (#252198)\n\n## Summary\n\nThe `FTR Bench` step can block the build from finishing, so we want to\nget the run time down and start sooner. It currently takes ~90 minutes\nto finish. After these changes, it is ~45 minutes.\n\n- Reverts #252437\n- Upgrade machine to `c2d -> c4d` and use hyperdisk. This reduces\nruntime by ~6 minutes.\n- Removes `fleet` config from being benchmarked. This reduces runtime by\n~17 minutes.\n- Removes one iteration of testing in FTR Bench. This reduces runtime by\n~25 minutes.\n- Due to #252200, the benchmarking steps now start with the pre checks.\nThis will start them ~25 minutes sooner.\n- `FTR Bench` builds it's own distributables, and thus has no other step\ndependencies. If these builds fail, the bench doesn't run.\n - `Jest Bench` has no dependencies.\n- Upgrade `Jest Bench` machine from `n2-highmem-16` to `c4d-standard-16`\nand adds hyperdisk.\n - Reduces runtime from 51 min to 26 min.","sha":"2e33182d5ddaf7073df2d493d78cfe6b1bf606b8"}},{"branch":"9.3","label":"v9.3.1","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"9.2","label":"v9.2.6","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}] BACKPORT--> Co-authored-by: Brad White <Ikuni17@users.noreply.github.com>
kibanamachine
added a commit
that referenced
this pull request
Feb 12, 2026
# Backport This will backport the following commits from `main` to `9.2`: - [[CI] Reduce FTR and Jest bench runtime (#252198)](#252198) <!--- Backport version: 9.6.6 --> ### Questions ? Please refer to the [Backport tool documentation](https://github.com/sorenlouv/backport) <!--BACKPORT [{"author":{"name":"Brad White","email":"Ikuni17@users.noreply.github.com"},"sourceCommit":{"committedDate":"2026-02-12T05:55:01Z","message":"[CI] Reduce FTR and Jest bench runtime (#252198)\n\n## Summary\n\nThe `FTR Bench` step can block the build from finishing, so we want to\nget the run time down and start sooner. It currently takes ~90 minutes\nto finish. After these changes, it is ~45 minutes.\n\n- Reverts #252437\n- Upgrade machine to `c2d -> c4d` and use hyperdisk. This reduces\nruntime by ~6 minutes.\n- Removes `fleet` config from being benchmarked. This reduces runtime by\n~17 minutes.\n- Removes one iteration of testing in FTR Bench. This reduces runtime by\n~25 minutes.\n- Due to #252200, the benchmarking steps now start with the pre checks.\nThis will start them ~25 minutes sooner.\n- `FTR Bench` builds it's own distributables, and thus has no other step\ndependencies. If these builds fail, the bench doesn't run.\n - `Jest Bench` has no dependencies.\n- Upgrade `Jest Bench` machine from `n2-highmem-16` to `c4d-standard-16`\nand adds hyperdisk.\n - Reduces runtime from 51 min to 26 min.","sha":"2e33182d5ddaf7073df2d493d78cfe6b1bf606b8","branchLabelMapping":{"^v9.4.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","backport:version","ci:bench-jest","v9.4.0","v9.3.1","v9.2.6"],"title":"[CI] Reduce FTR and Jest bench runtime","number":252198,"url":"https://github.com/elastic/kibana/pull/252198","mergeCommit":{"message":"[CI] Reduce FTR and Jest bench runtime (#252198)\n\n## Summary\n\nThe `FTR Bench` step can block the build from finishing, so we want to\nget the run time down and start sooner. It currently takes ~90 minutes\nto finish. After these changes, it is ~45 minutes.\n\n- Reverts #252437\n- Upgrade machine to `c2d -> c4d` and use hyperdisk. This reduces\nruntime by ~6 minutes.\n- Removes `fleet` config from being benchmarked. This reduces runtime by\n~17 minutes.\n- Removes one iteration of testing in FTR Bench. This reduces runtime by\n~25 minutes.\n- Due to #252200, the benchmarking steps now start with the pre checks.\nThis will start them ~25 minutes sooner.\n- `FTR Bench` builds it's own distributables, and thus has no other step\ndependencies. If these builds fail, the bench doesn't run.\n - `Jest Bench` has no dependencies.\n- Upgrade `Jest Bench` machine from `n2-highmem-16` to `c4d-standard-16`\nand adds hyperdisk.\n - Reduces runtime from 51 min to 26 min.","sha":"2e33182d5ddaf7073df2d493d78cfe6b1bf606b8"}},"sourceBranch":"main","suggestedTargetBranches":["9.3","9.2"],"targetPullRequestStates":[{"branch":"main","label":"v9.4.0","branchLabelMappingKey":"^v9.4.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/252198","number":252198,"mergeCommit":{"message":"[CI] Reduce FTR and Jest bench runtime (#252198)\n\n## Summary\n\nThe `FTR Bench` step can block the build from finishing, so we want to\nget the run time down and start sooner. It currently takes ~90 minutes\nto finish. After these changes, it is ~45 minutes.\n\n- Reverts #252437\n- Upgrade machine to `c2d -> c4d` and use hyperdisk. This reduces\nruntime by ~6 minutes.\n- Removes `fleet` config from being benchmarked. This reduces runtime by\n~17 minutes.\n- Removes one iteration of testing in FTR Bench. This reduces runtime by\n~25 minutes.\n- Due to #252200, the benchmarking steps now start with the pre checks.\nThis will start them ~25 minutes sooner.\n- `FTR Bench` builds it's own distributables, and thus has no other step\ndependencies. If these builds fail, the bench doesn't run.\n - `Jest Bench` has no dependencies.\n- Upgrade `Jest Bench` machine from `n2-highmem-16` to `c4d-standard-16`\nand adds hyperdisk.\n - Reduces runtime from 51 min to 26 min.","sha":"2e33182d5ddaf7073df2d493d78cfe6b1bf606b8"}},{"branch":"9.3","label":"v9.3.1","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"9.2","label":"v9.2.6","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}] BACKPORT--> Co-authored-by: Brad White <Ikuni17@users.noreply.github.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
The
FTR Benchstep can block the build from finishing, so we want to get the run time down and start sooner. It currently takes ~90 minutes to finish. After these changes, it is ~45 minutes.c2d -> c4dand use hyperdisk. This reduces runtime by ~6 minutes.fleetconfig from being benchmarked. This reduces runtime by ~17 minutes.FTR Benchbuilds it's own distributables, and thus has no other step dependencies. If these builds fail, the bench doesn't run.Jest Benchhas no dependencies.Jest Benchmachine fromn2-highmem-16toc4d-standard-16and adds hyperdisk.