Skip to content

[CI] Move faster beta build to default#252200

Merged
tylersmalley merged 10 commits intoelastic:mainfrom
Ikuni17:ci/enable-beta-faster-build
Feb 10, 2026
Merged

[CI] Move faster beta build to default#252200
tylersmalley merged 10 commits intoelastic:mainfrom
Ikuni17:ci/enable-beta-faster-build

Conversation

@Ikuni17
Copy link
Copy Markdown
Contributor

@Ikuni17 Ikuni17 commented Feb 7, 2026

Summary

  • This is a follow up to [CI] Optimize CI steps for FTR #241974 and enables it by default.
  • CI runs are about 80 minutes even with preemptions in FTR, example
  • Remove old yml that are no longer needed
  • Scout Test Run Builder updates
    • Moved into base.yml and now starts sooner since it blocks all Scout tests. It now only depends on build and check_types
    • Changed machine to c3d-standard-8
    • Manifests are now generated in parallel, resulting in 75% time reduction and will scale better as Scout is adopted
    • Overall step time was reduced 38%
  • Allows passing depends_on to Scout steps via SCOUT_CONFIGS_DEPS like FTR and Jest

@Ikuni17 Ikuni17 self-assigned this Feb 7, 2026
@Ikuni17 Ikuni17 added release_note:skip Skip the PR/issue when compiling release notes backport:all-open Backport to all branches that could still receive a release labels Feb 7, 2026
@Ikuni17 Ikuni17 marked this pull request as ready for review February 8, 2026 11:29
@Ikuni17 Ikuni17 requested review from a team as code owners February 8, 2026 11:29
@Ikuni17 Ikuni17 requested a review from a team February 8, 2026 11:29
Copy link
Copy Markdown
Contributor

@dmlemeshko dmlemeshko left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Passed in 1h 20m 🚀 great improvement

- exit_status: '-1'
limit: 3

- wait
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Removing the wait add adding depends_on for build and check_types means that we will still run e2e tests if we get a failure in linting, linting (with types) and checks. I know that gate was added for cost cutting (cc @jbudz), and not sure we want to revert that right now. I think for the sake of moving this PR forward we could add those as dependencies for now.

As a follow-up, I think we could do something like what I experimented with here. Start everything as soon as we can, but cancel e2e jobs if one of these early gates fail.

Copy link
Copy Markdown
Contributor Author

@Ikuni17 Ikuni17 Feb 10, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I added all checks to be blocking again in 7c3735c. Runtime is about 90 min without preemption https://buildkite.com/elastic/kibana-pull-request/builds/392225/waterfall

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@tylersmalley - you can find the original reasoning here: #241927 with Dario's estimations that these errors might increase the CI costs, but not significantly.

Maybe we could have considered build termination on these failed checks?

Comment thread .buildkite/pipelines/pull_request/base.yml
@tylersmalley
Copy link
Copy Markdown
Member

Just the one comment here which I think we need to address, then LGTM.

In the future we should separate these type of things, like the updates to the scout step from prompting the new pipeline. More focused PR's will make things move along faster by feedback in one area not holding up another. It will also help as we communicate the changes we have made over time.

Copy link
Copy Markdown
Contributor

@mistic mistic left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM . Will follow up on this in the context of https://github.com/elastic/kibana-operations/issues/416 after finishing #252224 and #250509

@Ikuni17 Ikuni17 requested a review from tylersmalley February 10, 2026 07:52
@elasticmachine
Copy link
Copy Markdown
Contributor

💚 Build Succeeded

Metrics [docs]

✅ unchanged

History

cc @Ikuni17

@tylersmalley tylersmalley merged commit 77a0439 into elastic:main Feb 10, 2026
16 checks passed
@kibanamachine
Copy link
Copy Markdown
Contributor

Starting backport for target branches: 8.19, 9.2, 9.3

https://github.com/elastic/kibana/actions/runs/21874750677

@kibanamachine
Copy link
Copy Markdown
Contributor

💔 All backports failed

Status Branch Result
8.19 Backport failed because of merge conflicts
9.2 Backport failed because of merge conflicts
9.3 Backport failed because of merge conflicts

Manual backport

To create the backport manually run:

node scripts/backport --pr 252200

Questions ?

Please refer to the Backport tool documentation

@Ikuni17
Copy link
Copy Markdown
Contributor Author

Ikuni17 commented Feb 11, 2026

💚 All backports created successfully

Status Branch Result
9.3
9.2
8.19

Note: Successful backport PRs will be merged automatically after passing CI.

Questions ?

Please refer to the Backport tool documentation

@kibanamachine
Copy link
Copy Markdown
Contributor

Looks like this PR has backport PRs but they still haven't been merged. Please merge them ASAP to keep the branches relatively in sync.
cc: @Ikuni17

mistic added a commit that referenced this pull request Feb 11, 2026
…#252768)

This reverts the parallel logic added at
#252200 for now. @dolaru will look
later on how to do this properly.
Ikuni17 pushed a commit to Ikuni17/kibana that referenced this pull request Feb 12, 2026
…elastic#252768)

This reverts the parallel logic added at
elastic#252200 for now. @dolaru will look
later on how to do this properly.
Ikuni17 pushed a commit to Ikuni17/kibana that referenced this pull request Feb 12, 2026
…elastic#252768)

This reverts the parallel logic added at
elastic#252200 for now. @dolaru will look
later on how to do this properly.
Ikuni17 pushed a commit to Ikuni17/kibana that referenced this pull request Feb 12, 2026
…elastic#252768)

This reverts the parallel logic added at
elastic#252200 for now. @dolaru will look
later on how to do this properly.
mistic added a commit that referenced this pull request Feb 12, 2026
Closes elastic/kibana-operations#416

This PR creates an `on_merge_fanout` pipeline to simplify the setup and
read of the main on_merge pipeline itself. For now everything aside from
core jobs and dynamic pickup jobs for FTR and Scout goes into that file.

I've made sure we are using an early upload to the fanout pipeline so
timing should be the same while anything inside the on_merge fanout
still aways on the same on_merge gates.

Finally this also puts in sync the setup of on_merge after what we added
at #252200

---------

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
mistic added a commit to mistic/kibana that referenced this pull request Feb 12, 2026
Closes elastic/kibana-operations#416

This PR creates an `on_merge_fanout` pipeline to simplify the setup and
read of the main on_merge pipeline itself. For now everything aside from
core jobs and dynamic pickup jobs for FTR and Scout goes into that file.

I've made sure we are using an early upload to the fanout pipeline so
timing should be the same while anything inside the on_merge fanout
still aways on the same on_merge gates.

Finally this also puts in sync the setup of on_merge after what we added
at elastic#252200

---------

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
(cherry picked from commit 9c57120)

# Conflicts:
#	.buildkite/pipelines/on_merge.yml
#	.buildkite/pipelines/pull_request/base.yml
#	.buildkite/pipelines/pull_request/security_solution/cypress_burn.yml
#	.buildkite/pipelines/pull_request/security_solution/defend_workflows.yml
Ikuni17 added a commit that referenced this pull request Feb 12, 2026
# Backport

This will backport the following commits from `main` to `9.3`:
- [[CI] Move faster beta build to default
(#252200)](#252200)
 - #252768

<!--- Backport version: 10.2.0 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)

<!--BACKPORT [{"author":{"name":"Brad
White","email":"Ikuni17@users.noreply.github.com"},"sourceCommit":{"committedDate":"2026-02-10T17:08:12Z","message":"[CI]
Move faster beta build to default (#252200)\n\n## Summary\n\n- This is a
follow up to #241974 and enables it by default.\n- CI runs are about 80
minutes even with preemptions in
FTR,\n[example](https://buildkite.com/elastic/kibana-pull-request/builds/391420/waterfall)\n-
Remove old `yml` that are no longer needed\n- `Scout Test Run Builder`
updates\n- Moved into `base.yml` and now starts sooner since it blocks
all Scout\ntests. It now only depends on `build` and `check_types`\n -
Changed machine to `c3d-standard-8`\n- Manifests are now generated in
parallel, resulting in 75% time\nreduction and will scale better as
Scout is adopted\n - Overall step time was reduced 38%\n- Allows passing
`depends_on` to Scout steps via `SCOUT_CONFIGS_DEPS`\nlike FTR and
Jest","sha":"77a0439683fe45b507e53bc0a6317a79b5f8e757","branchLabelMapping":{"^v9.4.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","backport:all-open","v9.4.0"],"title":"[CI]
Move faster beta build to
default","number":252200,"url":"https://github.com/elastic/kibana/pull/252200","mergeCommit":{"message":"[CI]
Move faster beta build to default (#252200)\n\n## Summary\n\n- This is a
follow up to #241974 and enables it by default.\n- CI runs are about 80
minutes even with preemptions in
FTR,\n[example](https://buildkite.com/elastic/kibana-pull-request/builds/391420/waterfall)\n-
Remove old `yml` that are no longer needed\n- `Scout Test Run Builder`
updates\n- Moved into `base.yml` and now starts sooner since it blocks
all Scout\ntests. It now only depends on `build` and `check_types`\n -
Changed machine to `c3d-standard-8`\n- Manifests are now generated in
parallel, resulting in 75% time\nreduction and will scale better as
Scout is adopted\n - Overall step time was reduced 38%\n- Allows passing
`depends_on` to Scout steps via `SCOUT_CONFIGS_DEPS`\nlike FTR and
Jest","sha":"77a0439683fe45b507e53bc0a6317a79b5f8e757"}},"sourceBranch":"main","suggestedTargetBranches":[],"targetPullRequestStates":[{"branch":"main","label":"v9.4.0","branchLabelMappingKey":"^v9.4.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/252200","number":252200,"mergeCommit":{"message":"[CI]
Move faster beta build to default (#252200)\n\n## Summary\n\n- This is a
follow up to #241974 and enables it by default.\n- CI runs are about 80
minutes even with preemptions in
FTR,\n[example](https://buildkite.com/elastic/kibana-pull-request/builds/391420/waterfall)\n-
Remove old `yml` that are no longer needed\n- `Scout Test Run Builder`
updates\n- Moved into `base.yml` and now starts sooner since it blocks
all Scout\ntests. It now only depends on `build` and `check_types`\n -
Changed machine to `c3d-standard-8`\n- Manifests are now generated in
parallel, resulting in 75% time\nreduction and will scale better as
Scout is adopted\n - Overall step time was reduced 38%\n- Allows passing
`depends_on` to Scout steps via `SCOUT_CONFIGS_DEPS`\nlike FTR and
Jest","sha":"77a0439683fe45b507e53bc0a6317a79b5f8e757"}}]}] BACKPORT-->

---------

Co-authored-by: Tiago Costa <tiago.costa@elastic.co>
Ikuni17 added a commit that referenced this pull request Feb 12, 2026
# Backport

This will backport the following commits from `main` to `9.2`:
- [[CI] Move faster beta build to default
(#252200)](#252200)
 - #252768

<!--- Backport version: 10.2.0 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)

<!--BACKPORT [{"author":{"name":"Brad
White","email":"Ikuni17@users.noreply.github.com"},"sourceCommit":{"committedDate":"2026-02-10T17:08:12Z","message":"[CI]
Move faster beta build to default (#252200)\n\n## Summary\n\n- This is a
follow up to #241974 and enables it by default.\n- CI runs are about 80
minutes even with preemptions in
FTR,\n[example](https://buildkite.com/elastic/kibana-pull-request/builds/391420/waterfall)\n-
Remove old `yml` that are no longer needed\n- `Scout Test Run Builder`
updates\n- Moved into `base.yml` and now starts sooner since it blocks
all Scout\ntests. It now only depends on `build` and `check_types`\n -
Changed machine to `c3d-standard-8`\n- Manifests are now generated in
parallel, resulting in 75% time\nreduction and will scale better as
Scout is adopted\n - Overall step time was reduced 38%\n- Allows passing
`depends_on` to Scout steps via `SCOUT_CONFIGS_DEPS`\nlike FTR and
Jest","sha":"77a0439683fe45b507e53bc0a6317a79b5f8e757","branchLabelMapping":{"^v9.4.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","backport:all-open","v9.4.0"],"title":"[CI]
Move faster beta build to
default","number":252200,"url":"https://github.com/elastic/kibana/pull/252200","mergeCommit":{"message":"[CI]
Move faster beta build to default (#252200)\n\n## Summary\n\n- This is a
follow up to #241974 and enables it by default.\n- CI runs are about 80
minutes even with preemptions in
FTR,\n[example](https://buildkite.com/elastic/kibana-pull-request/builds/391420/waterfall)\n-
Remove old `yml` that are no longer needed\n- `Scout Test Run Builder`
updates\n- Moved into `base.yml` and now starts sooner since it blocks
all Scout\ntests. It now only depends on `build` and `check_types`\n -
Changed machine to `c3d-standard-8`\n- Manifests are now generated in
parallel, resulting in 75% time\nreduction and will scale better as
Scout is adopted\n - Overall step time was reduced 38%\n- Allows passing
`depends_on` to Scout steps via `SCOUT_CONFIGS_DEPS`\nlike FTR and
Jest","sha":"77a0439683fe45b507e53bc0a6317a79b5f8e757"}},"sourceBranch":"main","suggestedTargetBranches":[],"targetPullRequestStates":[{"branch":"main","label":"v9.4.0","branchLabelMappingKey":"^v9.4.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/252200","number":252200,"mergeCommit":{"message":"[CI]
Move faster beta build to default (#252200)\n\n## Summary\n\n- This is a
follow up to #241974 and enables it by default.\n- CI runs are about 80
minutes even with preemptions in
FTR,\n[example](https://buildkite.com/elastic/kibana-pull-request/builds/391420/waterfall)\n-
Remove old `yml` that are no longer needed\n- `Scout Test Run Builder`
updates\n- Moved into `base.yml` and now starts sooner since it blocks
all Scout\ntests. It now only depends on `build` and `check_types`\n -
Changed machine to `c3d-standard-8`\n- Manifests are now generated in
parallel, resulting in 75% time\nreduction and will scale better as
Scout is adopted\n - Overall step time was reduced 38%\n- Allows passing
`depends_on` to Scout steps via `SCOUT_CONFIGS_DEPS`\nlike FTR and
Jest","sha":"77a0439683fe45b507e53bc0a6317a79b5f8e757"}}]}] BACKPORT-->

---------

Co-authored-by: Tiago Costa <tiago.costa@elastic.co>
Ikuni17 added a commit that referenced this pull request Feb 12, 2026
# Backport

This will backport the following commits from `main` to `8.19`:
- [[CI] Move faster beta build to default
(#252200)](#252200)
 - #252768

<!--- Backport version: 10.2.0 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)

<!--BACKPORT [{"author":{"name":"Brad
White","email":"Ikuni17@users.noreply.github.com"},"sourceCommit":{"committedDate":"2026-02-10T17:08:12Z","message":"[CI]
Move faster beta build to default (#252200)\n\n## Summary\n\n- This is a
follow up to #241974 and enables it by default.\n- CI runs are about 80
minutes even with preemptions in
FTR,\n[example](https://buildkite.com/elastic/kibana-pull-request/builds/391420/waterfall)\n-
Remove old `yml` that are no longer needed\n- `Scout Test Run Builder`
updates\n- Moved into `base.yml` and now starts sooner since it blocks
all Scout\ntests. It now only depends on `build` and `check_types`\n -
Changed machine to `c3d-standard-8`\n- Manifests are now generated in
parallel, resulting in 75% time\nreduction and will scale better as
Scout is adopted\n - Overall step time was reduced 38%\n- Allows passing
`depends_on` to Scout steps via `SCOUT_CONFIGS_DEPS`\nlike FTR and
Jest","sha":"77a0439683fe45b507e53bc0a6317a79b5f8e757","branchLabelMapping":{"^v9.4.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","backport:all-open","v9.4.0"],"title":"[CI]
Move faster beta build to
default","number":252200,"url":"https://github.com/elastic/kibana/pull/252200","mergeCommit":{"message":"[CI]
Move faster beta build to default (#252200)\n\n## Summary\n\n- This is a
follow up to #241974 and enables it by default.\n- CI runs are about 80
minutes even with preemptions in
FTR,\n[example](https://buildkite.com/elastic/kibana-pull-request/builds/391420/waterfall)\n-
Remove old `yml` that are no longer needed\n- `Scout Test Run Builder`
updates\n- Moved into `base.yml` and now starts sooner since it blocks
all Scout\ntests. It now only depends on `build` and `check_types`\n -
Changed machine to `c3d-standard-8`\n- Manifests are now generated in
parallel, resulting in 75% time\nreduction and will scale better as
Scout is adopted\n - Overall step time was reduced 38%\n- Allows passing
`depends_on` to Scout steps via `SCOUT_CONFIGS_DEPS`\nlike FTR and
Jest","sha":"77a0439683fe45b507e53bc0a6317a79b5f8e757"}},"sourceBranch":"main","suggestedTargetBranches":[],"targetPullRequestStates":[{"branch":"main","label":"v9.4.0","branchLabelMappingKey":"^v9.4.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/252200","number":252200,"mergeCommit":{"message":"[CI]
Move faster beta build to default (#252200)\n\n## Summary\n\n- This is a
follow up to #241974 and enables it by default.\n- CI runs are about 80
minutes even with preemptions in
FTR,\n[example](https://buildkite.com/elastic/kibana-pull-request/builds/391420/waterfall)\n-
Remove old `yml` that are no longer needed\n- `Scout Test Run Builder`
updates\n- Moved into `base.yml` and now starts sooner since it blocks
all Scout\ntests. It now only depends on `build` and `check_types`\n -
Changed machine to `c3d-standard-8`\n- Manifests are now generated in
parallel, resulting in 75% time\nreduction and will scale better as
Scout is adopted\n - Overall step time was reduced 38%\n- Allows passing
`depends_on` to Scout steps via `SCOUT_CONFIGS_DEPS`\nlike FTR and
Jest","sha":"77a0439683fe45b507e53bc0a6317a79b5f8e757"}}]}] BACKPORT-->

---------

Co-authored-by: Tiago Costa <tiago.costa@elastic.co>
@kibanamachine kibanamachine added v8.19.12 and removed backport missing Added to PRs automatically when the are determined to be missing a backport. labels Feb 12, 2026
mistic added a commit to mistic/kibana that referenced this pull request Feb 12, 2026
Closes elastic/kibana-operations#416

This PR creates an `on_merge_fanout` pipeline to simplify the setup and
read of the main on_merge pipeline itself. For now everything aside from
core jobs and dynamic pickup jobs for FTR and Scout goes into that file.

I've made sure we are using an early upload to the fanout pipeline so
timing should be the same while anything inside the on_merge fanout
still aways on the same on_merge gates.

Finally this also puts in sync the setup of on_merge after what we added
at elastic#252200

---------

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
(cherry picked from commit 9c57120)

# Conflicts:
#	.buildkite/pipelines/on_merge.yml
#	.buildkite/pipelines/pull_request/security_solution/cypress_burn.yml
#	.buildkite/pipelines/pull_request/security_solution/defend_workflows.yml
mistic added a commit to mistic/kibana that referenced this pull request Feb 12, 2026
Closes elastic/kibana-operations#416

This PR creates an `on_merge_fanout` pipeline to simplify the setup and
read of the main on_merge pipeline itself. For now everything aside from
core jobs and dynamic pickup jobs for FTR and Scout goes into that file.

I've made sure we are using an early upload to the fanout pipeline so
timing should be the same while anything inside the on_merge fanout
still aways on the same on_merge gates.

Finally this also puts in sync the setup of on_merge after what we added
at elastic#252200

---------

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
(cherry picked from commit 9c57120)

# Conflicts:
#	.buildkite/pipelines/on_merge.yml
#	.buildkite/pipelines/pull_request/security_solution/cypress_burn.yml
#	.buildkite/pipelines/pull_request/security_solution/defend_workflows.yml
Ikuni17 added a commit that referenced this pull request Feb 12, 2026
## Summary

The `FTR Bench` step can block the build from finishing, so we want to
get the run time down and start sooner. It currently takes ~90 minutes
to finish. After these changes, it is ~45 minutes.

- Reverts #252437
- Upgrade machine to `c2d -> c4d` and use hyperdisk. This reduces
runtime by ~6 minutes.
- Removes `fleet` config from being benchmarked. This reduces runtime by
~17 minutes.
- Removes one iteration of testing in FTR Bench. This reduces runtime by
~25 minutes.
- Due to #252200, the benchmarking steps now start with the pre checks.
This will start them ~25 minutes sooner.
- `FTR Bench` builds it's own distributables, and thus has no other step
dependencies. If these builds fail, the bench doesn't run.
  - `Jest Bench` has no dependencies.
- Upgrade `Jest Bench` machine from `n2-highmem-16` to `c4d-standard-16`
and adds hyperdisk.
  - Reduces runtime from 51 min to 26 min.
kibanamachine pushed a commit to kibanamachine/kibana that referenced this pull request Feb 12, 2026
## Summary

The `FTR Bench` step can block the build from finishing, so we want to
get the run time down and start sooner. It currently takes ~90 minutes
to finish. After these changes, it is ~45 minutes.

- Reverts elastic#252437
- Upgrade machine to `c2d -> c4d` and use hyperdisk. This reduces
runtime by ~6 minutes.
- Removes `fleet` config from being benchmarked. This reduces runtime by
~17 minutes.
- Removes one iteration of testing in FTR Bench. This reduces runtime by
~25 minutes.
- Due to elastic#252200, the benchmarking steps now start with the pre checks.
This will start them ~25 minutes sooner.
- `FTR Bench` builds it's own distributables, and thus has no other step
dependencies. If these builds fail, the bench doesn't run.
  - `Jest Bench` has no dependencies.
- Upgrade `Jest Bench` machine from `n2-highmem-16` to `c4d-standard-16`
and adds hyperdisk.
  - Reduces runtime from 51 min to 26 min.

(cherry picked from commit 2e33182)
kibanamachine pushed a commit to kibanamachine/kibana that referenced this pull request Feb 12, 2026
## Summary

The `FTR Bench` step can block the build from finishing, so we want to
get the run time down and start sooner. It currently takes ~90 minutes
to finish. After these changes, it is ~45 minutes.

- Reverts elastic#252437
- Upgrade machine to `c2d -> c4d` and use hyperdisk. This reduces
runtime by ~6 minutes.
- Removes `fleet` config from being benchmarked. This reduces runtime by
~17 minutes.
- Removes one iteration of testing in FTR Bench. This reduces runtime by
~25 minutes.
- Due to elastic#252200, the benchmarking steps now start with the pre checks.
This will start them ~25 minutes sooner.
- `FTR Bench` builds it's own distributables, and thus has no other step
dependencies. If these builds fail, the bench doesn't run.
  - `Jest Bench` has no dependencies.
- Upgrade `Jest Bench` machine from `n2-highmem-16` to `c4d-standard-16`
and adds hyperdisk.
  - Reduces runtime from 51 min to 26 min.

(cherry picked from commit 2e33182)
kibanamachine added a commit that referenced this pull request Feb 12, 2026
# Backport

This will backport the following commits from `main` to `9.3`:
- [[CI] Reduce FTR and Jest bench runtime
(#252198)](#252198)

<!--- Backport version: 9.6.6 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)

<!--BACKPORT [{"author":{"name":"Brad
White","email":"Ikuni17@users.noreply.github.com"},"sourceCommit":{"committedDate":"2026-02-12T05:55:01Z","message":"[CI]
Reduce FTR and Jest bench runtime (#252198)\n\n## Summary\n\nThe `FTR
Bench` step can block the build from finishing, so we want to\nget the
run time down and start sooner. It currently takes ~90 minutes\nto
finish. After these changes, it is ~45 minutes.\n\n- Reverts #252437\n-
Upgrade machine to `c2d -> c4d` and use hyperdisk. This reduces\nruntime
by ~6 minutes.\n- Removes `fleet` config from being benchmarked. This
reduces runtime by\n~17 minutes.\n- Removes one iteration of testing in
FTR Bench. This reduces runtime by\n~25 minutes.\n- Due to #252200, the
benchmarking steps now start with the pre checks.\nThis will start them
~25 minutes sooner.\n- `FTR Bench` builds it's own distributables, and
thus has no other step\ndependencies. If these builds fail, the bench
doesn't run.\n - `Jest Bench` has no dependencies.\n- Upgrade `Jest
Bench` machine from `n2-highmem-16` to `c4d-standard-16`\nand adds
hyperdisk.\n - Reduces runtime from 51 min to 26
min.","sha":"2e33182d5ddaf7073df2d493d78cfe6b1bf606b8","branchLabelMapping":{"^v9.4.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","backport:version","ci:bench-jest","v9.4.0","v9.3.1","v9.2.6"],"title":"[CI]
Reduce FTR and Jest bench
runtime","number":252198,"url":"https://github.com/elastic/kibana/pull/252198","mergeCommit":{"message":"[CI]
Reduce FTR and Jest bench runtime (#252198)\n\n## Summary\n\nThe `FTR
Bench` step can block the build from finishing, so we want to\nget the
run time down and start sooner. It currently takes ~90 minutes\nto
finish. After these changes, it is ~45 minutes.\n\n- Reverts #252437\n-
Upgrade machine to `c2d -> c4d` and use hyperdisk. This reduces\nruntime
by ~6 minutes.\n- Removes `fleet` config from being benchmarked. This
reduces runtime by\n~17 minutes.\n- Removes one iteration of testing in
FTR Bench. This reduces runtime by\n~25 minutes.\n- Due to #252200, the
benchmarking steps now start with the pre checks.\nThis will start them
~25 minutes sooner.\n- `FTR Bench` builds it's own distributables, and
thus has no other step\ndependencies. If these builds fail, the bench
doesn't run.\n - `Jest Bench` has no dependencies.\n- Upgrade `Jest
Bench` machine from `n2-highmem-16` to `c4d-standard-16`\nand adds
hyperdisk.\n - Reduces runtime from 51 min to 26
min.","sha":"2e33182d5ddaf7073df2d493d78cfe6b1bf606b8"}},"sourceBranch":"main","suggestedTargetBranches":["9.3","9.2"],"targetPullRequestStates":[{"branch":"main","label":"v9.4.0","branchLabelMappingKey":"^v9.4.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/252198","number":252198,"mergeCommit":{"message":"[CI]
Reduce FTR and Jest bench runtime (#252198)\n\n## Summary\n\nThe `FTR
Bench` step can block the build from finishing, so we want to\nget the
run time down and start sooner. It currently takes ~90 minutes\nto
finish. After these changes, it is ~45 minutes.\n\n- Reverts #252437\n-
Upgrade machine to `c2d -> c4d` and use hyperdisk. This reduces\nruntime
by ~6 minutes.\n- Removes `fleet` config from being benchmarked. This
reduces runtime by\n~17 minutes.\n- Removes one iteration of testing in
FTR Bench. This reduces runtime by\n~25 minutes.\n- Due to #252200, the
benchmarking steps now start with the pre checks.\nThis will start them
~25 minutes sooner.\n- `FTR Bench` builds it's own distributables, and
thus has no other step\ndependencies. If these builds fail, the bench
doesn't run.\n - `Jest Bench` has no dependencies.\n- Upgrade `Jest
Bench` machine from `n2-highmem-16` to `c4d-standard-16`\nand adds
hyperdisk.\n - Reduces runtime from 51 min to 26
min.","sha":"2e33182d5ddaf7073df2d493d78cfe6b1bf606b8"}},{"branch":"9.3","label":"v9.3.1","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"9.2","label":"v9.2.6","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}]
BACKPORT-->

Co-authored-by: Brad White <Ikuni17@users.noreply.github.com>
kibanamachine added a commit that referenced this pull request Feb 12, 2026
# Backport

This will backport the following commits from `main` to `9.2`:
- [[CI] Reduce FTR and Jest bench runtime
(#252198)](#252198)

<!--- Backport version: 9.6.6 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)

<!--BACKPORT [{"author":{"name":"Brad
White","email":"Ikuni17@users.noreply.github.com"},"sourceCommit":{"committedDate":"2026-02-12T05:55:01Z","message":"[CI]
Reduce FTR and Jest bench runtime (#252198)\n\n## Summary\n\nThe `FTR
Bench` step can block the build from finishing, so we want to\nget the
run time down and start sooner. It currently takes ~90 minutes\nto
finish. After these changes, it is ~45 minutes.\n\n- Reverts #252437\n-
Upgrade machine to `c2d -> c4d` and use hyperdisk. This reduces\nruntime
by ~6 minutes.\n- Removes `fleet` config from being benchmarked. This
reduces runtime by\n~17 minutes.\n- Removes one iteration of testing in
FTR Bench. This reduces runtime by\n~25 minutes.\n- Due to #252200, the
benchmarking steps now start with the pre checks.\nThis will start them
~25 minutes sooner.\n- `FTR Bench` builds it's own distributables, and
thus has no other step\ndependencies. If these builds fail, the bench
doesn't run.\n - `Jest Bench` has no dependencies.\n- Upgrade `Jest
Bench` machine from `n2-highmem-16` to `c4d-standard-16`\nand adds
hyperdisk.\n - Reduces runtime from 51 min to 26
min.","sha":"2e33182d5ddaf7073df2d493d78cfe6b1bf606b8","branchLabelMapping":{"^v9.4.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","backport:version","ci:bench-jest","v9.4.0","v9.3.1","v9.2.6"],"title":"[CI]
Reduce FTR and Jest bench
runtime","number":252198,"url":"https://github.com/elastic/kibana/pull/252198","mergeCommit":{"message":"[CI]
Reduce FTR and Jest bench runtime (#252198)\n\n## Summary\n\nThe `FTR
Bench` step can block the build from finishing, so we want to\nget the
run time down and start sooner. It currently takes ~90 minutes\nto
finish. After these changes, it is ~45 minutes.\n\n- Reverts #252437\n-
Upgrade machine to `c2d -> c4d` and use hyperdisk. This reduces\nruntime
by ~6 minutes.\n- Removes `fleet` config from being benchmarked. This
reduces runtime by\n~17 minutes.\n- Removes one iteration of testing in
FTR Bench. This reduces runtime by\n~25 minutes.\n- Due to #252200, the
benchmarking steps now start with the pre checks.\nThis will start them
~25 minutes sooner.\n- `FTR Bench` builds it's own distributables, and
thus has no other step\ndependencies. If these builds fail, the bench
doesn't run.\n - `Jest Bench` has no dependencies.\n- Upgrade `Jest
Bench` machine from `n2-highmem-16` to `c4d-standard-16`\nand adds
hyperdisk.\n - Reduces runtime from 51 min to 26
min.","sha":"2e33182d5ddaf7073df2d493d78cfe6b1bf606b8"}},"sourceBranch":"main","suggestedTargetBranches":["9.3","9.2"],"targetPullRequestStates":[{"branch":"main","label":"v9.4.0","branchLabelMappingKey":"^v9.4.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/252198","number":252198,"mergeCommit":{"message":"[CI]
Reduce FTR and Jest bench runtime (#252198)\n\n## Summary\n\nThe `FTR
Bench` step can block the build from finishing, so we want to\nget the
run time down and start sooner. It currently takes ~90 minutes\nto
finish. After these changes, it is ~45 minutes.\n\n- Reverts #252437\n-
Upgrade machine to `c2d -> c4d` and use hyperdisk. This reduces\nruntime
by ~6 minutes.\n- Removes `fleet` config from being benchmarked. This
reduces runtime by\n~17 minutes.\n- Removes one iteration of testing in
FTR Bench. This reduces runtime by\n~25 minutes.\n- Due to #252200, the
benchmarking steps now start with the pre checks.\nThis will start them
~25 minutes sooner.\n- `FTR Bench` builds it's own distributables, and
thus has no other step\ndependencies. If these builds fail, the bench
doesn't run.\n - `Jest Bench` has no dependencies.\n- Upgrade `Jest
Bench` machine from `n2-highmem-16` to `c4d-standard-16`\nand adds
hyperdisk.\n - Reduces runtime from 51 min to 26
min.","sha":"2e33182d5ddaf7073df2d493d78cfe6b1bf606b8"}},{"branch":"9.3","label":"v9.3.1","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"9.2","label":"v9.2.6","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}]
BACKPORT-->

Co-authored-by: Brad White <Ikuni17@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport:all-open Backport to all branches that could still receive a release release_note:skip Skip the PR/issue when compiling release notes v8.19.12 v9.2.6 v9.3.0 v9.4.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants