Skip to content

Conversation

@dgieselaar
Copy link
Contributor

@dgieselaar dgieselaar commented Oct 10, 2025

Currently we only measure the root suite duration, which does not include the time to start Elasticsearch, Kibana (which are started before Mocha runs) and the docker containers (which are in the beforeTests lifecycle).

With this change, we start tracking A) total process duration which will capture these phases, B) test stats, so we can see the distribution of test counts across configs and the relation between test counts and process/test run duration

@dgieselaar dgieselaar added release_note:skip Skip the PR/issue when compiling release notes backport:version Backport to applied version labels v9.2.0 v9.3.0 labels Oct 10, 2025
@dolaru dolaru self-requested a review October 13, 2025 10:32
@dgieselaar dgieselaar marked this pull request as ready for review October 13, 2025 11:23
@dgieselaar dgieselaar requested a review from a team as a code owner October 13, 2025 11:23
@elasticmachine
Copy link
Contributor

elasticmachine commented Oct 13, 2025

💔 Build Failed

Failed CI Steps

Metrics [docs]

Public APIs missing comments

Total count of every public API that lacks a comment. Target amount is 0. Run node scripts/build_api_docs --plugin [yourplugin] --stats comments for more detailed information.

id before after diff
@kbn/scout-reporting 109 111 +2
Unknown metric groups

API count

id before after diff
@kbn/scout-reporting 128 130 +2

History

cc @dgieselaar

Copy link
Contributor

@dolaru dolaru left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM 👍🏽

@dgieselaar dgieselaar added backport:all-open Backport to all branches that could still receive a release and removed backport:version Backport to applied version labels v9.2.0 v9.3.0 labels Oct 14, 2025
@dgieselaar dgieselaar merged commit 086c290 into elastic:main Oct 14, 2025
13 checks passed
@kibanamachine
Copy link
Contributor

Starting backport for target branches: 8.18, 8.19, 9.1, 9.2

https://github.com/elastic/kibana/actions/runs/18500172047

kibanamachine pushed a commit to kibanamachine/kibana that referenced this pull request Oct 14, 2025
Currently we only measure the root suite duration, which does not
include the time to start Elasticsearch, Kibana (which are started
before Mocha runs) and the docker containers (which are in the
`beforeTests` lifecycle).

With this change, we start tracking A) total process duration which will
capture these phases, B) test stats, so we can see the distribution of
test counts across configs and the relation between test counts and
process/test run duration

(cherry picked from commit 086c290)
kibanamachine pushed a commit to kibanamachine/kibana that referenced this pull request Oct 14, 2025
Currently we only measure the root suite duration, which does not
include the time to start Elasticsearch, Kibana (which are started
before Mocha runs) and the docker containers (which are in the
`beforeTests` lifecycle).

With this change, we start tracking A) total process duration which will
capture these phases, B) test stats, so we can see the distribution of
test counts across configs and the relation between test counts and
process/test run duration

(cherry picked from commit 086c290)
@kibanamachine
Copy link
Contributor

💔 Some backports could not be created

Status Branch Result
8.18 Backport failed because of merge conflicts

You might need to backport the following PRs to 8.18:
- SKA: Relocate "platform" packages that remain on /packages (#208704)
8.19 Backport failed because of merge conflicts

You might need to backport the following PRs to 8.19:
- [Scout] Capture test run target, mode and parallel info (#229846)
9.1
9.2

Note: Successful backport PRs will be merged automatically after passing CI.

Manual backport

To create the backport manually run:

node scripts/backport --pr 238397

Questions ?

Please refer to the Backport tool documentation

kibanamachine added a commit that referenced this pull request Oct 14, 2025
…238923)

# Backport

This will backport the following commits from `main` to `9.1`:
- [[FTR] Track process duration + test stats in run-end
(#238397)](#238397)

<!--- Backport version: 9.6.6 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)

<!--BACKPORT [{"author":{"name":"Dario
Gieselaar","email":"dario.gieselaar@elastic.co"},"sourceCommit":{"committedDate":"2025-10-14T14:36:17Z","message":"[FTR]
Track process duration + test stats in run-end (#238397)\n\nCurrently we
only measure the root suite duration, which does not\ninclude the time
to start Elasticsearch, Kibana (which are started\nbefore Mocha runs)
and the docker containers (which are in the\n`beforeTests`
lifecycle).\n\nWith this change, we start tracking A) total process
duration which will\ncapture these phases, B) test stats, so we can see
the distribution of\ntest counts across configs and the relation between
test counts and\nprocess/test run
duration","sha":"086c2900f274de0239dccb82595b93a883fa946b","branchLabelMapping":{"^v9.3.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","backport:all-open","v9.3.0"],"title":"[FTR]
Track process duration + test stats in
run-end","number":238397,"url":"https://github.com/elastic/kibana/pull/238397","mergeCommit":{"message":"[FTR]
Track process duration + test stats in run-end (#238397)\n\nCurrently we
only measure the root suite duration, which does not\ninclude the time
to start Elasticsearch, Kibana (which are started\nbefore Mocha runs)
and the docker containers (which are in the\n`beforeTests`
lifecycle).\n\nWith this change, we start tracking A) total process
duration which will\ncapture these phases, B) test stats, so we can see
the distribution of\ntest counts across configs and the relation between
test counts and\nprocess/test run
duration","sha":"086c2900f274de0239dccb82595b93a883fa946b"}},"sourceBranch":"main","suggestedTargetBranches":[],"targetPullRequestStates":[{"branch":"main","label":"v9.3.0","branchLabelMappingKey":"^v9.3.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/238397","number":238397,"mergeCommit":{"message":"[FTR]
Track process duration + test stats in run-end (#238397)\n\nCurrently we
only measure the root suite duration, which does not\ninclude the time
to start Elasticsearch, Kibana (which are started\nbefore Mocha runs)
and the docker containers (which are in the\n`beforeTests`
lifecycle).\n\nWith this change, we start tracking A) total process
duration which will\ncapture these phases, B) test stats, so we can see
the distribution of\ntest counts across configs and the relation between
test counts and\nprocess/test run
duration","sha":"086c2900f274de0239dccb82595b93a883fa946b"}}]}]
BACKPORT-->

Co-authored-by: Dario Gieselaar <dario.gieselaar@elastic.co>
kibanamachine added a commit that referenced this pull request Oct 14, 2025
…238924)

# Backport

This will backport the following commits from `main` to `9.2`:
- [[FTR] Track process duration + test stats in run-end
(#238397)](#238397)

<!--- Backport version: 9.6.6 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)

<!--BACKPORT [{"author":{"name":"Dario
Gieselaar","email":"dario.gieselaar@elastic.co"},"sourceCommit":{"committedDate":"2025-10-14T14:36:17Z","message":"[FTR]
Track process duration + test stats in run-end (#238397)\n\nCurrently we
only measure the root suite duration, which does not\ninclude the time
to start Elasticsearch, Kibana (which are started\nbefore Mocha runs)
and the docker containers (which are in the\n`beforeTests`
lifecycle).\n\nWith this change, we start tracking A) total process
duration which will\ncapture these phases, B) test stats, so we can see
the distribution of\ntest counts across configs and the relation between
test counts and\nprocess/test run
duration","sha":"086c2900f274de0239dccb82595b93a883fa946b","branchLabelMapping":{"^v9.3.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","backport:all-open","v9.3.0"],"title":"[FTR]
Track process duration + test stats in
run-end","number":238397,"url":"https://github.com/elastic/kibana/pull/238397","mergeCommit":{"message":"[FTR]
Track process duration + test stats in run-end (#238397)\n\nCurrently we
only measure the root suite duration, which does not\ninclude the time
to start Elasticsearch, Kibana (which are started\nbefore Mocha runs)
and the docker containers (which are in the\n`beforeTests`
lifecycle).\n\nWith this change, we start tracking A) total process
duration which will\ncapture these phases, B) test stats, so we can see
the distribution of\ntest counts across configs and the relation between
test counts and\nprocess/test run
duration","sha":"086c2900f274de0239dccb82595b93a883fa946b"}},"sourceBranch":"main","suggestedTargetBranches":[],"targetPullRequestStates":[{"branch":"main","label":"v9.3.0","branchLabelMappingKey":"^v9.3.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/238397","number":238397,"mergeCommit":{"message":"[FTR]
Track process duration + test stats in run-end (#238397)\n\nCurrently we
only measure the root suite duration, which does not\ninclude the time
to start Elasticsearch, Kibana (which are started\nbefore Mocha runs)
and the docker containers (which are in the\n`beforeTests`
lifecycle).\n\nWith this change, we start tracking A) total process
duration which will\ncapture these phases, B) test stats, so we can see
the distribution of\ntest counts across configs and the relation between
test counts and\nprocess/test run
duration","sha":"086c2900f274de0239dccb82595b93a883fa946b"}}]}]
BACKPORT-->

Co-authored-by: Dario Gieselaar <dario.gieselaar@elastic.co>
ersin-erdal pushed a commit to ersin-erdal/kibana that referenced this pull request Oct 15, 2025
Currently we only measure the root suite duration, which does not
include the time to start Elasticsearch, Kibana (which are started
before Mocha runs) and the docker containers (which are in the
`beforeTests` lifecycle).

With this change, we start tracking A) total process duration which will
capture these phases, B) test stats, so we can see the distribution of
test counts across configs and the relation between test counts and
process/test run duration
mgadewoll pushed a commit to tkajtoch/kibana that referenced this pull request Oct 17, 2025
Currently we only measure the root suite duration, which does not
include the time to start Elasticsearch, Kibana (which are started
before Mocha runs) and the docker containers (which are in the
`beforeTests` lifecycle).

With this change, we start tracking A) total process duration which will
capture these phases, B) test stats, so we can see the distribution of
test counts across configs and the relation between test counts and
process/test run duration
rylnd pushed a commit to rylnd/kibana that referenced this pull request Oct 17, 2025
Currently we only measure the root suite duration, which does not
include the time to start Elasticsearch, Kibana (which are started
before Mocha runs) and the docker containers (which are in the
`beforeTests` lifecycle).

With this change, we start tracking A) total process duration which will
capture these phases, B) test stats, so we can see the distribution of
test counts across configs and the relation between test counts and
process/test run duration
nickpeihl pushed a commit to nickpeihl/kibana that referenced this pull request Oct 23, 2025
Currently we only measure the root suite duration, which does not
include the time to start Elasticsearch, Kibana (which are started
before Mocha runs) and the docker containers (which are in the
`beforeTests` lifecycle).

With this change, we start tracking A) total process duration which will
capture these phases, B) test stats, so we can see the distribution of
test counts across configs and the relation between test counts and
process/test run duration
NicholasPeretti pushed a commit to NicholasPeretti/kibana that referenced this pull request Oct 27, 2025
Currently we only measure the root suite duration, which does not
include the time to start Elasticsearch, Kibana (which are started
before Mocha runs) and the docker containers (which are in the
`beforeTests` lifecycle).

With this change, we start tracking A) total process duration which will
capture these phases, B) test stats, so we can see the distribution of
test counts across configs and the relation between test counts and
process/test run duration
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport:all-open Backport to all branches that could still receive a release release_note:skip Skip the PR/issue when compiling release notes v9.1.6 v9.2.0 v9.3.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants