Skip to content

[Entity Store] Change defaults to conservative values#270617

Merged
romulets merged 4 commits into
elastic:mainfrom
romulets:entity-store/change-defaults
May 22, 2026
Merged

[Entity Store] Change defaults to conservative values#270617
romulets merged 4 commits into
elastic:mainfrom
romulets:entity-store/change-defaults

Conversation

@romulets
Copy link
Copy Markdown
Member

@romulets romulets commented May 22, 2026

Summary

Update entity store defaults to a conservative number:

  • maxLogsPerPage: 50k
  • maxLogsPerWindow: 100k

Meaning, we will process at most 50k logs in each query of entity store, and in a single window, if it observes more than 100k logs (two pages) we don't process those logs.

This can be configured via update api to better align with customers' setup and needs.

@romulets romulets requested a review from a team as a code owner May 22, 2026 14:01
@romulets romulets self-assigned this May 22, 2026
@romulets romulets added backport:version Backport to applied version labels v9.4.0 release_note:skip Skip the PR/issue when compiling release notes labels May 22, 2026
@elastic-vault-github-plugin-prod elastic-vault-github-plugin-prod Bot requested a review from a team as a code owner May 22, 2026 14:33
@romulets romulets enabled auto-merge (squash) May 22, 2026 14:36
Copy link
Copy Markdown
Member

@florent-leborgne florent-leborgne left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM for docs

@kibanamachine
Copy link
Copy Markdown
Contributor

💛 Build succeeded, but was flaky

Failed CI Steps

Metrics [docs]

✅ unchanged

History

cc @romulets

@romulets romulets merged commit b9560c5 into elastic:main May 22, 2026
32 checks passed
@kibanamachine
Copy link
Copy Markdown
Contributor

Starting backport for target branches: 9.4

https://github.com/elastic/kibana/actions/runs/26297016087

@kibanamachine
Copy link
Copy Markdown
Contributor

💔 All backports failed

Status Branch Result
9.4 Backport failed because of merge conflicts

You might need to backport the following PRs to 9.4:
- [ES|QL] Handles dom exceptions (#270603)
- [One workflow] 🐞 Include registered triggers in agent builder experience (#270221)
- [Synthetics] Fix monitor health API for monitors in non-default spaces (#270540)
- fix(streams): update default_pipeline on write index when adding processing to a second OTEL metrics stream (#269988)

Manual backport

To create the backport manually run:

node scripts/backport --pr 270617

Questions ?

Please refer to the Backport tool documentation

@romulets
Copy link
Copy Markdown
Member Author

💚 All backports created successfully

Status Branch Result
9.4

Note: Successful backport PRs will be merged automatically after passing CI.

Questions ?

Please refer to the Backport tool documentation

romulets added a commit that referenced this pull request May 25, 2026
…#270915)

# Backport

This will backport the following commits from `main` to `9.4`:
- [[Entity Store] Change defaults to conservative values
(#270617)](#270617)

<!--- Backport version: 11.0.2 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)

<!--BACKPORT [{"author":{"name":"Rômulo
Farias","email":"romulo.farias@elastic.co"},"sourceCommit":{"committedDate":"2026-05-22T15:34:53Z","message":"[Entity
Store] Change defaults to conservative values (#270617)\n\n##
Summary\n\nUpdate entity store defaults to a conservative number:\n-
maxLogsPerPage: 50k \n- maxLogsPerWindow: 100k\n\nMeaning, we will
process at most 50k logs in each query of entity store,\nand in a single
window, if it observes more than 100k logs (two pages)\nwe don't process
those logs.\n\nThis can be configured via update api to better align
with customers'\nsetup and needs.\n\n---------\n\nCo-authored-by:
kibanamachine
<42973632+kibanamachine@users.noreply.github.com>","sha":"b9560c557118b03d3fa340140df992abc81307e8","branchLabelMapping":{"^v9.5.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","backport:version","v9.4.0","v9.5.0"],"title":"[Entity
Store] Change defaults to conservative
values","number":270617,"url":"https://github.com/elastic/kibana/pull/270617","mergeCommit":{"message":"[Entity
Store] Change defaults to conservative values (#270617)\n\n##
Summary\n\nUpdate entity store defaults to a conservative number:\n-
maxLogsPerPage: 50k \n- maxLogsPerWindow: 100k\n\nMeaning, we will
process at most 50k logs in each query of entity store,\nand in a single
window, if it observes more than 100k logs (two pages)\nwe don't process
those logs.\n\nThis can be configured via update api to better align
with customers'\nsetup and needs.\n\n---------\n\nCo-authored-by:
kibanamachine
<42973632+kibanamachine@users.noreply.github.com>","sha":"b9560c557118b03d3fa340140df992abc81307e8"}},"sourceBranch":"main","suggestedTargetBranches":[],"targetPullRequestStates":[{"branch":"9.4","label":"v9.4.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"url":"https://github.com/elastic/kibana/pull/270892","number":270892,"state":"OPEN"},{"branch":"main","label":"v9.5.0","branchLabelMappingKey":"^v9.5.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/270617","number":270617,"mergeCommit":{"message":"[Entity
Store] Change defaults to conservative values (#270617)\n\n##
Summary\n\nUpdate entity store defaults to a conservative number:\n-
maxLogsPerPage: 50k \n- maxLogsPerWindow: 100k\n\nMeaning, we will
process at most 50k logs in each query of entity store,\nand in a single
window, if it observes more than 100k logs (two pages)\nwe don't process
those logs.\n\nThis can be configured via update api to better align
with customers'\nsetup and needs.\n\n---------\n\nCo-authored-by:
kibanamachine
<42973632+kibanamachine@users.noreply.github.com>","sha":"b9560c557118b03d3fa340140df992abc81307e8"}}]}]
BACKPORT-->
jcger pushed a commit that referenced this pull request May 26, 2026
## Summary

Update entity store defaults to a conservative number:
- maxLogsPerPage: 50k  
- maxLogsPerWindow: 100k

Meaning, we will process at most 50k logs in each query of entity store,
and in a single window, if it observes more than 100k logs (two pages)
we don't process those logs.

This can be configured via update api to better align with customers'
setup and needs.

---------

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport:version Backport to applied version labels release_note:skip Skip the PR/issue when compiling release notes v9.4.0 v9.4.2 v9.5.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants