Skip to content

[ML] Explain Log Rate Spikes: Limit fields for frequent_items agg.#143974

Merged
walterra merged 4 commits intoelastic:mainfrom
walterra:ml-aiops-analytics-limit-frequent-items-fields
Oct 27, 2022
Merged

[ML] Explain Log Rate Spikes: Limit fields for frequent_items agg.#143974
walterra merged 4 commits intoelastic:mainfrom
walterra:ml-aiops-analytics-limit-frequent-items-fields

Conversation

@walterra
Copy link
Contributor

Summary

Part of #142568.

Limits the fields we pass on to the frequent_items aggregation to 15. This is a trade off between speed and quality of the grouping result. The amount of fields we pass on to the agg grow the time it takes to get frequent items more than linearly and we risk timeouts with more fields.

Checklist

@walterra walterra added :ml backport:skip This PR does not require backporting Feature:ML/AIOps ML AIOps features: Change Point Detection, Log Pattern Analysis, Log Rate Analysis v8.6.0 labels Oct 25, 2022
@walterra walterra self-assigned this Oct 25, 2022
@walterra walterra requested a review from a team as a code owner October 25, 2022 16:53
@elasticmachine
Copy link
Contributor

Pinging @elastic/ml-ui (:ml)

@walterra walterra added release_note:skip Skip the PR/issue when compiling release notes and removed backport:skip This PR does not require backporting labels Oct 25, 2022
return p;
}, []);

// TODO add query params
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this todo still neccessary?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Removed in ed1f725.

@qn895
Copy link
Member

qn895 commented Oct 26, 2022

Code LGTM 🎉

@kibana-ci
Copy link

💚 Build Succeeded

Metrics [docs]

✅ unchanged

History

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

cc @walterra

Copy link
Member

@jgowdyelastic jgowdyelastic left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@walterra walterra merged commit 0092f0a into elastic:main Oct 27, 2022
@kibanamachine kibanamachine added the backport:skip This PR does not require backporting label Oct 27, 2022
@walterra walterra deleted the ml-aiops-analytics-limit-frequent-items-fields branch October 27, 2022 12:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport:skip This PR does not require backporting Feature:ML/AIOps ML AIOps features: Change Point Detection, Log Pattern Analysis, Log Rate Analysis :ml release_note:skip Skip the PR/issue when compiling release notes v8.6.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants