Skip to content

Conversation

@przemekwitek
Copy link
Contributor

@przemekwitek przemekwitek commented Mar 9, 2020

This PR performs evaluation aggregations in batches when performing a single request would cause too_many_buckets_exception.

It takes into account the search.max_buckets setting. The setting is passed to all the metrics using Settings object so the interface of EvaluationMetric::aggs method had to be extended.

For the default value of search.max_buckets setting (10000) there will be more than 100 sequential steps making the _evaluate request somewhat slow. But for now I think it's better to provide slow response rather than no response at all.

@przemekwitek przemekwitek force-pushed the fix_evaluation_bug branch 4 times, most recently from 1ab682c to baff92b Compare March 11, 2020 07:05
@przemekwitek przemekwitek marked this pull request as ready for review March 11, 2020 07:52
@przemekwitek przemekwitek added :ml Machine learning >bug v7.7.0 v8.0.0 and removed WIP labels Mar 11, 2020
@elasticmachine
Copy link
Collaborator

Pinging @elastic/ml-core (:ml)

@przemekwitek
Copy link
Contributor Author

run elasticsearch-ci/default-distro
run elasticsearch-ci/bwc

@przemekwitek
Copy link
Contributor Author

run elasticsearch-ci/bwc

Copy link

@droberts195 droberts195 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants