Skip to content

[ML] Job validation uses fieldCaps to check aggregatable fields to avoid triggering Elasticsearch errors.#21087

Merged
walterra merged 1 commit intoelastic:masterfrom
walterra:ml-job-validation-aggregatable-field
Jul 23, 2018
Merged

[ML] Job validation uses fieldCaps to check aggregatable fields to avoid triggering Elasticsearch errors.#21087
walterra merged 1 commit intoelastic:masterfrom
walterra:ml-job-validation-aggregatable-field

Conversation

@walterra
Copy link
Contributor

@walterra walterra commented Jul 23, 2018

Fixes #18516.

While the output in the UI was fine, certain job configurations containing non-aggregatable fields could trigger errors on the Elasticsearch side.

This PR fixes it by adding an additional query for fieldCaps to check first which fields are actually aggregatable.

Review hint: Most changes in the tests files are a refactor to allow the callrequest mocks to return different mock objects based on the types of request because the tests now need to return different data whether the job validation code uses search or fieldCaps.

@elasticmachine
Copy link
Contributor

Pinging @elastic/ml-ui

Copy link
Member

@jgowdyelastic jgowdyelastic left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Contributor

@peteharverson peteharverson left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@elasticmachine
Copy link
Contributor

💔 Build Failed

@walterra
Copy link
Contributor Author

retest

@elasticmachine
Copy link
Contributor

💚 Build Succeeded

@walterra walterra merged commit 3dc5b30 into elastic:master Jul 23, 2018
@walterra walterra deleted the ml-job-validation-aggregatable-field branch July 23, 2018 18:35
walterra added a commit to walterra/kibana that referenced this pull request Jul 24, 2018
…oid triggering Elasticsearch errors. (elastic#21087)

While the output in the UI was fine, certain job configurations containing non-aggregatable fields could trigger errors on the Elasticsearch side.
This PR fixes it by adding an additional query for fieldCaps to check first which fields are actually aggregatable.
walterra added a commit that referenced this pull request Jul 24, 2018
… to avoid triggering Elasticsearch errors. (#21087) (#21104)

While the output in the UI was fine, certain job configurations containing non-aggregatable fields could trigger errors on the Elasticsearch side.
This PR fixes it by adding an additional query for fieldCaps to check first which fields are actually aggregatable.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[ML] Job Validation - elasticsearch error when aggregating _source

4 participants