Skip to content

Make ES|QL scoring tests running consistently in serverless#118854

Merged
tteofili merged 6 commits intoelastic:mainfrom
tteofili:books_sharding_scores
Dec 18, 2024
Merged

Make ES|QL scoring tests running consistently in serverless#118854
tteofili merged 6 commits intoelastic:mainfrom
tteofili:books_sharding_scores

Conversation

@tteofili
Copy link
Contributor

This PR enforces _id for each row within the (test) books dataset; this results in document distribution being consistent across shards.
Settings file was also added for the books dataset, to set the number of shards to 3 (to accomodate serverless CI settings).
CSV scoring tests for ES|QL have been fixed and unmuted.

enforce _id in books dataset to make doc distribution across shards consistent.
books settings with 3 shards to accomodate serverless settings.
unmuting scoring tests.
scoring test fixed.
@tteofili tteofili added :Analytics/ES|QL AKA ESQL >test Issues or PRs that are addressing/adding tests auto-backport Automatically create backport pull requests when merged v8.18.0 labels Dec 17, 2024
@tteofili tteofili marked this pull request as ready for review December 17, 2024 20:06
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-analytical-engine (Team:Analytics)

@elasticsearchmachine elasticsearchmachine added the Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) label Dec 17, 2024
Copy link
Contributor

@ioanatia ioanatia left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nice work fixing these tests! I know it was quite tedious!

@tteofili tteofili merged commit 140beb1 into elastic:main Dec 18, 2024
@elasticsearchmachine
Copy link
Collaborator

💔 Backport failed

Status Branch Result
8.x Commit could not be cherrypicked due to conflicts

You can use sqren/backport to manually backport by running backport --upstream elastic/elasticsearch --pr 118854

tteofili added a commit to tteofili/elasticsearch that referenced this pull request Dec 18, 2024
…118854)

* make scoring tests running consistently in serverless

enforce _id in books dataset to make doc distribution across shards consistent.
books settings with 3 shards to accomodate serverless settings.
unmuting scoring tests.
scoring test fixed.

(cherry picked from commit 140beb1)
@tteofili
Copy link
Contributor Author

💚 All backports created successfully

Status Branch Result
8.x

Questions ?

Please refer to the Backport tool documentation

tteofili added a commit that referenced this pull request Dec 18, 2024
…18854) (#118928)

* Make ES|QL scoring tests running consistently in serverless (#118854)

* make scoring tests running consistently in serverless

enforce _id in books dataset to make doc distribution across shards consistent.
books settings with 3 shards to accomodate serverless settings.
unmuting scoring tests.
scoring test fixed.

(cherry picked from commit 140beb1)
rjernst pushed a commit to rjernst/elasticsearch that referenced this pull request Dec 18, 2024
…118854)

* make scoring tests running consistently in serverless

enforce _id in books dataset to make doc distribution across shards consistent.
books settings with 3 shards to accomodate serverless settings.
unmuting scoring tests.
scoring test fixed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

:Analytics/ES|QL AKA ESQL auto-backport Automatically create backport pull requests when merged backport pending Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) >test Issues or PRs that are addressing/adding tests v8.18.0 v9.0.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants