[AUTOCUT] Gradle Check Flaky Test Report for SmokeTestMultiNodeClientYamlTestSuiteIT

[opensearch-ci-bot]

Flaky Test Report for SmokeTestMultiNodeClientYamlTestSuiteIT

Noticed the SmokeTestMultiNodeClientYamlTestSuiteIT has some flaky, failing tests that failed during post-merge actions.

Details

Git Reference	Merged Pull Request	Build Details	Test Name
1015fa6	15154	44203	org.opensearch.smoketest.SmokeTestMultiNodeClientYamlTestSuiteIT.test {yaml=indices.delete_index_template/10_basic/Delete index template which is not used by data stream but index pattern matches}
1e9fdb4	15410	45949	org.opensearch.smoketest.SmokeTestMultiNodeClientYamlTestSuiteIT.test {yaml=index/91_flat_object_null_value/Supported queries}
481fd38	16098	48529	org.opensearch.smoketest.SmokeTestMultiNodeClientYamlTestSuiteIT.classMethod org.opensearch.smoketest.SmokeTestMultiNodeClientYamlTestSuiteIT.test {yaml=search/340_doc_values_field/search on fields with both index and doc_values enabled}
017f7d4	15704	47021	org.opensearch.smoketest.SmokeTestMultiNodeClientYamlTestSuiteIT.test {yaml=search.aggregation/360_date_histogram/Date histogram aggregation w/ shared field range test}
07029b2	15906	47796	org.opensearch.smoketest.SmokeTestMultiNodeClientYamlTestSuiteIT.test {yaml=search.aggregation/360_date_histogram/Date histogram aggregation w/ shared field range test}
10b955d	15547	46008	org.opensearch.smoketest.SmokeTestMultiNodeClientYamlTestSuiteIT.test {yaml=search.aggregation/360_date_histogram/Date histogram aggregation w/ shared field range test}
61dbcd0	14348	41143	org.opensearch.smoketest.SmokeTestMultiNodeClientYamlTestSuiteIT.test {yaml=search.aggregation/230_composite/composite aggregation date_histogram profile shows filter rewrite info}
81288b1	15957	47925	org.opensearch.smoketest.SmokeTestMultiNodeClientYamlTestSuiteIT.test {yaml=search.aggregation/360_date_histogram/Date histogram aggregation w/ shared field range test}
a24c858	15805	47501	org.opensearch.smoketest.SmokeTestMultiNodeClientYamlTestSuiteIT.test {yaml=search.aggregation/360_date_histogram/Date histogram aggregation w/ shared field range test}
af25ece	15969	48106	org.opensearch.smoketest.SmokeTestMultiNodeClientYamlTestSuiteIT.test {yaml=search.aggregation/360_date_histogram/Date histogram aggregation w/ shared field range test}
e076e66	15348	44994	org.opensearch.smoketest.SmokeTestMultiNodeClientYamlTestSuiteIT.test {yaml=search.aggregation/360_date_histogram/Date histogram aggregation w/ shared field range test}

The other pull requests, besides those involved in post-merge actions, that contain failing tests with the SmokeTestMultiNodeClientYamlTestSuiteIT class are:

• 15131
• 16403
• 14443
• 13865
• 13853
• 13620
• 13821
• 13788
• 14446
• 13232
• 15568
• 13461
• 15124
• 14383
• 15365
• 15012
• 14069
• 14464
• 14613
• 14718
• 15289
• 15545
• 15882
• 13829
• 14273
• 14486
• 14454
• 15462
• 15465
• 15531
• 15575
• 13897
• 13929
• 14711
• 15080
• 15194
• 15358
• 14415
• 14427
• 15017
• 15426
• 15734
• 15990
• 14048
• 14550
• 14625
• 14785
• 14809
• 15077
• 15177
• 15326
• 15328
• 15335
• 15341
• 15381
• 15409
• 15416
• 15418
• 15436
• 15455
• 15457
• 15478
• 15521
• 15549
• 15554
• 15565
• 15566
• 15573
• 15586
• 15621
• 15627
• 15662
• 15695
• 15702
• 15703
• 15723
• 15778
• 15790
• 15887
• 15980
• 16047
• 16150
• 16193
• 16254
• 16421

For more details on the failed tests refer to OpenSearch Gradle Check Metrics dashboard.

[sandeshkr419]

#16067 has fixed tests related to 360_date_histogram

Last reported failures were in #16421 and #16254:

This test detail is not covered in list of tests in issue description, and with last occurrence on 10/25/2024

java.lang.AssertionError: Failure at [search.aggregation/20_terms:1082]: profile.shards.0.aggregations.0.debug.segments_with_multi_valued_ords didn't match expected value:
profile.shards.0.aggregations.0.debug.segments_with_multi_valued_ords: expected Integer [0] but was Integer [1]

REPRODUCE WITH: ./gradlew ':qa:smoke-test-multinode:integTest' --tests "org.opensearch.smoketest.SmokeTestMultiNodeClientYamlTestSuiteIT" -Dtests.method="test {yaml=search.aggregation/20_terms/string profiler via global ordinals}" -Dtests.seed=5547B5C90D78DE0F -Dtests.security.manager=true -Dtests.jvm.argline="-XX:TieredStopAtLevel=1 -XX:ReservedCodeCacheSize=64m" -Dtests.locale=ja-Jpan-JP -Dtests.timezone=Mexico/BajaSur -Druntime.java=21

REPRODUCE WITH: ./gradlew ':qa:smoke-test-multinode:integTest' --tests "org.opensearch.smoketest.SmokeTestMultiNodeClientYamlTestSuiteIT" -Dtests.method="test {yaml=search.aggregation/20_terms/string profiler via global ordinals}" -Dtests.seed=47181BE7B412E53 -Dtests.security.manager=true -Dtests.jvm.argline="-XX:TieredStopAtLevel=1 -XX:ReservedCodeCacheSize=64m" -Dtests.locale=sd-PK -Dtests.timezone=America/Guayaquil -Druntime.java=23

Tried reproducing using the same seeds as above, but not able to reproduce.

---

Build details not retained for previous builds, meaning tests in description haven't failed since Oct 9. Checking further if we fixed those tests indirectly.

Will wait and observe if there are new failures in couple days, else will close it out since the bot will recreate the issue with fresh details or reopen it.