Skip to content

Conversation

@ahkcs
Copy link
Contributor

@ahkcs ahkcs commented Aug 29, 2025

Description

Cherry-picked from #3878

opensearch-trigger-bot bot and others added 30 commits February 19, 2025 15:20
Signed-off-by: opensearch-ci-bot <[email protected]>
Co-authored-by: opensearch-ci-bot <[email protected]>
Signed-off-by: opensearch-ci-bot <[email protected]>
Signed-off-by: Zelin Hao <[email protected]>
Co-authored-by: opensearch-ci-bot <[email protected]>
…oject#3160) (opensearch-project#3597)

* Test cases



* Minimise code changes



* Format



* Update integration test



* Update unit test



---------


(cherry picked from commit eb88e3c)

Signed-off-by: Andy Kwok <[email protected]>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Signed-off-by: opensearch-ci-bot <[email protected]>
Co-authored-by: opensearch-ci-bot <[email protected]>
…ject#3075)

Signed-off-by: Norman Jordan <[email protected]>
Signed-off-by: normanj-bitquill <[email protected]>
Co-authored-by: Andrew Carbonetto <[email protected]>
Signed-off-by: xinyual <[email protected]>
* Add trendline (With SWA) PPL command

---------

Signed-off-by: James Duong <[email protected]>
Signed-off-by: Andrew Carbonetto <[email protected]>
Co-authored-by: Andrew Carbonetto <[email protected]>
Signed-off-by: xinyual <[email protected]>
Signed-off-by: currantw <[email protected]>

* Add support for casting (`cast(field_name to ip)`) and remove existing unused sorting syntax.

Signed-off-by: currantw <[email protected]>

* Update comparison logic to compare in IPv6

Signed-off-by: currantw <[email protected]>

* Fix bug casting to IP

Signed-off-by: currantw <[email protected]>

* Fix failing tests

Signed-off-by: currantw <[email protected]>

* Assert that comparison only valid if same type, update tests accordingly

Signed-off-by: currantw <[email protected]>

* Add additional tests to increase code coverage

Signed-off-by: currantw <[email protected]>

* Integrate `cidrmatch` changes

Signed-off-by: currantw <[email protected]>

* Remove `OpenSearchIPType` data type

Signed-off-by: currantw <[email protected]>

* Fix more failing tests

Signed-off-by: currantw <[email protected]>

* Minor cleanup

Signed-off-by: currantw <[email protected]>

* Add new tests for IP data type to `SortCommandIT`, and update `weblogs` test data.

Signed-off-by: currantw <[email protected]>

* Fixing IT test failure.

Signed-off-by: currantw <[email protected]>

* Spotless and update test to sort in SQL

Signed-off-by: currantw <[email protected]>

* Fix broken link

Signed-off-by: currantw <[email protected]>

* Fix failing code coverage

Signed-off-by: currantw <[email protected]>

* Fix failing doctest

Signed-off-by: currantw <[email protected]>

* Fix failing `ip.rst` doctest

Signed-off-by: currantw <[email protected]>

* Fix test failure due to merge.

Signed-off-by: currantw <[email protected]>

* Fix spotless

Signed-off-by: currantw <[email protected]>

* Add missing `url` field

Signed-off-by: currantw <[email protected]>

* Address minor review comments.

Signed-off-by: currantw <[email protected]>

* Revert sort syntax changes

Signed-off-by: currantw <[email protected]>

* Minor doc update

Signed-off-by: currantw <[email protected]>

* FIx failing `ip.rst` doctest

Signed-off-by: currantw <[email protected]>

* Add `IPComparisonIT` tests for comparison operators, rename modules and weblogs test index to make plural for consistency.

Signed-off-by: currantw <[email protected]>

---------

Signed-off-by: currantw <[email protected]>
Signed-off-by: xinyual <[email protected]>
…er (opensearch-project#3249)

* First commit for Calcite integration

Signed-off-by: Lantao Jin <[email protected]>

* disable java security manager in IT

Signed-off-by: Lantao Jin <[email protected]>

---------

Signed-off-by: Lantao Jin <[email protected]>
Signed-off-by: xinyual <[email protected]>
…ject#3258)

* [POC] Make Calcite execute successfully

Signed-off-by: Heng Qian <[email protected]>

* [POC] Change caching schema to simple schema and avoid registering table when visitRelation.

Signed-off-by: Heng Qian <[email protected]>

* spotlessApply

Signed-off-by: Heng Qian <[email protected]>

* address comments

Signed-off-by: Heng Qian <[email protected]>

---------

Signed-off-by: Heng Qian <[email protected]>
Signed-off-by: xinyual <[email protected]>
* Make basic aggregation working (partial)

Signed-off-by: Lantao Jin <[email protected]>

* add a settings to enable calcite

Signed-off-by: Lantao Jin <[email protected]>

* add more UTs

Signed-off-by: Lantao Jin <[email protected]>

---------

Signed-off-by: Lantao Jin <[email protected]>
Signed-off-by: xinyual <[email protected]>
opensearch-project#3327)

* Support Filter and Project pushdown

Signed-off-by: Heng Qian <[email protected]>

* Support Filter and Project pushdown v2

Signed-off-by: Heng Qian <[email protected]>

* Address comments

Signed-off-by: Heng Qian <[email protected]>

* Add original license for PredicateAnalyzer

Signed-off-by: Heng Qian <[email protected]>

---------

Signed-off-by: Heng Qian <[email protected]>
Signed-off-by: xinyual <[email protected]>
* Build integration test framework

Signed-off-by: Lantao Jin <[email protected]>

* make local work

Signed-off-by: Lantao Jin <[email protected]>

* Fix the timestamp issue

Signed-off-by: Lantao Jin <[email protected]>

* address comments

Signed-off-by: Lantao Jin <[email protected]>

* fix java style and rename CalcitePPLTestCase back to CalcitePPLIntegTestCase

Signed-off-by: Lantao Jin <[email protected]>

---------

Signed-off-by: Lantao Jin <[email protected]>
Signed-off-by: xinyual <[email protected]>
…oject#3355)

* Add more aggregation tests

Signed-off-by: Lantao Jin <[email protected]>

* delete unrelavant code

Signed-off-by: Lantao Jin <[email protected]>

---------

Signed-off-by: Lantao Jin <[email protected]>
Signed-off-by: xinyual <[email protected]>
* Transform to calcite plan before executing

Signed-off-by: Heng Qian <[email protected]>

* Fix bug for single column row

Signed-off-by: Heng Qian <[email protected]>

* Add settings for calcite pushdown

Signed-off-by: Heng Qian <[email protected]>

* Lazily construct OpenSearchRequestBuilder and do push down

Signed-off-by: Heng Qian <[email protected]>

* Address comments and disable push down

Signed-off-by: Heng Qian <[email protected]>

---------

Signed-off-by: Heng Qian <[email protected]>
Signed-off-by: xinyual <[email protected]>
* Fix PredicateAnalyzer for in and notIn

Signed-off-by: Heng Qian <[email protected]>

* Change text field to keyword since we don't support push down for that type

Signed-off-by: Heng Qian <[email protected]>

---------

Signed-off-by: Heng Qian <[email protected]>
Signed-off-by: xinyual <[email protected]>
Signed-off-by: xinyual <[email protected]>
Signed-off-by: xinyual <[email protected]>
…3376)

* [BugFix] Fix text field push down

Signed-off-by: Heng Qian <[email protected]>

* Ignore CalciteSortCommandIT.testSortWithNullValue

Signed-off-by: Heng Qian <[email protected]>

* Refine code: only get keyword subfield for termQuery builder

Signed-off-by: Heng Qian <[email protected]>

* Refine code

Signed-off-by: Heng Qian <[email protected]>

* remove ignore tests in CalcitePPLInSubqueryIT

Signed-off-by: Heng Qian <[email protected]>

---------

Signed-off-by: Heng Qian <[email protected]>
Signed-off-by: xinyual <[email protected]>
* add udf/udaf interface and take/sqrt function

Signed-off-by: xinyual <[email protected]>

* add UT

Signed-off-by: xinyual <[email protected]>

* add POW, Atan, Atan2 and corresponding UT

Signed-off-by: xinyual <[email protected]>

* apply spotless

Signed-off-by: xinyual <[email protected]>

* fix table for join it

Signed-off-by: xinyual <[email protected]>

* add java doc

Signed-off-by: xinyual <[email protected]>

* apply spotless

Signed-off-by: xinyual <[email protected]>

---------

Signed-off-by: xinyual <[email protected]>
…t#3392)

* Implement ppl scalar subquery command with Calcite

Signed-off-by: Lantao Jin <[email protected]>

* more general subquery checker

Signed-off-by: Lantao Jin <[email protected]>

* support correlated IN subquery

Signed-off-by: Lantao Jin <[email protected]>

---------

Signed-off-by: Lantao Jin <[email protected]>
Signed-off-by: xinyual <[email protected]>
* Change push down to logical index scan

Signed-off-by: Heng Qian <[email protected]>

* Support Aggregate Push Down

Signed-off-by: Heng Qian <[email protected]>

* Rebase and resolve conflict

Signed-off-by: Heng Qian <[email protected]>

* Add TODO

Signed-off-by: Heng Qian <[email protected]>

* Address comments

Signed-off-by: Heng Qian <[email protected]>

---------

Signed-off-by: Heng Qian <[email protected]>
Signed-off-by: xinyual <[email protected]>
* add string udfs

Signed-off-by: xinyual <[email protected]>

* add it to string

Signed-off-by: xinyual <[email protected]>

* add IT for string function

Signed-off-by: xinyual <[email protected]>

* remove change for local test

Signed-off-by: xinyual <[email protected]>

* revert change

Signed-off-by: xinyual <[email protected]>

---------

Signed-off-by: xinyual <[email protected]>
qianheng-aws and others added 29 commits August 4, 2025 09:51
…opensearch-project#3966)

* Append limit operator for QUEERY_SIZE_LIMIT



* Add LogicalSystemLimit



* Revert part of opensearch-project#3880



* Fix IT after merging main



---------


(cherry picked from commit 5316c0a)

Signed-off-by: Heng Qian <[email protected]>
…ect#3948)

* Fix create PIT permissions issue (opensearch-project#3921)

Signed-off-by: Vamsi Manohar <[email protected]>
(cherry picked from commit 739c4df)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

* Fix json string formatting with earlier java versions

Signed-off-by: Vamsi Manohar <[email protected]>

---------

Signed-off-by: Vamsi Manohar <[email protected]>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Vamsi Manohar <[email protected]>
…pensearch-project#3976)

(cherry picked from commit db2a8bf)

Signed-off-by: Heng Qian <[email protected]>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
…ect#3952) (opensearch-project#3977)

* Disable a failed PPL query fallback to v2 by default



* Workaround the permissionIT



---------


(cherry picked from commit 7892b90)

Signed-off-by: Lantao Jin <[email protected]>
) (opensearch-project#3968)

* Change the use of SqlTypeFamily.STRING to SqlTypeFamily.CHARACTER as the string family contains binary, which is not expected for most functions



* Implement basic argument type coercion at RelNode level



* Conform type checkers with their definition in documentation
- string as an input is removed if it is not in the document
- string as an input is kept if it is in the document, even if it can be implicitly cast
- use PPLOperandTypes as much as possible



* Implement type widening for comparator functions

- Add COMPARATORS set to BuiltinFunctionName for identifying comparison operators
- Implement widenArguments method in CoercionUtils to find widest compatible type
- Apply type widening to comparator functions before applying type casting
- Add detailed JavaDoc to explain coercion methods



* Update error messages of datetime functions with invalid args



* Simplify datetime-string compare logic with implict coercion



* Refactor resolve with coercion



* Move down argument cast for reduce function



* Merge comparators and their IP variants so that coercion works for IP comparison

- when not merging, ip comparing will also pass the type checker of Calcite's comparators



* Refactor ip comparator to comparator



* Revert "Refactor ip comparator to comparator"

This reverts commit c539056.



* Revert "Merge comparators and their IP variants so that coercion works for IP comparison"

This reverts commit bd9f3bb.



* Rule out ip from built-in comparator via its type checker



* Restrict CompareIP's parameter type



* Revert to previous implementation of CompareIpFunction to temporarily fix ip comparison pushdown problems (udt not correctly serialized; ip comparison is not converted to range query)



* Test argument coercion explain



* Fix error msg in CalcitePPLFunctionTypeTest



---------


(cherry picked from commit 484f49e)

Signed-off-by: Yuanchun Shen <[email protected]>
…-project#3806) (opensearch-project#3979)

(cherry picked from commit 7ccdcd1)

Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Sayali Gaikawad <[email protected]>
…nsearch-project#3991)

* Implement reverse



* Add reverse integ tests and unit tests



* Add reverse documentation



* Modify reverse test and documentation



* Fix limit pushdown bug when reverse comes before head

* Revert "Fix limit pushdown bug when reverse comes before head"

This reverts commit 087c936.



* Fix grammar, naming, and test cases. Pushdown reverted will be in 2nd PR.



* Fix reverse tests: update logical plans, format with Spotless

- Updated expected logical plans and Spark SQL in reverse tests
- Applied Spotless to fix formatting



* Fix OS version in build 3.1.0



* Add note on limitation to rst



* Move explain IT to correct file, add Anonymizer test



* Add reverse to index.rst



---------



(cherry picked from commit c05a58c)

Signed-off-by: Selina Song <[email protected]>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Selina Song <[email protected]>
…4011)

* add math udfs



* fix decimal bug



* make general udf adapter



* add math IT



* fix



* add rst



* fix error



* change signum IT



* add javadoc



---------


(cherry picked from commit d6aac3c)

Signed-off-by: Xinyu Hao <[email protected]>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
…ilter (opensearch-project#4022)

* Prevent aggregation push down when it has inner filter (opensearch-project#4002)

* Prevent aggregation push down when it has inner filter

Signed-off-by: Heng Qian <[email protected]>

* Fix IT & Remove log

Signed-off-by: Heng Qian <[email protected]>

* Fix 4009

Signed-off-by: Heng Qian <[email protected]>

* Fix IT

Signed-off-by: Heng Qian <[email protected]>

---------

Signed-off-by: Heng Qian <[email protected]>
(cherry picked from commit 6e3329f)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

* Fix IT

Signed-off-by: Heng Qian <[email protected]>

---------

Signed-off-by: Heng Qian <[email protected]>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Heng Qian <[email protected]>
…earch-project#4024) (opensearch-project#4054)

* Remove getTypeChecker from FunctionImp interface



* Refactor registerExternalFunction to registerExternalOperator



* Do not register GEOIP function if got incompatible client



* Create scaffold for type checking of aggregation functions



* Add type checkers for aggregation functions



* Test type checking for aggregation functions



---------


(cherry picked from commit d758163)

Signed-off-by: Yuanchun Shen <[email protected]>
…project#4028)

* Fix span on negative timestamp



* Fix span on negative timestamp



* typo



* Refine code



---------


(cherry picked from commit ad3fc1f)

Signed-off-by: Heng Qian <[email protected]>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
…oject#4059)

(cherry picked from commit 8368e60)

Signed-off-by: Vamsi Manohar <[email protected]>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
opensearch-project#3982) (opensearch-project#4062)

* Fix casting double 0.0 to string



* Fix float to string casting precision lost with custom FormatNumberFunction

This commit fixes float to string casting by replacing the use of SqlLibraryOperators.FORMAT_NUMBER
with a custom FormatNumberFunction implementation. The new implementation converts the number
to a BigDecimal before formatting to preserve precision and avoid issues like 6.2 becoming
6.199999809265137.



* Simplify the implementation of fp number to string cast



* Update implementation of NumberToStringFunction



* Cast decimal with NUMBER_TO_STRING function



* Test cast decimal



---------


(cherry picked from commit 1977083)

Signed-off-by: Yuanchun Shen <[email protected]>
…-project#4020) (opensearch-project#4068)

* eval command support



* improvment



* Refactor



* fix CI



* fix CI



* fix CI



* fixes



* fix



* Add IT



* remove redundant tests



---------


(cherry picked from commit f40d870)

Signed-off-by: Kai Huang <[email protected]>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
…ject#4074)

* enhance sort command



* update failing tests



* fix formatting



* add integ tests



* update documentation



* fix failing test



* update default and tests



* fix tests



* update analyzer test



* update reverse sort direction



* update formatting



* update docs



* add javadoc



* add tests



* fix failing tests



* fix failing tests



* update integ tests for query size limit change



* add explainit for desc and type cast



* add tests for desc



* fix formatting



* make count optional



* add cross cluster tests



* fix tests



* normalize count in AST node



* default null count to 0



* update logicalsort default constructor



---------


(cherry picked from commit c8d2694)

Signed-off-by: Ritvi Bhatt <[email protected]>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
… (opensearch-project#4064)

* Remove named function arg from functions other than table functions



* Test eval if function with equal as condition



---------


(cherry picked from commit 9f2b19a)

Signed-off-by: Yuanchun Shen <[email protected]>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
…ct#3959) (opensearch-project#4080)

* Add reverse op for compare ip to support pushdown



* Pushdown ip comparison



* Refactor CompareIpFunction to use SqlKind directly



* Simplify the overriding of reverse() for IP comparators



---------


(cherry picked from commit e2375fe)

Signed-off-by: Yuanchun Shen <[email protected]>
…h-project#4072)

* Support script push down on text field (opensearch-project#4010)

* Support script push down on text field

Signed-off-by: Heng Qian <[email protected]>

* Fix IT

Signed-off-by: Heng Qian <[email protected]>

* Add UT for struct type push down

Signed-off-by: Heng Qian <[email protected]>

---------

Signed-off-by: Heng Qian <[email protected]>
(cherry picked from commit bb1a644)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

* Fix CI failure because of plan having changed (opensearch-project#4077)

Signed-off-by: Heng Qian <[email protected]>
(cherry picked from commit acc055e)

* set segment and document as missing PR: opensearch-project/OpenSearch#17927 in core 2.19

Signed-off-by: Heng Qian <[email protected]>

* Fix IT

Signed-off-by: Heng Qian <[email protected]>

* fix compiling

Signed-off-by: Heng Qian <[email protected]>

---------

Signed-off-by: Heng Qian <[email protected]>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: qianheng <[email protected]>
…roject#3972) (opensearch-project#4081)

* Support pushdown dedup with Calcite (opensearch-project#3972)

* Support pushdown dedup with Calcite

Signed-off-by: Lantao Jin <[email protected]>

* Fix IT

Signed-off-by: Lantao Jin <[email protected]>

* Address comments

Signed-off-by: Lantao Jin <[email protected]>

* Fix flaky test

Signed-off-by: Lantao Jin <[email protected]>

* Address comment

Signed-off-by: Lantao Jin <[email protected]>

* delete useless codes

Signed-off-by: Lantao Jin <[email protected]>

* Add more ITs

Signed-off-by: Lantao Jin <[email protected]>

---------

Signed-off-by: Lantao Jin <[email protected]>
(cherry picked from commit f358e5d)

* Fix conflicts

Signed-off-by: Lantao Jin <[email protected]>

---------

Signed-off-by: Lantao Jin <[email protected]>
…evance function. (opensearch-project#4093)

* Make fields parameter optional in multi field relevance queries (opensearch-project#4018)

Signed-off-by: Vamsi Manohar <[email protected]>
(cherry picked from commit 5c0ed0d)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

* Fixed text block syntax issue for Java 11

Signed-off-by: Vamsi Manohar <[email protected]>

---------

Signed-off-by: Vamsi Manohar <[email protected]>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Vamsi Manohar <[email protected]>
…search-project#3989) (opensearch-project#4096)

* add UUID regex into template



* fix spotless



* add integration test



---------


(cherry picked from commit 4a3b03a)

Signed-off-by: Hailong Cui <[email protected]>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
…roject#4089)

* Add flaky retry on CalcitePPLTpchIT (opensearch-project#4060)

* Add flaky retry on CalcitePPLTpchIT.testQ7

Signed-off-by: Lantao Jin <[email protected]>

* Add retry to all tpch queries

Signed-off-by: Lantao Jin <[email protected]>

* address comments

Signed-off-by: Lantao Jin <[email protected]>

---------

Signed-off-by: Lantao Jin <[email protected]>
(cherry picked from commit be38740)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

* Fix retry annotation for class

Signed-off-by: Lantao Jin <[email protected]>

* Ignore testQ7 in macOS

Signed-off-by: Lantao Jin <[email protected]>

---------

Signed-off-by: Lantao Jin <[email protected]>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Lantao Jin <[email protected]>
…ection Features (Cal… (opensearch-project#4102)

* `fields` Command Enhancement - Advanced Field Selection Features (Calcite) (opensearch-project#3970)

* Add support for space-separated fields in addition to comma-separated

Signed-off-by: Aaron Alvarez <[email protected]>

* Byte number should treated as Long in doc values (opensearch-project#3928)

Signed-off-by: Lantao Jin <[email protected]>
Signed-off-by: Aaron Alvarez <[email protected]>

* Adding table as alias of the fields command

Signed-off-by: Aaron Alvarez <[email protected]>

* Fix create PIT permissions issue (opensearch-project#3921)

Signed-off-by: Vamsi Manohar <[email protected]>
Signed-off-by: Aaron Alvarez <[email protected]>

* Convert like function call to wildcard query for Calcite filter pushdown (opensearch-project#3915)

* Convert like function call to wildcard query for Calcite filter pushdown

Signed-off-by: Songkan Tang <[email protected]>

* Fix V2 expression like function bug and match its behavior in Calcite

Signed-off-by: Songkan Tang <[email protected]>

* Fix like default escape in Calcite

Signed-off-by: Songkan Tang <[email protected]>

* Fix tests

Signed-off-by: Songkan Tang <[email protected]>

* Fix spotless check

Signed-off-by: Songkan Tang <[email protected]>

* Address comments

Signed-off-by: Songkan Tang <[email protected]>

* Fix SQL IT correctness

Signed-off-by: Songkan Tang <[email protected]>

* Remove test log

Signed-off-by: Songkan Tang <[email protected]>

* Minor improve one CalciteLikeQueryIT

Signed-off-by: Songkan Tang <[email protected]>

---------

Signed-off-by: Songkan Tang <[email protected]>
Signed-off-by: Aaron Alvarez <[email protected]>

* Update commons-lang exclude rule to exclude it everywhere (opensearch-project#3932)

* Update commons-lang exclude rule to exclude it everywhere

Signed-off-by: Simeon Widdis <[email protected]>

* Undo removal in core

Signed-off-by: Simeon Widdis <[email protected]>

---------

Signed-off-by: Simeon Widdis <[email protected]>
Signed-off-by: Aaron Alvarez <[email protected]>

* Adding wildcard support to fields command in Calcite

Signed-off-by: Aaron Alvarez <[email protected]>

* Mixed delimiter support - Support both space and comma delimiters in the same command for table and fields

Signed-off-by: Aaron Alvarez <[email protected]>

* Adding widlcard support to non-Calcite engine and updating documentation with new features

Signed-off-by: Aaron Alvarez <[email protected]>

* Fixing formatting issues

Signed-off-by: Aaron Alvarez <[email protected]>

* Support function argument coercion with Calcite (opensearch-project#3914)

* Change the use of SqlTypeFamily.STRING to SqlTypeFamily.CHARACTER as the string family contains binary, which is not expected for most functions

Signed-off-by: Yuanchun Shen <[email protected]>

* Implement basic argument type coercion at RelNode level

Signed-off-by: Yuanchun Shen <[email protected]>

* Conform type checkers with their definition in documentation
- string as an input is removed if it is not in the document
- string as an input is kept if it is in the document, even if it can be implicitly cast
- use PPLOperandTypes as much as possible

Signed-off-by: Yuanchun Shen <[email protected]>

* Implement type widening for comparator functions

- Add COMPARATORS set to BuiltinFunctionName for identifying comparison operators
- Implement widenArguments method in CoercionUtils to find widest compatible type
- Apply type widening to comparator functions before applying type casting
- Add detailed JavaDoc to explain coercion methods

Signed-off-by: Yuanchun Shen <[email protected]>

* Update error messages of datetime functions with invalid args

Signed-off-by: Yuanchun Shen <[email protected]>

* Simplify datetime-string compare logic with implict coercion

Signed-off-by: Yuanchun Shen <[email protected]>

* Refactor resolve with coercion

Signed-off-by: Yuanchun Shen <[email protected]>

* Move down argument cast for reduce function

Signed-off-by: Yuanchun Shen <[email protected]>

* Merge comparators and their IP variants so that coercion works for IP comparison

- when not merging, ip comparing will also pass the type checker of Calcite's comparators

Signed-off-by: Yuanchun Shen <[email protected]>

* Refactor ip comparator to comparator

Signed-off-by: Yuanchun Shen <[email protected]>

* Revert "Refactor ip comparator to comparator"

This reverts commit c539056.

Signed-off-by: Yuanchun Shen <[email protected]>

* Revert "Merge comparators and their IP variants so that coercion works for IP comparison"

This reverts commit bd9f3bb.

Signed-off-by: Yuanchun Shen <[email protected]>

* Rule out ip from built-in comparator via its type checker

Signed-off-by: Yuanchun Shen <[email protected]>

* Restrict CompareIP's parameter type

Signed-off-by: Yuanchun Shen <[email protected]>

* Revert to previous implementation of CompareIpFunction to temporarily fix ip comparison pushdown problems (udt not correctly serialized; ip comparison is not converted to range query)

Signed-off-by: Yuanchun Shen <[email protected]>

* Test argument coercion explain

Signed-off-by: Yuanchun Shen <[email protected]>

* Fix error msg in CalcitePPLFunctionTypeTest

Signed-off-by: Yuanchun Shen <[email protected]>

---------

Signed-off-by: Yuanchun Shen <[email protected]>
Signed-off-by: Aaron Alvarez <[email protected]>

* Add missing command in index.rst (opensearch-project#3943)

Signed-off-by: Peng Huo <[email protected]>
Signed-off-by: Aaron Alvarez <[email protected]>

* Append limit operator for QUEERY_SIZE_LIMIT (opensearch-project#3940)

* Append limit operator for QUEERY_SIZE_LIMIT

Signed-off-by: Heng Qian <[email protected]>

* Add LogicalSystemLimit

Signed-off-by: Heng Qian <[email protected]>

* Revert part of opensearch-project#3880

Signed-off-by: Heng Qian <[email protected]>

* Fix IT after merging main

Signed-off-by: Heng Qian <[email protected]>

---------

Signed-off-by: Heng Qian <[email protected]>
Signed-off-by: Aaron Alvarez <[email protected]>

* Performing code cleaning and fixing tests

Signed-off-by: Aaron Alvarez <[email protected]>

* Performing code maintenance and adding more test cases

Signed-off-by: Aaron Alvarez <[email protected]>

* Doing some code cleaning and maintenance

Signed-off-by: Aaron Alvarez <[email protected]>

* Fixing code and implementation logic

Signed-off-by: Aaron Alvarez <[email protected]>

* Add issue template specific for PPL commands and queries (opensearch-project#3962)

* Add issue template specific for PPL commands and queries

Signed-off-by: Anas Alkouz <[email protected]>

* Add section for Dataset/schema information, add reminders for the customers to remove any sensitive datas

Signed-off-by: Anas Alkouz <[email protected]>

---------

Signed-off-by: Anas Alkouz <[email protected]>
Signed-off-by: Aaron Alvarez <[email protected]>

* Increase the precision of sum return type (opensearch-project#3974)

Signed-off-by: Heng Qian <[email protected]>
Signed-off-by: Aaron Alvarez <[email protected]>

* Disable a failed PPL query fallback to v2 by default (opensearch-project#3952)

* Disable a failed PPL query fallback to v2 by default

Signed-off-by: Lantao Jin <[email protected]>

* Workaround the permissionIT

Signed-off-by: Lantao Jin <[email protected]>

---------

Signed-off-by: Lantao Jin <[email protected]>
Signed-off-by: Aaron Alvarez <[email protected]>

* Update the maven snapshot publish endpoint and credential (opensearch-project#3806)

Co-authored-by: Sayali Gaikawad <[email protected]>
Signed-off-by: Aaron Alvarez <[email protected]>

* Add release notes for 3.2.0 (opensearch-project#3985)

Signed-off-by: opensearch-ci <[email protected]>
Signed-off-by: Aaron Alvarez <[email protected]>

* Fixing documentation

Signed-off-by: Aaron Alvarez <[email protected]>

* Taking care of comments left by Tomo

Signed-off-by: Aaron Alvarez <[email protected]>

* Adding full wildcard support functionality

Signed-off-by: Aaron Alvarez <[email protected]>

* Increment version to 3.2.0-SNAPSHOT (opensearch-project#3819)

Signed-off-by: opensearch-ci-bot <[email protected]>
Co-authored-by: opensearch-ci-bot <[email protected]>
Signed-off-by: Aaron Alvarez <[email protected]>

* Support `reverse` command with Calcite (opensearch-project#3867)

* Implement reverse

Signed-off-by: Selina Song <[email protected]>

* Add reverse integ tests and unit tests

Signed-off-by: Selina Song <[email protected]>

* Add reverse documentation

Signed-off-by: Selina Song <[email protected]>

* Modify reverse test and documentation

Signed-off-by: Selina Song <[email protected]>

* Fix limit pushdown bug when reverse comes before head

* Revert "Fix limit pushdown bug when reverse comes before head"

This reverts commit 087c936.

Signed-off-by: Selina Song <[email protected]>

* Fix grammar, naming, and test cases. Pushdown reverted will be in 2nd PR.

Signed-off-by: Selina Song <[email protected]>

* Fix reverse tests: update logical plans, format with Spotless

- Updated expected logical plans and Spark SQL in reverse tests
- Applied Spotless to fix formatting

Signed-off-by: Selina Song <[email protected]>

* Fix OS version in build 3.1.0

Signed-off-by: Selina Song <[email protected]>

* Add note on limitation to rst

Signed-off-by: Selina Song <[email protected]>

* Move explain IT to correct file, add Anonymizer test

Signed-off-by: Selina Song <[email protected]>

* Add reverse to index.rst

Signed-off-by: Selina Song <[email protected]>

---------

Signed-off-by: Selina Song <[email protected]>
Co-authored-by: Selina Song <[email protected]>
Signed-off-by: Aaron Alvarez <[email protected]>

* Pass JOIN_TIME_OUT value to keepalive (opensearch-project#3826)

* Fix JOIN_TIME_OUT

Signed-off-by: Kai Huang <[email protected]>

* fix style

Signed-off-by: Kai Huang <[email protected]>

* fix

Signed-off-by: Kai Huang <[email protected]>

* fix CI

Signed-off-by: Kai Huang <[email protected]>

* fix

Signed-off-by: Kai Huang <[email protected]>

* fixes

Signed-off-by: Kai Huang <[email protected]>

* fixes

Signed-off-by: Kai Huang <[email protected]>

* fix log-rethrow

Signed-off-by: Kai Huang <[email protected]>

* Restructure

Signed-off-by: Kai Huang <[email protected]>

* fix CI

Signed-off-by: Kai Huang <[email protected]>

* fix format

Signed-off-by: Kai Huang <[email protected]>

* remove unused PIT

Signed-off-by: Kai Huang <[email protected]>

* remove reflection, add hintConfig

Signed-off-by: Kai Huang <[email protected]>

* Added Unit test, restructured to use existing methods

Signed-off-by: Kai Huang <[email protected]>

* fixes

Signed-off-by: Kai Huang <[email protected]>

* fix

Signed-off-by: Kai Huang <[email protected]>

* fixes

Signed-off-by: Kai Huang <[email protected]>

* add IT tests

Signed-off-by: Kai Huang <[email protected]>

* formatting

Signed-off-by: Kai Huang <[email protected]>

* Trim IT

Signed-off-by: Kai Huang <[email protected]>

* format fix

Signed-off-by: Kai Huang <[email protected]>

* trim IT

Signed-off-by: Kai Huang <[email protected]>

* formatting

Signed-off-by: Kai Huang <[email protected]>

* Update legacy/src/main/java/org/opensearch/sql/legacy/query/planner/physical/node/pointInTime/PointInTime.java

Co-authored-by: Louis Chu <[email protected]>
Signed-off-by: Kai Huang <[email protected]>

* fix

Signed-off-by: Kai Huang <[email protected]>

* update .gitignore

Signed-off-by: Kai Huang <[email protected]>

* deletion

Signed-off-by: Kai Huang <[email protected]>

* restore main PIT

Signed-off-by: Kai Huang <[email protected]>

---------

Signed-off-by: Kai Huang <[email protected]>
Signed-off-by: Kai Huang <[email protected]>
Co-authored-by: Louis Chu <[email protected]>
Signed-off-by: Aaron Alvarez <[email protected]>

* Changed seenFields to Hashset instead of LinkedHashSet

Signed-off-by: Aaron Alvarez <[email protected]>

* Creating a rule only for the fields/table commands to avoid any interference

Signed-off-by: Aaron Alvarez <[email protected]>

* This commit is in response of PR comments left by Tomo and Chen

Signed-off-by: Aaron Alvarez <[email protected]>

* Fixing Integration test failure

Signed-off-by: Aaron Alvarez <[email protected]>

* Adding anonymizer tests, wildcard unit tests, etc

Signed-off-by: Aaron Alvarez <[email protected]>

* Disabling Calcite for enhance fields features

Signed-off-by: Aaron Alvarez <[email protected]>

* Disabling automatic de-deduplication when Calcite is disabled

Signed-off-by: Aaron Alvarez <[email protected]>

* Adding cross-cluster IT test

Signed-off-by: Aaron Alvarez <[email protected]>

* Adding a dedicated Cross-cluster IT test file for Calcite

Signed-off-by: Aaron Alvarez <[email protected]>

* Fixing formatting issues

Signed-off-by: Aaron Alvarez <[email protected]>

* Improving widlcard logic and exception message

Signed-off-by: Aaron Alvarez <[email protected]>

* Addressing comments left by Tomo regarding wildcard logic implementation

Signed-off-by: Aaron Alvarez <[email protected]>

* Empty commit

Signed-off-by: Aaron Alvarez <[email protected]>

* Add missing udfs in v3 (opensearch-project#3957)

* add math udfs

Signed-off-by: Xinyu Hao <[email protected]>

* fix decimal bug

Signed-off-by: Xinyu Hao <[email protected]>

* make general udf adapter

Signed-off-by: Xinyu Hao <[email protected]>

* add math IT

Signed-off-by: Xinyu Hao <[email protected]>

* fix

Signed-off-by: Xinyu Hao <[email protected]>

* add rst

Signed-off-by: Xinyu Hao <[email protected]>

* fix error

Signed-off-by: Xinyu Hao <[email protected]>

* change signum IT

Signed-off-by: Xinyu Hao <[email protected]>

* add javadoc

Signed-off-by: Xinyu Hao <[email protected]>

---------

Signed-off-by: Xinyu Hao <[email protected]>
Signed-off-by: Aaron Alvarez <[email protected]>

* fix snapshot uploading (opensearch-project#4006)

* fix snapshot uploading

Signed-off-by: Kai Huang <[email protected]>

* Add comment

Signed-off-by: Kai Huang <[email protected]>

---------

Signed-off-by: Kai Huang <[email protected]>
Signed-off-by: Aaron Alvarez <[email protected]>

* Fix DOUBLE to STRING cast rendering zero values in scientific notation (opensearch-project#3982)

* Fix casting double 0.0 to string

Signed-off-by: Yuanchun Shen <[email protected]>

* Fix float to string casting precision lost with custom FormatNumberFunction

This commit fixes float to string casting by replacing the use of SqlLibraryOperators.FORMAT_NUMBER
with a custom FormatNumberFunction implementation. The new implementation converts the number
to a BigDecimal before formatting to preserve precision and avoid issues like 6.2 becoming
6.199999809265137.

Signed-off-by: Yuanchun Shen <[email protected]>

* Simplify the implementation of fp number to string cast

Signed-off-by: Yuanchun Shen <[email protected]>

* Update implementation of NumberToStringFunction

Signed-off-by: Yuanchun Shen <[email protected]>

* Cast decimal with NUMBER_TO_STRING function

Signed-off-by: Yuanchun Shen <[email protected]>

* Test cast decimal

Signed-off-by: Yuanchun Shen <[email protected]>

---------

Signed-off-by: Yuanchun Shen <[email protected]>
Signed-off-by: Aaron Alvarez <[email protected]>

* Eliminate reliance on assert in Calcite for integration test (opensearch-project#4016)

* Move num-of-column check of in subquery ahead from RexSubQuery.java#L78 because assert is disabled in production

Signed-off-by: Yuanchun Shen <[email protected]>

* Increase script.context.filter.max_compilations_rate for SQLCorrectnessIT

Signed-off-by: Yuanchun Shen <[email protected]>

* Check script.disable_max_compilations_rate before setting context-specific compilations rate

Signed-off-by: Yuanchun Shen <[email protected]>

* Refactor: remove some methods in tests to upper level to reduce duplication

Signed-off-by: Yuanchun Shen <[email protected]>

* Replace plugin-level setting strings with private test-specific ones

Signed-off-by: Yuanchun Shen <[email protected]>

---------

Signed-off-by: Yuanchun Shen <[email protected]>
Signed-off-by: Aaron Alvarez <[email protected]>

* Prevent aggregation push down when it has inner filter (opensearch-project#4002)

* Prevent aggregation push down when it has inner filter

Signed-off-by: Heng Qian <[email protected]>

* Fix IT & Remove log

Signed-off-by: Heng Qian <[email protected]>

* Fix 4009

Signed-off-by: Heng Qian <[email protected]>

* Fix IT

Signed-off-by: Heng Qian <[email protected]>

---------

Signed-off-by: Heng Qian <[email protected]>
Signed-off-by: Aaron Alvarez <[email protected]>

* Fix span on negative timestamp (opensearch-project#4017)

* Fix span on negative timestamp

Signed-off-by: Heng Qian <[email protected]>

* Fix span on negative timestamp

Signed-off-by: Heng Qian <[email protected]>

* typo

Signed-off-by: Heng Qian <[email protected]>

* Refine code

Signed-off-by: Heng Qian <[email protected]>

---------

Signed-off-by: Heng Qian <[email protected]>
Signed-off-by: Aaron Alvarez <[email protected]>

* Skip script encoding when run explain with  'extended' (opensearch-project#3930)

* No need to decode script when run explain command

Signed-off-by: Lantao Jin <[email protected]>

* address comment

Signed-off-by: Lantao Jin <[email protected]>

* Do not encoding when explain format is 'extended'

Signed-off-by: Lantao Jin <[email protected]>

* Rename the thread local var

Signed-off-by: Lantao Jin <[email protected]>

* Fix IT after merge main

Signed-off-by: Lantao Jin <[email protected]>

---------

Signed-off-by: Lantao Jin <[email protected]>
Signed-off-by: Aaron Alvarez <[email protected]>

* Implement type checking for aggregation functions with Calcite (opensearch-project#4024)

* Remove getTypeChecker from FunctionImp interface

Signed-off-by: Yuanchun Shen <[email protected]>

* Refactor registerExternalFunction to registerExternalOperator

Signed-off-by: Yuanchun Shen <[email protected]>

* Do not register GEOIP function if got incompatible client

Signed-off-by: Yuanchun Shen <[email protected]>

* Create scaffold for type checking of aggregation functions

Signed-off-by: Yuanchun Shen <[email protected]>

* Add type checkers for aggregation functions

Signed-off-by: Yuanchun Shen <[email protected]>

* Test type checking for aggregation functions

Signed-off-by: Yuanchun Shen <[email protected]>

---------

Signed-off-by: Yuanchun Shen <[email protected]>
Signed-off-by: Aaron Alvarez <[email protected]>

* Allow equal expression as a function argument (opensearch-project#4001)

* Remove named function arg from functions other than table functions

Signed-off-by: Yuanchun Shen <[email protected]>

* Test eval if function with equal as condition

Signed-off-by: Yuanchun Shen <[email protected]>

---------

Signed-off-by: Yuanchun Shen <[email protected]>
Signed-off-by: Aaron Alvarez <[email protected]>

* Push down IP comparison as range query with Calcite (opensearch-project#3959)

* Add reverse op for compare ip to support pushdown

Signed-off-by: Yuanchun Shen <[email protected]>

* Pushdown ip comparison

Signed-off-by: Yuanchun Shen <[email protected]>

* Refactor CompareIpFunction to use SqlKind directly

Signed-off-by: Yuanchun Shen <[email protected]>

* Simplify the overriding of reverse() for IP comparators

Signed-off-by: Yuanchun Shen <[email protected]>

---------

Signed-off-by: Yuanchun Shen <[email protected]>
Signed-off-by: Aaron Alvarez <[email protected]>

* eval sum, avg implementation (opensearch-project#3986)

Signed-off-by: Vamsi Manohar <[email protected]>
Signed-off-by: Aaron Alvarez <[email protected]>

* Fix PPL eval command string concatenation with + operator (opensearch-project#4020)

* eval command support

Signed-off-by: Kai Huang <[email protected]>

* improvment

Signed-off-by: Kai Huang <[email protected]>

* Refactor

Signed-off-by: Kai Huang <[email protected]>

* fix CI

Signed-off-by: Kai Huang <[email protected]>

* fix CI

Signed-off-by: Kai Huang <[email protected]>

* fix CI

Signed-off-by: Kai Huang <[email protected]>

* fixes

Signed-off-by: Kai Huang <[email protected]>

* fix

Signed-off-by: Kai Huang <[email protected]>

* Add IT

Signed-off-by: Kai Huang <[email protected]>

* remove redundant tests

Signed-off-by: Kai Huang <[email protected]>

---------

Signed-off-by: Kai Huang <[email protected]>
Signed-off-by: Aaron Alvarez <[email protected]>

* Support script push down on text field (opensearch-project#4010)

* Support script push down on text field

Signed-off-by: Heng Qian <[email protected]>

* Fix IT

Signed-off-by: Heng Qian <[email protected]>

* Add UT for struct type push down

Signed-off-by: Heng Qian <[email protected]>

---------

Signed-off-by: Heng Qian <[email protected]>
Signed-off-by: Aaron Alvarez <[email protected]>

* Enhance sort command in PPL (opensearch-project#3934)

* enhance sort command

Signed-off-by: Ritvi Bhatt <[email protected]>

* update failing tests

Signed-off-by: Ritvi Bhatt <[email protected]>

* fix formatting

Signed-off-by: Ritvi Bhatt <[email protected]>

* add integ tests

Signed-off-by: Ritvi Bhatt <[email protected]>

* update documentation

Signed-off-by: Ritvi Bhatt <[email protected]>

* fix failing test

Signed-off-by: Ritvi Bhatt <[email protected]>

* update default and tests

Signed-off-by: Ritvi Bhatt <[email protected]>

* fix tests

Signed-off-by: Ritvi Bhatt <[email protected]>

* update analyzer test

Signed-off-by: Ritvi Bhatt <[email protected]>

* update reverse sort direction

Signed-off-by: Ritvi Bhatt <[email protected]>

* update formatting

Signed-off-by: Ritvi Bhatt <[email protected]>

* update docs

Signed-off-by: Ritvi Bhatt <[email protected]>

* add javadoc

Signed-off-by: Ritvi Bhatt <[email protected]>

* add tests

Signed-off-by: Ritvi Bhatt <[email protected]>

* fix failing tests

Signed-off-by: Ritvi Bhatt <[email protected]>

* fix failing tests

Signed-off-by: Ritvi Bhatt <[email protected]>

* update integ tests for query size limit change

Signed-off-by: Ritvi Bhatt <[email protected]>

* add explainit for desc and type cast

Signed-off-by: Ritvi Bhatt <[email protected]>

* add tests for desc

Signed-off-by: Ritvi Bhatt <[email protected]>

* fix formatting

Signed-off-by: Ritvi Bhatt <[email protected]>

* make count optional

Signed-off-by: Ritvi Bhatt <[email protected]>

* add cross cluster tests

Signed-off-by: Ritvi Bhatt <[email protected]>

* fix tests

Signed-off-by: Ritvi Bhatt <[email protected]>

* normalize count in AST node

Signed-off-by: Ritvi Bhatt <[email protected]>

* default null count to 0

Signed-off-by: Ritvi Bhatt <[email protected]>

* update logicalsort default constructor

Signed-off-by: Ritvi Bhatt <[email protected]>

---------

Signed-off-by: Ritvi Bhatt <[email protected]>
Signed-off-by: Aaron Alvarez <[email protected]>

* Add example for String concat in eval.rst (opensearch-project#4075)

* Add example for String concat in eval.rst

Signed-off-by: Kai Huang <[email protected]>

* mention calcite enabling

Signed-off-by: Kai Huang <[email protected]>

---------

Signed-off-by: Kai Huang <[email protected]>
Signed-off-by: Aaron Alvarez <[email protected]>

* Support pushdown dedup with Calcite (opensearch-project#3972)

* Support pushdown dedup with Calcite

Signed-off-by: Lantao Jin <[email protected]>

* Fix IT

Signed-off-by: Lantao Jin <[email protected]>

* Address comments

Signed-off-by: Lantao Jin <[email protected]>

* Fix flaky test

Signed-off-by: Lantao Jin <[email protected]>

* Address comment

Signed-off-by: Lantao Jin <[email protected]>

* delete useless codes

Signed-off-by: Lantao Jin <[email protected]>

* Add more ITs

Signed-off-by: Lantao Jin <[email protected]>

---------

Signed-off-by: Lantao Jin <[email protected]>
Signed-off-by: Aaron Alvarez <[email protected]>

* Fix CI failure because of plan having changed (opensearch-project#4077)

Signed-off-by: Heng Qian <[email protected]>
Signed-off-by: Aaron Alvarez <[email protected]>

* Empty commit

Signed-off-by: Aaron Alvarez <[email protected]>

* Empty commit

Signed-off-by: Aaron Alvarez <[email protected]>

---------

Signed-off-by: Aaron Alvarez <[email protected]>
Signed-off-by: Lantao Jin <[email protected]>
Signed-off-by: Vamsi Manohar <[email protected]>
Signed-off-by: Songkan Tang <[email protected]>
Signed-off-by: Simeon Widdis <[email protected]>
Signed-off-by: Yuanchun Shen <[email protected]>
Signed-off-by: Peng Huo <[email protected]>
Signed-off-by: Heng Qian <[email protected]>
Signed-off-by: Anas Alkouz <[email protected]>
Signed-off-by: opensearch-ci <[email protected]>
Signed-off-by: opensearch-ci-bot <[email protected]>
Signed-off-by: Selina Song <[email protected]>
Signed-off-by: Kai Huang <[email protected]>
Signed-off-by: Kai Huang <[email protected]>
Signed-off-by: Xinyu Hao <[email protected]>
Signed-off-by: Ritvi Bhatt <[email protected]>
Signed-off-by: Aaron Alvarez <[email protected]>
Co-authored-by: Aaron Alvarez <[email protected]>
Co-authored-by: Lantao Jin <[email protected]>
Co-authored-by: Vamsi Manohar <[email protected]>
Co-authored-by: Songkan Tang <[email protected]>
Co-authored-by: Simeon Widdis <[email protected]>
Co-authored-by: Yuanchun Shen <[email protected]>
Co-authored-by: Peng Huo <[email protected]>
Co-authored-by: qianheng <[email protected]>
Co-authored-by: Anas Alkouz <[email protected]>
Co-authored-by: Zelin Hao <[email protected]>
Co-authored-by: Sayali Gaikawad <[email protected]>
Co-authored-by: opensearch-ci <[email protected]>
Co-authored-by: opensearch-trigger-bot[bot] <98922864+opensearch-trigger-bot[bot]@users.noreply.github.com>
Co-authored-by: opensearch-ci-bot <[email protected]>
Co-authored-by: Selina Song <[email protected]>
Co-authored-by: Selina Song <[email protected]>
Co-authored-by: Kai Huang <[email protected]>
Co-authored-by: Louis Chu <[email protected]>
Co-authored-by: Xinyu Hao <[email protected]>
Co-authored-by: ritvibhatt <[email protected]>
(cherry picked from commit f16f1c0)

* Fixing compatibility issues

Signed-off-by: Aaron Alvarez <[email protected]>

* Fixing JDK compatibility issues

Signed-off-by: Aaron Alvarez <[email protected]>

* fixing java 11 compatibility issues

Signed-off-by: Aaron Alvarez <[email protected]>

---------

Signed-off-by: Aaron Alvarez <[email protected]>
Signed-off-by: Lantao Jin <[email protected]>
Signed-off-by: Vamsi Manohar <[email protected]>
Signed-off-by: Songkan Tang <[email protected]>
Signed-off-by: Simeon Widdis <[email protected]>
Signed-off-by: Yuanchun Shen <[email protected]>
Signed-off-by: Peng Huo <[email protected]>
Signed-off-by: Heng Qian <[email protected]>
Signed-off-by: Anas Alkouz <[email protected]>
Signed-off-by: opensearch-ci <[email protected]>
Signed-off-by: opensearch-ci-bot <[email protected]>
Signed-off-by: Selina Song <[email protected]>
Signed-off-by: Kai Huang <[email protected]>
Signed-off-by: Kai Huang <[email protected]>
Signed-off-by: Xinyu Hao <[email protected]>
Signed-off-by: Ritvi Bhatt <[email protected]>
Signed-off-by: Aaron Alvarez <[email protected]>
Co-authored-by: Aaron Alvarez <[email protected]>
Co-authored-by: Lantao Jin <[email protected]>
Co-authored-by: Vamsi Manohar <[email protected]>
Co-authored-by: Songkan Tang <[email protected]>
Co-authored-by: Simeon Widdis <[email protected]>
Co-authored-by: Yuanchun Shen <[email protected]>
Co-authored-by: Peng Huo <[email protected]>
Co-authored-by: qianheng <[email protected]>
Co-authored-by: Anas Alkouz <[email protected]>
Co-authored-by: Zelin Hao <[email protected]>
Co-authored-by: Sayali Gaikawad <[email protected]>
Co-authored-by: opensearch-ci <[email protected]>
Co-authored-by: opensearch-trigger-bot[bot] <98922864+opensearch-trigger-bot[bot]@users.noreply.github.com>
Co-authored-by: opensearch-ci-bot <[email protected]>
Co-authored-by: Selina Song <[email protected]>
Co-authored-by: Selina Song <[email protected]>
Co-authored-by: Kai Huang <[email protected]>
Co-authored-by: Louis Chu <[email protected]>
Co-authored-by: Xinyu Hao <[email protected]>
Co-authored-by: ritvibhatt <[email protected]>
…ch-project#4055) (opensearch-project#4098)

* Filter with isnull or other expression should be pushded down



* revert unexpected deletion



* Fix conflicts



---------


(cherry picked from commit fce8383)

Signed-off-by: Lantao Jin <[email protected]>
Signed-off-by: Kai Huang <[email protected]>
Signed-off-by: Kai Huang <[email protected]>
(cherry picked from commit 71076f7)
@ahkcs ahkcs closed this Aug 29, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.