Skip to content

Conversation

@edgarRd
Copy link
Contributor

@edgarRd edgarRd commented Mar 16, 2023

Fixes #7122

Handles issues when converting SearchArguments where tree and leaf arrays are not in sync.

The changes in PR make sure that whenever we access certain array indexes they are within bounds expected.

* [mr] Skip filter translation if there are no leaves (#43)

* Skip filter translation if there are no leaves

* Make check generic

* [mr] Check for valid leaf literals

* Add unit test
@github-actions github-actions bot added the MR label Mar 16, 2023
@edgarRd
Copy link
Contributor Author

edgarRd commented Mar 21, 2023

PTAL @pvary

@edgarRd
Copy link
Contributor Author

edgarRd commented Apr 14, 2023

PTAL @danielcweeks - Thanks!

@edgarRd edgarRd changed the title MR: Skip filter translation if there are no leaves MR: Fix IndexOutOfBounds by skip filter translation if there are no leaves Apr 14, 2023
@pvary
Copy link
Contributor

pvary commented Apr 18, 2023

I am not working on MR side lately, so I do not have a current knowledge of the code here
Maybe @deniskuzZ would be interested in reviewing this PR.

Copy link
Member

@deniskuzZ deniskuzZ left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, note that Hive overrides this class in iceberg-handler module, due to a lack of committer support in iceberg project. Consider opening a similar PR for Hive.

@deniskuzZ
Copy link
Member

thanks @pvary for the +1.
@edgarRd if that gets merged soon, the change could be incorporated in Hive with the next Iceberg release, and probably no need for a separate PR in Hive.

@pvary pvary merged commit 37cb7ca into apache:master Apr 24, 2023
@pvary
Copy link
Contributor

pvary commented Apr 24, 2023

Thanks @edgarRd for the PR and @deniskuzZ for the review!

@edgarRd
Copy link
Contributor Author

edgarRd commented Apr 24, 2023

Thanks for the review @deniskuzZ and @pvary for the merge!

@edgarRd edgarRd deleted the hive-between-sargs-fix branch April 24, 2023 14:35
zhangbutao added a commit to zhangbutao/hive that referenced this pull request Apr 25, 2023
zhangbutao added a commit to zhangbutao/hive that referenced this pull request Apr 25, 2023
manisin pushed a commit to Snowflake-Labs/iceberg that referenced this pull request May 9, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Iceberg table in Hive fails with IndexOutOfBounds when BETWEEN filter used

3 participants