Skip to content

Support RLE DictionaryBlock.dictionary in UnnestingPositionsAppender#17844

Merged
raunaqmorarka merged 3 commits intotrinodb:masterfrom
starburstdata:ls/2306/01-unnest-dict-rle
Jun 13, 2023
Merged

Support RLE DictionaryBlock.dictionary in UnnestingPositionsAppender#17844
raunaqmorarka merged 3 commits intotrinodb:masterfrom
starburstdata:ls/2306/01-unnest-dict-rle

Conversation

@lukasz-stec
Copy link
Copy Markdown
Member

@lukasz-stec lukasz-stec commented Jun 12, 2023

Description

DictionaryBlock.dictionary will not be RLE in normal circumstances,
but since there is no precondition in the constructor, we cannot
rely on this to be always the case

Additional context and related issues

Fixes #17861

Release notes

( ) This is not user-visible or docs only and no release notes are required.
( ) Release notes are required, please propose a release note for me.
(x) Release notes are required, with the following suggested text:

# General
* Fix query failure due to an exception from PartitionedOutputOperator. ({issue}`17861`)

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is it possible to create a test ?

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It is possible at the moment but it will be brittle as we don't want blocks like that so the test may stop covering this case at any time e.g. after #17842 is merged

@lukasz-stec lukasz-stec force-pushed the ls/2306/01-unnest-dict-rle branch from 1f20d0b to 11a2b58 Compare June 12, 2023 10:59
DictionaryBlock.dictionary will not be RLE in normal circumstances,
but since there is no precondition in the constructor, we cannot
rely on this to be always the case
@lukasz-stec lukasz-stec force-pushed the ls/2306/01-unnest-dict-rle branch from 11a2b58 to a444950 Compare June 12, 2023 12:21
@raunaqmorarka raunaqmorarka merged commit 8f39e4c into trinodb:master Jun 13, 2023
@raunaqmorarka raunaqmorarka deleted the ls/2306/01-unnest-dict-rle branch June 13, 2023 04:33
@github-actions github-actions bot added this to the 420 milestone Jun 13, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Development

Successfully merging this pull request may close these issues.

Large CTAS fails with internal error

2 participants