Skip to content

Add test coverage for data size reported by Iceberg connector#11711

Merged
ebyhr merged 1 commit intotrinodb:masterfrom
ebyhr:ebi/iceberg-size
Mar 30, 2022
Merged

Add test coverage for data size reported by Iceberg connector#11711
ebyhr merged 1 commit intotrinodb:masterfrom
ebyhr:ebi/iceberg-size

Conversation

@ebyhr
Copy link
Copy Markdown
Member

@ebyhr ebyhr commented Mar 30, 2022

Description

Add test coverage for data size reported by Iceberg connector. testTruncateTextTransform & testAllAvailableTypes mentioned "the size is varying", but 10/10 invocations succeeded.
Fixes #8649

Documentation

(x) No documentation is needed.
( ) Sufficient documentation is included in this PR.
( ) Documentation PR is available with #prnumber.
( ) Documentation issue #issuenumber is filed, and can be handled later.

Release notes

(x) No release notes entries required.
( ) Release notes entries required with the following suggested text:

@ebyhr ebyhr added test no-release-notes This pull request does not require release notes entry labels Mar 30, 2022
@cla-bot cla-bot bot added the cla-signed label Mar 30, 2022
@ebyhr ebyhr requested review from findepi, losipiuk and phd3 March 30, 2022 06:00
" ('a_double', NULL, NULL, 0.5e0, NULL, '1.0', '1.0'), " +
" ('a_short_decimal', NULL, NULL, 0.5e0, NULL, '1.0', '1.0'), " +
" ('a_long_decimal', NULL, NULL, 0.5e0, NULL, '11.0', '11.0'), " +
" ('a_varchar', " + (format == PARQUET ? "87e0" : "NULL") + ", NULL, 0.5e0, NULL, NULL, NULL), " +
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is it always exactly 87?

can you please run iceberg module on a CI couple times?

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ran stress test (30 attempts) in #11727 and the value seems stable.

@ebyhr ebyhr merged commit 3051f7d into trinodb:master Mar 30, 2022
@ebyhr ebyhr deleted the ebi/iceberg-size branch March 30, 2022 23:32
@github-actions github-actions bot added this to the 376 milestone Mar 30, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cla-signed no-release-notes This pull request does not require release notes entry test

Development

Successfully merging this pull request may close these issues.

Add test coverage for data size reported by Iceberg connector

2 participants