-
Notifications
You must be signed in to change notification settings - Fork 3.4k
Downscale base connector tests #15816
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Downscale base connector tests #15816
Conversation
|
Could you confirm CI failures? |
bbae176 to
347cbd2
Compare
testing/trino-testing/src/main/java/io/trino/testing/BaseConnectorSmokeTest.java
Outdated
Show resolved
Hide resolved
testing/trino-testing/src/main/java/io/trino/testing/BaseConnectorSmokeTest.java
Outdated
Show resolved
Hide resolved
65ef90b to
afe551f
Compare
|
@SemionPar can we mark this ready for review? |
6bc0d42 to
9ca9691
Compare
hashhar
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM % questions
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
where does 111_200 come from? the estimated join size was 83_400 AFAIK.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
That's what I would expect, too, after consistently decreasing data size 10x, but actually its 111200 (joinDataSize when I put the breakpoint in
trino/plugin/trino-base-jdbc/src/main/java/io/trino/plugin/jdbc/JdbcJoinPushdownUtil.java
Line 110 in 095d35a
| if (joinDataSize < getJoinPushdownAutomaticJoinToTablesRatio(session) * (leftDataSize + rightDataSize)) { |
plugin/trino-base-jdbc/src/test/java/io/trino/plugin/jdbc/BaseAutomaticJoinPushdownTest.java
Outdated
Show resolved
Hide resolved
9d35e73 to
24d9588
Compare
|
@hashhar who can merge this PR? looks like comments are addressed |
plugin/trino-base-jdbc/src/test/java/io/trino/plugin/jdbc/BaseAutomaticJoinPushdownTest.java
Outdated
Show resolved
Hide resolved
Use smaller tables or smaller datasets in general, where appropriate. This should speed up tests for some connectors considerably.
24d9588 to
51d48fb
Compare
Description
Use smaller tables or smaller data sets in general, where appropriate. This should speed up tests for some connectors considerably.
Additional context and related issues
Release notes
(x) This is not user-visible or docs only and no release notes are required.
( ) Release notes are required, please propose a release note for me.
( ) Release notes are required, with the following suggested text: