Skip to content

Migrate Kudu to use BaseConnectorTest#11113

Merged
ebyhr merged 3 commits intotrinodb:masterfrom
ebyhr:ebi/kudu-migrate-test
Feb 23, 2022
Merged

Migrate Kudu to use BaseConnectorTest#11113
ebyhr merged 3 commits intotrinodb:masterfrom
ebyhr:ebi/kudu-migrate-test

Conversation

@ebyhr
Copy link
Copy Markdown
Member

@ebyhr ebyhr commented Feb 21, 2022

Description

Migrate Kudu to use BaseConnectorTest

Related issues, pull requests, and links

Documentation

(x) No documentation is needed.

Release notes

(x) No release notes entries required.

@ebyhr ebyhr added the maintenance Project maintenance task label Feb 21, 2022
@cla-bot cla-bot bot added the cla-signed label Feb 21, 2022
Merge TestKuduDistributedQueries into AbstractKuduConnectorTest.
@ebyhr ebyhr force-pushed the ebi/kudu-migrate-test branch from 26ca440 to 79fe1c9 Compare February 21, 2022 07:32
@ebyhr
Copy link
Copy Markdown
Member Author

ebyhr commented Feb 21, 2022

CI #11130


<dependency>
<groupId>io.airlift</groupId>
<artifactId>log-manager</artifactId>
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just curious what is the log-manager dep for? I assumed it would be in test scope only.

.build();
}

public static void main(String[] args)
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is just for manual testing correct?

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes. Also this is where log-manager gets pulled in because of Logging.initialize.

Copy link
Copy Markdown
Contributor

@grantatspothero grantatspothero left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, just had a few questions

testColumnName(columnName, true);
}

private void testColumnName(String columnName, boolean delimited)
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is same as the definition inherited from AbstractTestDistributedQueries except for the CREATE TABLE query.

Can we make the method in ATDQ protected and override here with a comment so that we know to unify this/make base class more flexible at some point in future?

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a general deficiency in our base tests today - they cannot be adapted to fit different CREATE TABLE/CTAS syntax. The connectors which might benefit from this are ClickHouse, Druid, Kudu and Phoenix IIRC.

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we can make it protected or extract one line for creating a table. Let me handle in another PR because other tests also has the similar issue.

@ebyhr ebyhr merged commit dd2f1ae into trinodb:master Feb 23, 2022
@ebyhr ebyhr deleted the ebi/kudu-migrate-test branch February 23, 2022 00:47
@github-actions github-actions bot added this to the 372 milestone Feb 23, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cla-signed maintenance Project maintenance task

Development

Successfully merging this pull request may close these issues.

Migrate Kudu tests to use BaseConnectorTest

3 participants