Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Migrate Kudu to use BaseConnectorTest #11113

Merged
merged 3 commits into from
Feb 23, 2022
Merged

Conversation

ebyhr
Copy link
Member

@ebyhr ebyhr commented Feb 21, 2022

Description

Migrate Kudu to use BaseConnectorTest

Related issues, pull requests, and links

Documentation

(x) No documentation is needed.

Release notes

(x) No release notes entries required.

@ebyhr ebyhr added the maintenance Project maintenance task label Feb 21, 2022
@cla-bot cla-bot bot added the cla-signed label Feb 21, 2022
Merge TestKuduDistributedQueries into AbstractKuduConnectorTest.
@ebyhr ebyhr force-pushed the ebi/kudu-migrate-test branch from 26ca440 to 79fe1c9 Compare February 21, 2022 07:32
@ebyhr
Copy link
Member Author

ebyhr commented Feb 21, 2022

CI #11130

@@ -43,6 +43,12 @@
<artifactId>log</artifactId>
</dependency>

<dependency>
<groupId>io.airlift</groupId>
<artifactId>log-manager</artifactId>
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just curious what is the log-manager dep for? I assumed it would be in test scope only.

@@ -152,4 +154,19 @@ public static Session createSession(String schema)
.setSchema(schema)
.build();
}

public static void main(String[] args)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is just for manual testing correct?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes. Also this is where log-manager gets pulled in because of Logging.initialize.

Copy link
Contributor

@grantatspothero grantatspothero left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, just had a few questions

testColumnName(columnName, true);
}

private void testColumnName(String columnName, boolean delimited)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is same as the definition inherited from AbstractTestDistributedQueries except for the CREATE TABLE query.

Can we make the method in ATDQ protected and override here with a comment so that we know to unify this/make base class more flexible at some point in future?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a general deficiency in our base tests today - they cannot be adapted to fit different CREATE TABLE/CTAS syntax. The connectors which might benefit from this are ClickHouse, Druid, Kudu and Phoenix IIRC.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we can make it protected or extract one line for creating a table. Let me handle in another PR because other tests also has the similar issue.

@ebyhr ebyhr merged commit dd2f1ae into trinodb:master Feb 23, 2022
@ebyhr ebyhr deleted the ebi/kudu-migrate-test branch February 23, 2022 00:47
@github-actions github-actions bot added this to the 372 milestone Feb 23, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cla-signed maintenance Project maintenance task
Development

Successfully merging this pull request may close these issues.

Migrate Kudu tests to use BaseConnectorTest
3 participants