-
Notifications
You must be signed in to change notification settings - Fork 1.9k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Feature][Shade] Add seatunnel hadoop3 uber #3755
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Add version scope to seatunnel uber dependency.
seatunnel-e2e/seatunnel-flink-connector-v2-e2e/connector-iceberg-flink-e2e/pom.xml
Show resolved
Hide resolved
Please check CI errors. |
<artifactId>seatunnel-shade</artifactId> | ||
<packaging>pom</packaging> | ||
<modules> | ||
<module>seatunnel-hadoop3-3.1.4-uber</module> |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think the name of seatunnel-hadoop3-shade may be better.There's no need to add hadoop version to module name.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think the name of seatunnel-hadoop3-shade may be better.There's no need to add hadoop version to module name.
I don't think so. We will add more hadoop version shaded jar in the next version.
924b421
to
8ce8a79
Compare
seatunnel-e2e/seatunnel-flink-connector-v2-e2e/connector-iceberg-flink-e2e/pom.xml
Show resolved
Hide resolved
...l-engine/seatunnel-engine-storage/checkpoint-storage-plugins/checkpoint-storage-hdfs/pom.xml
Show resolved
Hide resolved
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
Now many module test used
flink shade hadoop
, We tested useflink shade hadoop
jar will trigger jackson jar conflict when we useMySQL CDC Source
. So we add a seatunnel owner hadoop shaded uber jar.