Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Improve][Connector][Hive] skip temporary hidden directories #8402

Merged
merged 5 commits into from
Jan 1, 2025

Conversation

sohurdc
Copy link
Contributor

@sohurdc sohurdc commented Dec 30, 2024

Purpose of this pull request

skip temporary hidden directories (like .hive-stage_hive) that are generated during Hive queries. these path cannot parse partition info.

Does this PR introduce any user-facing change?

no

How was this patch tested?

no

Check list

…ive-stage_hive) that are generated during Hive queries. these path cannot parse partition info.
Copy link
Member

@Hisoka-X Hisoka-X left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

OK for me. Could you add a unit test? Thanks.

binwang219962 added 2 commits December 30, 2024 18:03
…ive-stage_hive) that are generated during Hive queries. these path cannot parse partition info.
…ive-stage_hive) that are generated during Hive queries. these path cannot parse partition info.
@sohurdc
Copy link
Contributor Author

sohurdc commented Dec 30, 2024

ok, I have add a unit test.

…ive-stage_hive) that are generated during Hive queries. these path cannot parse partition info.
…/test/java/org/apache/seatunnel/connectors/seatunnel/file/source/reader/AbstractReadStrategyTest.java

Co-authored-by: Jia Fan <[email protected]>
@Hisoka-X Hisoka-X changed the title [Improve][Connector][Hive] skip temporary hidden directories (like .h… [Improve][Connector][Hive] skip temporary hidden directories Dec 31, 2024
@hailin0 hailin0 merged commit 9fdedc4 into apache:dev Jan 1, 2025
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants