You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I had searched in the issues and found no similar issues.
What happened
similar to #4873.
This improvement only addresses the case when.hive-staging_hive*** is a file, not when.hive-staging_hive*** is a temporary folder.
I encounter the following situation when.hive-staging_hive is a folder, and the folder needs to be filtered out.
Is this a bug that needs to be fixed? If so, I can submit a pr to resolve
seatunnel.sh --config test.conf --deploy-mode local
Error Exception
Caused by: java.lang.RuntimeException: hdfs://xxx/xxx_mx_change_log_di/.hive-staging_hive_2021-07-22_13-56-05_587_1779994300234021397-1/-ext-10000/_temporary/0/_temporary/attempt_20210722135614_0000_m_000000_0/part-00000-effc5e0c-deaa-4d2f-941b-6644f5c945cc-c000 is not a Parquet file. Expected magic number at tail, but found [-2, 12, 0, 8]
at org.apache.seatunnel.shade.connector.file.org.apache.parquet.hadoop.ParquetFileReader.readFooter(ParquetFileReader.java:557)
Search before asking
What happened
similar to #4873.
This improvement only addresses the case when.hive-staging_hive*** is a file, not when.hive-staging_hive*** is a temporary folder.
I encounter the following situation when.hive-staging_hive is a folder, and the folder needs to be filtered out.
Is this a bug that needs to be fixed? If so, I can submit a pr to resolve
SeaTunnel Version
2.3.8
SeaTunnel Config
Running Command
seatunnel.sh --config test.conf --deploy-mode local
Error Exception
Zeta or Flink or Spark Version
No response
Java or Scala Version
JDK 1.8
Screenshots
Are you willing to submit PR?
Code of Conduct
The text was updated successfully, but these errors were encountered: