You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the bug
There is a minor bug in cudf.io.merge_parquet_filemetadata after #14264 was merged. Some details are discussed in that PR. E.g. #14264 (comment)
Closes#14315Closes#14326
Parquet writer writes time and timestamp types with logical type with `isAdjustedToUTC` as `false`. However, timestamps in libcudf tables are implicitly in UTC and don't need to be adjusted.
This PR changes the `isAdjustedToUTC` to true.
Also added a writer option to write timestamps as local, as this is the expected behavior on the Python side.
Also changed the way logical type is handled for UNKNOWN type columns in `merge_row_group_metadata` - the logical type is excluded from merged metadata because of issues with type inference.
Authors:
- Vukasin Milovanovic (https://github.com/vuule)
Approvers:
- David Wendt (https://github.com/davidwendt)
- GALI PREM SAGAR (https://github.com/galipremsagar)
- Mike Wilson (https://github.com/hyperbolic2346)
URL: #14322
Describe the bug
There is a minor bug in
cudf.io.merge_parquet_filemetadata
after #14264 was merged. Some details are discussed in that PR. E.g. #14264 (comment)Steps/Code to reproduce bug
Expected behavior
Null column metadata should be "promoted" when it is merged with integer metedata for the same column.
Additional context
This bug is unlikely to affect many users, and can be treated as a low priority if the fix proves difficult.
The text was updated successfully, but these errors were encountered: