You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Per 1076, it would be great for delta-rs to support column mapping. With Delta tables that support column mapping, the altering or dropping of columns is a metadata only operation.
Use Case
As folks can enable column mapping for Delta tables, it would be great for delta-rs to support this feature.
On python side, I guess it's not possible to implement with the current to_pyarrow_dataset method, since Dataset does not support a distinction between physical and logical column names. I opened an issue about that: apache/arrow#36593
With pyarrow Table would be fairly straight forward, one could probably also expose a RecordBatchReader based on a dataset which uses physical column names.
Description
Per 1076, it would be great for delta-rs to support column mapping. With Delta tables that support column mapping, the altering or dropping of columns is a metadata only operation.
Use Case
As folks can enable column mapping for Delta tables, it would be great for delta-rs to support this feature.
Related Issue(s)
#1076, #1064
The text was updated successfully, but these errors were encountered: