Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature Request] Shallow clone Iceberg tables #1464

Closed
dennyglee opened this issue Oct 28, 2022 · 3 comments
Closed

[Feature Request] Shallow clone Iceberg tables #1464

dennyglee opened this issue Oct 28, 2022 · 3 comments
Labels
enhancement New feature or request
Milestone

Comments

@dennyglee
Copy link
Contributor

Feature request

Overview

Enable shallow cloning parquet-backed Iceberg tables following the Delta protocols without the need to copy all of the data.

Motivation

We want to make it easier for users to read parquet-backed Iceberg tables within the context of Delta pipelines. While #1462 enables users to convert parquet-backed Iceberg tables to Delta in place, this may interfere with existing pipeline processes. Propose to use a SHALLOW CLONE to create a Delta log that points to the original files.

Further details

We will have to think about what this API / module / JAR / artifact, etc. will look like. Would love to hear feedback and thoughts from the community!

@dennyglee dennyglee added the enhancement New feature or request label Oct 28, 2022
@giucris
Copy link

giucris commented Feb 28, 2023

Hi. Is there any news regarding this feature?

@allisonport-db
Copy link
Collaborator

Resolved in ff805d0 and will be in the next release

@allisonport-db allisonport-db added this to the 2.3.0 milestone Mar 9, 2023
@giucris
Copy link

giucris commented Mar 9, 2023

Thank you @allisonport-db.
I'm waiting for it

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants