Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Leverage partitionValues_parsed from arrow state to report partition values #2771

Open
roeap opened this issue Aug 14, 2024 · 4 comments
Open
Assignees
Labels
enhancement New feature or request

Comments

@roeap
Copy link
Collaborator

roeap commented Aug 14, 2024

Description

Currently we parse partition values ad-hoc from raw string data in teh various state / snapshot APIs. Since we now have partitionValues_parsed included in the arrow state, we should directly read from that data to avoid additional work.

Use Case

Related Issue(s)

@omkar-foss
Copy link
Contributor

Please ignore the issue mention above, it was a typo while trying something out. Sorry!

@ion-elgreco
Copy link
Collaborator

@roeap are you still looking into this?

@roeap
Copy link
Collaborator Author

roeap commented Feb 11, 2025

@ion-elgreco - sort of, the main avenue to a more optimized treatment would now IMO be via kernel. Hoping to file a larger issue soon to align on the best approach for adoption.

@ion-elgreco
Copy link
Collaborator

@roeap alright, looking forward to that :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants