You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
BufferBuilder is effectively a Vec<T: ArrowNativeType> that can be converted to Buffer without needing to copy. This is an incredibly useful abstraction for incrementally building and mutating data in place, prior to freezing it for hand-off to other systems.
Unfortunately it is currently lacking some relatively minor functionality to enable this use-case. In particular access to the data that has been already written. The parquet crate currently rolls its own ScalarBuffer to work around this, but as described in #1849 it would be nice to avoid this duplication.
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
BufferBuilder
is effectively aVec<T: ArrowNativeType>
that can be converted toBuffer
without needing to copy. This is an incredibly useful abstraction for incrementally building and mutating data in place, prior to freezing it for hand-off to other systems.Unfortunately it is currently lacking some relatively minor functionality to enable this use-case. In particular access to the data that has been already written. The parquet crate currently rolls its own ScalarBuffer to work around this, but as described in #1849 it would be nice to avoid this duplication.
Describe the solution you'd like
Add the following APIs to
BufferBuilder
Describe alternatives you've considered
We could not do this
Additional context
arrow::array::builder
module #1843)The text was updated successfully, but these errors were encountered: