parquet::record::RowIter cannot be customized with batch_size and defaults to 1024 #4782
Labels
enhancement
Any new improvement worthy of a entry in the changelog
parquet
Changes to the parquet crate
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
I'd like to read parquet file with custom batch_size using parquet::record::RowIter
Describe the solution you'd like
Allow custom tree builder for parquet::record::RowIter
Describe alternatives you've considered
replace parquet::record::RowIter with own implementation
Additional context
SerializedFileReader::get_row_iter and SerializedRowGroupReader::get_row_iter returns parquet::record::RowIter, so I cannot set custom batch_size to the result anyhow
The text was updated successfully, but these errors were encountered: