Speed up Parquet utf8 validation #6667
Labels
enhancement
Any new improvement worthy of a entry in the changelog
parquet
Changes to the parquet crate
performance
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
Utf8 validation comes up in profiles when reading Parquet.
Describe the solution you'd like
We could use https://docs.rs/simdutf8/latest/simdutf8/ to speed up validation of utf8.
Describe alternatives you've considered
Additional context
The text was updated successfully, but these errors were encountered: