CHANGELOG.md

Changelog

36.0.0 (2023-03-24)

Full Changelog

Breaking changes:

• Use dyn Array in sort kernels #3931 [arrow] (tustvold)
• Enforce struct nullability in JSON raw reader (#3900) (#3904) #3906 [arrow] (tustvold)
• Return ScalarBuffer from PrimitiveArray::values (#3879) #3896 [arrow] (tustvold)
• Use BooleanBuffer in BooleanArray (#3879) #3895 [arrow] (tustvold)
• Seal ArrowPrimitiveType #3882 [arrow] (tustvold)
• Support compression levels #3847 [parquet] (spebern)

Implemented enhancements:

• Improve speed of parsing string to Times #3919 [arrow]
• feat: add comparison/sort support for Float16 #3914
• Pinned version in arrow-flight's build-dependencies are causing conflicts #3876
• Add compression options (levels) #3844 [parquet] [arrow]
• Use Unsigned Integer for Fixed Size DataType #3815
• Common trait for RecordBatch and StructArray #3764 [arrow]
• Allow precision loss on multiplying decimal arrays #3689 [arrow]

Fixed bugs:

• Raw JSON Reader Allows Non-Nullable Struct Children to Contain Nulls #3904
• Nullable field with nested not nullable map in json #3900
• parquet_derive doesn't support Vec<u8> #3864 [parquet]
• [REGRESSION] Parsing timestamps with lower case time separator #3863 [arrow]
• [REGRESSION] Parsing timestamps with leap seconds #3861 [arrow]
• [REGRESSION] Parsing timestamps with fractional seconds / microseconds / milliseconds / nanoseconds #3859 [arrow]
• CSV Reader Doesn't set Timezone #3841
• PyArrowConvert Leaks Memory #3683 [arrow]

Merged pull requests:

• Derive RunArray Clone #3932 [arrow] (tustvold)
• Move protoc generation to binary crate, unpin prost/tonic build (#3876) #3927 [arrow] [arrow-flight] (tustvold)
• Fix JSON Temporal Encoding of Multiple Batches #3924 [arrow] (doki23)
• Cleanup uses of Array::data_ref (#3880) #3918 [parquet] [arrow] (tustvold)
• Support microsecond and nanosecond in interval parsing #3916 [arrow] (alamb)
• feat: add comparison/sort support for Float16 #3915 [arrow] (izveigor)
• Add AsArray trait for more ergonomic downcasting #3912 [parquet] [arrow] (tustvold)
• Add OffsetBuffer::new #3910 [arrow] (tustvold)
• Add PrimitiveArray::new (#3879) #3909 [arrow] (tustvold)
• Support timezones in CSV reader (#3841) #3908 [arrow] (tustvold)
• Improve ScalarBuffer debug output #3907 [arrow] (tustvold)
• Update proc-macro2 requirement from =1.0.52 to =1.0.53 #3905 [arrow] [arrow-flight] (dependabot[bot])
• Re-export parquet compression level structs #3903 [parquet] (tustvold)
• Fix parsing timestamps of exactly 32 characters #3902 [arrow] (tustvold)
• Add iterators to BooleanBuffer and NullBuffer #3901 [arrow] (tustvold)
• Array equality for &dyn Array (#3880) #3899 [arrow] (tustvold)
• Add BooleanArray::new (#3879) #3898 [arrow] (tustvold)
• Revert structured ArrayData (#3877) #3894 (tustvold)
• Fix pyarrow memory leak (#3683) #3893 [arrow] (tustvold)
• Minor: add examples for ListBuilder and GenericListBuilder #3891 [arrow] (alamb)
• Update syn requirement from 1.0 to 2.0 #3890 (dependabot[bot])
• Use of mul_checked to avoid silent overflow in interval arithmetic #3886 [arrow] (Weijun-H)
• Flesh out NullBuffer abstraction (#3880) #3885 [parquet] [arrow] (tustvold)
• Implement Bit Operations for i256 #3884 [arrow] (tustvold)
• Flatten arrow_buffer #3883 [arrow] (tustvold)
• Add Array::to_data and Array::nulls (#3880) #3881 [arrow] (tustvold)
• Added support for byte vectors and slices to parquet_derive (#3864) #3878 [parquet] (waymost)
• chore: remove LevelDecoder #3872 [parquet] (Weijun-H)
• Parse timestamps with leap seconds (#3861) #3862 [arrow] (tustvold)
• Faster time parsing (~93% faster) #3860 [arrow] (tustvold)
• Parse timestamps with arbitrary seconds fraction #3858 [arrow] (tustvold)
• Add BitIterator #3856 [arrow] (tustvold)
• Improve decimal parsing performance #3854 [arrow] (spebern)
• Update proc-macro2 requirement from =1.0.51 to =1.0.52 #3853 [arrow] [arrow-flight] (dependabot[bot])
• Update bitflags requirement from 1.2.1 to 2.0.0 #3852 [arrow] (dependabot[bot])
• Add offset pushdown to parquet #3848 [parquet] (tustvold)
• Add timezone support to JSON reader #3845 [arrow] (tustvold)
• Allow precision loss on multiplying decimal arrays #3690 [arrow] (viirya)

* This Changelog was automatically generated by github_changelog_generator