CHANGELOG.md

Changelog

33.0.0 (2023-02-10)

Full Changelog

Breaking changes:

• Use ArrayFormatter in Cast Kernel #3668 [arrow] (tustvold)
• Use dyn Array in cast kernels #3667 [arrow] (tustvold)
• Return references from FixedSizeListArray and MapArray #3652 [parquet] [arrow] (tustvold)
• Lazy array display (#3638) #3647 [parquet] [arrow] (tustvold)
• Use array_value_to_string in arrow-csv #3514 [arrow] (JayjeetAtGithub)

Implemented enhancements:

• Support UTF8 cast to Timestamp with timezone #3664
• Add modulus_dyn and modulus_scalar_dyn #3648 [arrow]
• A trait for append_value and append_null on ArrayBuilders #3644
• Improve error messge "batches[0] schema is different with argument schema" #3628 [arrow]
• Specified version of helper function to cast binary to string #3623 [arrow]
• Casting generic binary to generic string #3606 [arrow]
• Use array_value_to_string in arrow-csv #3483 [arrow]

Fixed bugs:

• ArrowArray::try_from_raw Misleading Signature #3684 [arrow]
• PyArrowConvert Leaks Memory #3683 [arrow]
• Arrow-csv reader cannot produce RecordBatch even if the bytes are necessary #3674
• FFI Fails to Account For Offsets #3671 [arrow]
• Regression in CSV reader error handling #3656 [arrow]
• UnionArray Child and Value Fail to Account for non-contiguous Type IDs #3653 [arrow]
• Panic when accessing RecordBatch from pyarrow #3646 [arrow]
• Multiplication for decimals is incorrect #3645
• Inconsistent output between pretty print and CSV writer for Arrow #3513 [arrow]

Closed issues:

• Release 33.0.0 of arrow/arrow-flight/parquet/parquet-derive (next release after 32.0.0) #3682
• Release 32.0.0 of arrow/arrow-flight/parquet/parquet-derive (next release after 31.0.0) #3584 [parquet] [arrow] [arrow-flight]

Merged pull requests:

• Move FFI to sub-crates #3687 [arrow] (tustvold)
• Update to 33.0.0 and update changelog #3686 [parquet] [arrow] [arrow-flight] (iajoiner)
• Cleanup FFI interface (#3684) (#3683) #3685 [arrow] (tustvold)
• fix: take_run benchmark parameter #3679 [arrow] (askoa)
• Minor: Add some examples to Date*Array and Time*Array #3678 [arrow] (alamb)
• Add CSV Decoder::capacity (#3674) #3677 [arrow] (tustvold)
• Add ArrayData::new_null and DataType::primitive_width #3676 [arrow] (tustvold)
• Fix FFI which fails to account for offsets #3675 [arrow] (viirya)
• Support UTF8 cast to Timestamp with timezone #3673 [arrow] (comphead)
• Fix Date64Array docs #3670 [arrow] (tustvold)
• Update proc-macro2 requirement from =1.0.50 to =1.0.51 #3669 [arrow] [arrow-flight] (dependabot[bot])
• Add timezone accessor for Timestamp*Array #3666 [arrow] (tustvold)
• Faster timezone cast #3665 [arrow] (tustvold)
• feat + fix: IPC support for run encoded array. #3662 [arrow] (askoa)
• Implement std::fmt::Write for StringBuilder (#3638) #3659 [arrow] (tustvold)
• Include line and field number in CSV UTF-8 error (#3656) #3657 [arrow] (tustvold)
• Handle non-contiguous type_ids in UnionArray (#3653) #3654 [arrow] (tustvold)
• Add modulus_dyn and modulus_scalar_dyn #3649 [arrow] (viirya)
• Improve error messge with detailed schema #3637 [arrow] (Veeupup)
• Add limit to ArrowReaderBuilder to push limit down to parquet reader #3633 [parquet] (thinkharderdev)
• chore: delete wrong comment and refactor set_metadata in Field #3630 [arrow] (chunshao90)
• Fix typo in comment #3627 [parquet] (kjschiroo)
• Minor: Update doc strings about Page Index / Column Index #3625 [parquet] (alamb)
• Specified version of helper function to cast binary to string #3624 [arrow] (viirya)
• feat: take kernel for RunArray #3622 [arrow] (askoa)
• Remove BitSliceIterator specialization from try_for_each_valid_idx #3621 [arrow] (tustvold)
• Reduce PrimitiveArray::try_unary codegen #3619 [arrow] (tustvold)
• Reduce Dictionary Builder Codegen #3616 [arrow] (tustvold)
• Minor: Add test for dictionary encoding of batches #3608 [arrow-flight] (alamb)
• Casting generic binary to generic string #3607 [arrow] (viirya)
• Add ArrayAccessor, Iterator, Extend and benchmarks for RunArray #3603 [arrow] (askoa)

* This Changelog was automatically generated by github_changelog_generator