CHANGELOG.md

Changelog

32.0.0 (2023-01-26)

Full Changelog

Breaking changes:

• Allow StringArray construction with Vec<Option<String>> #3602 [arrow] (sinistersnare)
• Use native types in PageIndex (#3575) #3578 [parquet] (tustvold)
• Add external variant to ParquetError (#3285) #3574 [parquet] (tustvold)
• Return reference from ListArray::values #3561 [arrow] (tustvold)
• feat: Add RunEndEncodedArray #3553 [parquet] [arrow] (askoa)

Implemented enhancements:

• There should be a From<Vec<Option<String>>> impl for GenericStringArray<OffsetSize> #3599
• FlightDataEncoder Optionally send Schema even when no record batches #3591 [arrow-flight]
• [object_store] support more identity based auth flows for azure #3580
• Use Native Types in PageIndex #3575
• Packing array into dictionary of generic byte array #3571
• Implement Error::Source for ArrowError and FlightError #3566
• [FlightSQL] Allow access to underlying FlightClient #3551
• Arrow CSV writer should not fail when cannot cast the value #3547
• Implement workload identity and application default credentials for GCP object store. #3533
• Write Deprecated Min Max Statistics When ColumnOrder Signed #3526
• Support footer kv metadata for IPC file #3432
• Add External variant to ParquetError #3285

Fixed bugs:

• Nullif of NULL Predicate is not NULL #3589
• BooleanBufferBuilder Fails to Clear Set Bits On Truncate #3587
• nullif incorrectly calculates null_count, sometimes panics with substraction overflow error #3579
• Meet warning when use pyarrow #3543
• Incorrect row group total_byte_size written to parquet file #3530
• Overflow when casting timestamps prior to the epoch #3512

Closed issues:

• Panic on Key Overflow in Dictionary Builders #3562
• Bumping version gives compilation error (arrow-array) #3525
• Release Arrow 31.0.0 (next release after 30.0.0) #3415

Merged pull requests:

• Update to flatbuffers 23.1.21 #3597 [arrow] (tustvold)
• Faster BooleanBufferBuilder::append_n for true values #3596 [arrow] (tustvold)
• Support sending schemas for empty streams #3594 [arrow-flight] (alamb)
• Faster ListArray to StringArray conversion #3593 [arrow] (tustvold)
• Add conversion from StringArray to BinaryArray #3592 [arrow] (tustvold)
• Fix nullif null count (#3579) #3590 [arrow] (tustvold)
• Clear bits in BooleanBufferBuilder (#3587) #3588 [arrow] (tustvold)
• Iterate all dictionary key types in cast test #3585 [arrow] (viirya)
• Propagate EOF Error from AsyncRead #3576 [parquet] (Sach1nAgarwal)
• Show row_counts also for (FixedLen)ByteArray #3573 [parquet] (bmmeijers)
• Packing array into dictionary of generic byte array #3572 [arrow] (viirya)
• Remove unwrap on datetime cast for CSV writer #3570 [arrow] (comphead)
• Implement std::error::Error::source for ArrowError and FlightError #3567 [arrow] [arrow-flight] (alamb)
• Improve GenericBytesBuilder offset overflow panic message (#139) #3564 [arrow] (tustvold)
• Implement Extend for ArrayBuilder (#1841) #3563 [arrow] (tustvold)
• Update pyarrow method call with kwargs #3560 [arrow] (Frankonly)
• Update pyo3 requirement from 0.17 to 0.18 #3557 [arrow] (viirya)
• Expose Inner FlightServiceClient on FlightSqlServiceClient (#3551) #3556 [arrow-flight] (tustvold)
• Fix final page row count in parquet-index binary #3554 [parquet] (tustvold)
• Parquet Avoid Reading 8 Byte Footer Twice from AsyncRead #3550 [parquet] (Sach1nAgarwal)
• Improve concat kernel capacity estimation #3546 [arrow] (tustvold)
• Update proc-macro2 requirement from =1.0.49 to =1.0.50 #3545 [arrow-flight] (dependabot[bot])
• Update pyarrow method call to avoid warning #3544 [arrow] (Frankonly)
• Enable casting between Utf8/LargeUtf8 and Binary/LargeBinary #3542 [arrow] (viirya)
• Use GHA concurrency groups (#3495) #3538 (tustvold)
• set sum of uncompressed column size as row group size for parquet files #3531 [parquet] (sidred)
• Minor: Add documentation about memory use for ArrayData #3529 [arrow] (alamb)
• Upgrade to clap 4.1 + fix test #3528 [parquet] (tustvold)
• Write backwards compatible row group statistics (#3526) #3527 [parquet] (tustvold)
• No panic on timestamp buffer overflow #3519 [arrow] (comphead)
• Support casting from binary to dictionary of binary #3482 [arrow] (viirya)

* This Changelog was automatically generated by github_changelog_generator