CHANGELOG.md

Changelog

31.0.0 (2023-01-12)

Full Changelog

Breaking changes:

• support RFC3339 style timestamps in arrow-json #3449 [arrow] (JayjeetAtGithub)
• Improve arrow flight batch splitting and naming #3444 [arrow-flight] (alamb)
• Parquet record API: timestamp as signed integer #3437 [parquet] (ByteBaker)
• Support decimal int32/64 for writer #3431 [parquet] (liukun4515)

Implemented enhancements:

• Support casting Date32 to timestamp #3504 [arrow]
• Support casting strings like '2001-01-01' to timestamp #3492
• Allow providing service account key directly when building GCP object store client #3488
• CLI to "rewrite" parquet files #3476
• Add more dictionary value type support to build_compare #3465
• Allow concat_batches to take non owned RecordBatch #3456
• Release Arrow 30.0.1 (maintenance release for 30.0.0) #3455
• Add string comparisons (starts_with, ends_with, and contains) to kernel #3442
• make_builder Loses Timezone and Decimal Scale Information #3435
• Use RFC3339 style timestamps in arrow-json #3416
• ArrayDataget_slice_memory_size or similar #3407

Fixed bugs:

• Sliced batch w/ bool column doesn't roundtrip through IPC #3496 [arrow-flight]
• take kernel on List array introduces nulls instead of empty lists #3471
• Infinite Loop If Skipping More CSV Lines than Present #3469

Closed issues:

• object_store: temporary aws credentials not refreshed? #3446

Merged pull requests:

• Additional nullif re-export #3515 [arrow] (tustvold)
• Enable cast Date32 to Timestamp #3508 [arrow] (comphead)
• Update prost-build requirement from =0.11.5 to =0.11.6 #3507 [arrow-flight] (dependabot[bot])
• minor fix for the comments #3505 [arrow] (liukun4515)
• Fix DataTypeLayout for LargeList #3503 [arrow] (viirya)
• Add string comparisons (starts_with, ends_with, and contains) to kernel #3502 [arrow] (snmvaughan)
• Add a function to get memory size of array slice #3501 [arrow] (askoa)
• Fix IPCWriter for Sliced BooleanArray #3498 [arrow] (crepererum)
• Fix: Added support to cast string without time #3494 [arrow] (gaelwjl)
• Fix negative interval prettyprint #3491 [arrow] (Jefffrey)
• Fixes a broken link in the arrow lib.rs rustdoc #3487 [arrow] (AdamGS)
• Refactoring build_compare for decimal and using downcast_primitive #3484 (viirya)
• Add tests for record batch size splitting logic in FlightClient #3481 [arrow-flight] (alamb)
• change concat_batches parameter to non owned reference #3480 [arrow] (askoa)
• feat: add parquet-rewrite CLI #3477 [parquet] (crepererum)
• Preserve empty list array elements in take kernel #3473 [arrow] (jonmmease)
• Add a test for stream writer for writing sliced array #3472 [arrow] (viirya)
• Fix CSV infinite loop and improve error messages #3470 [arrow] (tustvold)
• Add more dictionary value type support to build_compare #3466 (viirya)
• Add tests for FlightClient::{list_flights, list_actions, do_action, get_schema} #3463 [arrow-flight] (alamb)
• Minor: add ticket links to failing ipc integration tests #3461 (alamb)
• feat: column_name based index access for RecordBatch and StructArray #3458 [arrow] (askoa)
• Support Decimal256 in FFI #3453 [arrow] (viirya)
• Remove multiversion dependency #3452 [arrow] (tustvold)
• Re-export nullif kernel #3451 [arrow] (tustvold)
• Meaningful error message for map builder with null keys #3450 [arrow] (Jefffrey)
• Parquet writer v2: clear buffer after page flush #3447 [parquet] (askoa)
• Verify ArrayData::data_type compatible in PrimitiveArray::from #3440 [arrow] (tustvold)
• Preserve DataType metadata in make_builder #3438 [arrow] (tustvold)
• Consolidate arrow ipc tests and increase coverage #3427 [arrow] (alamb)
• Generic bytes dictionary builder #3426 [arrow] (viirya)
• Minor: Improve docs for arrow-ipc, remove clippy ignore #3421 [arrow] (alamb)
• refactor: convert *like_dyn, *like_utf8_scalar_dyn and *like_dict functions to macros #3411 [arrow] (askoa)
• Add parquet-index binary #3405 [parquet] (tustvold)
• Complete mid-level FlightClient #3402 [arrow-flight] (alamb)
• Implement RecordBatch <--> FlightData encode/decode + tests #3391 [arrow] [arrow-flight] (alamb)
• Provide into_builder for bytearray #3326 [arrow] (viirya)

* This Changelog was automatically generated by github_changelog_generator