CHANGELOG.md

Changelog

42.0.0 (2023-06-16)

Full Changelog

Breaking changes:

• Remove 64-bit to 32-bit Cast from IPC Reader #4412 [arrow] (ming08108)
• Truncate Min/Max values in the Column Index #4389 [parquet] (AdamGS)
• feat(flight): harmonize server metadata APIs #4384 [arrow] [arrow-flight] (roeap)
• Move record delimiting into ColumnReader (#4365) #4376 [parquet] (tustvold)
• Changed array_to_json_array to take &dyn Array #4370 [arrow] (dadepo)
• Make PrimitiveArray::with_timezone consuming #4366 [parquet] [arrow] (tustvold)

Implemented enhancements:

• Add doc example of constructing a MapArray #4385 [arrow]
• Support millisecond and microsecond functions #4374 [arrow]
• Changed array_to_json_array to take &dyn Array #4369 [arrow]
• compute::ord kernel for getting min and max of two scalar/array values #4347 [arrow]
• Release 41.0.0 of arrow/arrow-flight/parquet/parquet-derive #4346
• Refactor CAST tests to use new cast array syntax #4336 [arrow]
• pass bytes directly to parquet's KeyValue #4317
• PyArrow conversions could return TypeError if provided incorrect Python type #4312 [arrow]
• Have array_to_json_array support Map #4297 [arrow]
• FlightSQL: Add helpers to create CommandGetXdbcTypeInfo responses (XdbcInfoValue and builders) #4257 [arrow] [arrow-flight]
• Have array_to_json_array support FixedSizeList #4248 [arrow]
• Truncate ColumnIndex ByteArray Statistics #4126 [parquet]
• Arrow compute kernel regards selection vector #4095 [arrow]

Fixed bugs:

• Wrongly calculated data compressed length in IPC writer #4410 [arrow]
• Take Kernel Handles Nullable Indices Incorrectly #4404 [arrow]
• StructBuilder::new Doesn't Validate Builder DataTypes #4397 [arrow]
• Parquet error: Not all children array length are the same! when using RowSelection to read a parquet file #4396
• RecordReader::skip_records Is Incorrect for Repeated Columns #4368 [parquet]
• List-of-String Array panics in the presence of row filters #4365 [parquet]
• Fail to read block compressed gzip files with parquet-fromcsv #4173 [parquet]

Closed issues:

• Have a parquet file not able to be deduped via arrow-rs, complains about Decimal precision? #4356
• Question: Could we move dict_id, dict_is_ordered into DataType? #4325

Merged pull requests:

• Fix reading gzip file with multiple gzip headers in parquet-fromcsv. #4419 [parquet] (ghuls)
• Cleanup nullif kernel #4416 [arrow] (tustvold)
• Fix bug in IPC logic that determines if the buffer should be compressed or not #4411 [arrow] (lwpyr)
• Faster unpacking of Int32Type dictionary #4406 [arrow] (tustvold)
• Improve take kernel performance on primitive arrays, fix bad null index handling (#4404) #4405 [arrow] (tustvold)
• More take benchmarks #4403 [arrow] (tustvold)
• Add BooleanBuffer::new_unset and BooleanBuffer::new_set and BooleanArray::new_null constructors #4402 [arrow] (tustvold)
• Add PrimitiveBuilder type constructors #4401 [arrow] (tustvold)
• StructBuilder Validate Child Data (#4397) #4400 [arrow] (tustvold)
• Faster UTF-8 truncation #4399 [parquet] (tustvold)
• Minor: Derive Hash impls for CastOptions and FormatOptions #4395 [arrow] (alamb)
• Fix typo in README #4394 [arrow] [arrow-flight] (okue)
• Improve parquet WriterProperites and ReaderProperties docs #4392 [parquet] (alamb)
• Cleanup downcast macros #4391 [arrow] (tustvold)
• Update proc-macro2 requirement from =1.0.59 to =1.0.60 #4388 [arrow] [arrow-flight] (dependabot[bot])
• Consolidate ByteArray::from_iterator #4386 [arrow] (tustvold)
• Add MapArray constructors and doc example #4382 [arrow] (tustvold)
• Documentation Improvements #4381 [arrow] (tustvold)
• Add NullBuffer and BooleanBuffer From conversions #4380 [arrow] (tustvold)
• Add more examples of constructing Boolean, Primitive, String, and Decimal Arrays, and From impl for i256 #4379 [arrow] (alamb)
• Add ListArrayReader benchmarks #4378 [parquet] (tustvold)
• Update comfy-table requirement from 6.0 to 7.0 #4377 [arrow] (dependabot[bot])
• feat: Addmicrosecond and millisecond kernels #4375 [arrow] (izveigor)
• Update hashbrown requirement from 0.13 to 0.14 #4373 [parquet] [arrow] (dependabot[bot])
• minor: use as_boolean to resolve TODO #4367 [arrow] (jackwener)
• Have array_to_json_array support MapArray #4364 [arrow] (dadepo)
• deprecate: as_decimal_array #4363 [arrow] (izveigor)
• Add support for FixedSizeList in array_to_json_array #4361 [arrow] (dadepo)
• refact: use as_primitive in cast.rs test #4360 [arrow] (Weijun-H)
• feat(flight): add xdbc type info helpers #4359 [arrow] [arrow-flight] (roeap)
• Minor: float16 to json #4358 [arrow] (izveigor)
• Raise TypeError on PyArrow import #4316 [arrow] (wjones127)
• Arrow Cast: Fixed Point Arithmetic for Interval Parsing #4291 [arrow] (mr-brobot)

* This Changelog was automatically generated by github_changelog_generator