CHANGELOG.md

Changelog

38.0.0 (2023-04-21)

Full Changelog

Breaking changes:

• Remove DataType from PrimitiveArray constructors #4098 [arrow] (tustvold)
• Use Into<Arc<str>> for PrimitiveArray::with_timezone #4097 [arrow] (tustvold)
• Store StructArray entries in MapArray #4085 [parquet] [arrow] (tustvold)
• Add DictionaryArray Constructors (#3879) #4068 [arrow] [arrow-flight] (tustvold)
• Relax JSON schema inference generics #4063 [arrow] (tustvold)
• Remove ArrayData from Array (#3880) #4061 [arrow] (tustvold)
• Add CommandGetXdbcTypeInfo to Flight SQL Server #4055 [arrow] [arrow-flight] (c-thiel)
• Remove old JSON Reader and Decoder (#3610) #4052 [parquet] [arrow] (tustvold)
• Use BufRead for JSON Schema Inference #4041 [arrow] (WenyXu)

Implemented enhancements:

• Support dyn_compare_scalar for Decimal256 #4083 [arrow]
• Better JSON Reader Error Messages #4076 [arrow]
• Additional data type groups #4056 [arrow]
• Async JSON reader #4043 [arrow]
• Field::contains Should Recurse into DataType #4029 [arrow]
• Prevent UnionArray with Repeated Type IDs #3982 [parquet] [arrow]
• Support Timestamp +/- Interval types #3963 [arrow]
• First-Class Array Abstractions #3880 [parquet] [arrow] [arrow-flight]

Fixed bugs:

• Update readme to remove reference to Jira #4091
• OffsetBuffer::new Rejects 0 Offsets #4066 [arrow]
• Parquet AsyncArrowWriter not shutting down inner async writer. #4058 [parquet]
• Flight SQL Server missing command type.googleapis.com/arrow.flight.protocol.sql.CommandGetXdbcTypeInfo #4054 [arrow] [arrow-flight]
• RawJsonReader Errors with Empty Schema #4053 [parquet] [arrow]
• RawJsonReader Integer Truncation #4049 [arrow]
• Sparse UnionArray Equality Incorrect Offset Handling #4044 [arrow]

Documentation updates:

• Write blog about improvements in JSON and CSV processing #4062 [arrow]

Closed issues:

• Parquet reader of Int96 columns and coercion to timestamps #4075
• Serializing timestamp from int (json raw decoder) #4069 [arrow]
• Support casting to/from Interval and Duration #3998 [arrow]

Merged pull requests:

• Fix Docs Typos #4100 [parquet] (rnarkk)
• Update tonic-build requirement from =0.9.1 to =0.9.2 #4099 [arrow] [arrow-flight] (dependabot[bot])
• Increase minimum chrono version to 0.4.24 #4093 [arrow] (alamb)
• Simplify reference to GitHub issues #4092 (bkmgit)
• [Minor]: Add Hash trait to SortOptions. #4089 [arrow] (mustafasrepo)
• Include byte offsets in parquet-layout #4086 [parquet] (tustvold)
• feat: Support dyn_compare_scalar for Decimal256 #4084 [arrow] (izveigor)
• Add ByteArray constructors (#3879) #4081 [arrow] (tustvold)
• Update prost-build requirement from =0.11.8 to =0.11.9 #4080 [arrow] [arrow-flight] (dependabot[bot])
• Improve JSON decoder errors (#4076) #4079 [arrow] (tustvold)
• Fix Timestamp Numeric Truncation in JSON Reader #4074 [arrow] (tustvold)
• Serialize numeric to tape (#4069) #4073 [arrow] (tustvold)
• feat: Prevent UnionArray with Repeated Type IDs #4070 [arrow] (Weijun-H)
• Add PrimitiveArray::try_new (#3879) #4067 [arrow] (tustvold)
• Add ListArray Constructors (#3879) #4065 [arrow] (tustvold)
• Shutdown parquet async writer #4059 [parquet] (kindly)
• feat: additional data type groups #4057 [arrow] (izveigor)
• Fix precision loss in Raw JSON decoder (#4049) #4051 [arrow] (tustvold)
• Use lexical_core in CSV and JSON parser (~25% faster) #4050 [arrow] (tustvold)
• Add offsets accessors to variable length arrays (#3879) #4048 [arrow] (tustvold)
• Document Async decoder usage (#4043) (#78) #4046 [arrow] (tustvold)
• Fix sparse union array equality (#4044) #4045 [arrow] (tustvold)
• feat: DataType::contains support nested type #4042 [arrow] (Weijun-H)
• feat: Support Timestamp +/- Interval types #4038 [arrow] (Weijun-H)
• Fix object_store CI #4037 (tustvold)
• feat: cast from/to interval and duration #4020 [arrow] (Weijun-H)

* This Changelog was automatically generated by github_changelog_generator