python-v0.25.2

New features

• feat: set clientVersion for python binding by @ion-elgreco in #3242

Bug Fixes

• fix: aarch64 ssl handshakes by @ion-elgreco in #3263
• fix: enable missing cloud features for uc crate by @omkar-foss in #3260
• fix: refresh snapshot after vacuuming logs by @ion-elgreco in #3252
• fix: use tableprovider scan in z-order by @ion-elgreco in #3238
• fix: commitlint config by @roeap in #3268

Other Changes

• chore: inline format args to improve readability by @nyurik in #3154
• chore: update readme for Generated columns by @ion-elgreco in #3247
• docs: update CONTRIBUTING.md and Makefile to account for switch to uv by @adamreeve in #3257
• chore: fix some compiler warnings by @alamb in #3262
• chore: fix clippy warnings on main by @alamb in #3264
• chore: use builder API to create FileScanConfig by @alamb in #3266
• chore: update tests to use Column::new and other expr_fn functions by @alamb in #3265

New Contributors

• @adamreeve made their first contribution in #3257

Full Changelog: python-v0.25.1...python-v0.25.2

python-v0.25.0: Improved memory writer, schema evolution `merge` and UC support

Highlights

• Streamed execution in write and merge (lower memory pressure)
• Overall improved memory allocation
• Schema evolution in MERGE
• Unity catalog support through uc:// uri-prefix

Performance improvements

• feat: streamed execution in MERGE by @ion-elgreco in #3145
• feat: streamed execution, writer refactor, simplified generated columns and schema evolution by @ion-elgreco in #3229
• refactor: logical plans in writer by @ion-elgreco in #3141
• chore(python): choose performance over compile time in release mode by @ion-elgreco in #3177
• chore(python): use custom global alloc by @ion-elgreco in #3176

New features

• feat: add schema evolution to merge statement by @JustinRush80 in #3136
• feat(python): add capability to read unity catalog (uc://) uris by @omkar-foss in #3113
• feat: support reading tables via Unity Catalog provided credentials by @hntd187 in #3078
• feat: added workspace oauth source for UC by @hntd187 in #3152
• feat: update metadata field builder by @Nordalf in #3149
• feat: set column metadata from python by @umartin in #3189
• feat(disable conflict checker): start counting concurrent retries at 0 and disable conflict checker with maxRetries=0 by @daphnenhuch-at in #3204
• feat: make Add:get_stats public by @jkylling in #3216
• feat: configurable column encoding for parquet checkpoint files by @dmunch in #3214
• feat: return metrics about the commit by @HawaiianSpork in #3202
• feat: cdf tableprovider with predicate pushdown support by @ion-elgreco in #3220

Bug Fixes

• fix: properly encode metadata field values when creating actions by @rtyler in #3183
• fix: only use stats for required cols by @ion-elgreco in #3210
• fix: load cdf latest version by @ion-elgreco in #3218
• fix: adhere write stats configuration by @ion-elgreco in #3209
• fix(rust, python): treat FSCK files_removed as strings by @liamphmurphy in #3219
• fix: update snapshot after conflict check by @ion-elgreco in #3205

Other Changes

• chore: preparing the 0.24 release of the Rust crates` by @rtyler in #3132
• chore: fix typos by @roeap in #3138
• refactor: combine normal and cdf plan until write for merge by @ion-elgreco in #3142
• chore: remove lazy_static and once_cell dependencies by @nyurik in #3148
• docs: Fix broken markdown syntax by @hattajr in #3134
• chore: minor changes to allow 0.24.0 to be published by @rtyler in #3158
• chore: prevent the pr actions from filing on merge_group by @rtyler in #3161
• docs: fix broken links by @ion-elgreco in #3179
• chore: update to DataFusion 45.0.0 / arrow/parquet 54.0.0 by @alamb in #3175
• chore: adopt the released datafusion 45 release by @rtyler in #3195
• fix: removing openssl from the dependency tree by @rtyler in #3160
• chore: remove the unnecessary hashbrown dependency by @rtyler in #3198
• chore: switch to cache@v4 by @rtyler in #3230
• fix(typo): s/implemtnation/implementation/ by @akesling in #3227
• chore: bump python 0.25 by @ion-elgreco in #3233
• chore(python): set streaming opt-in by @ion-elgreco in #3178

New Contributors

• @nyurik made their first contribution in #3148
• @hattajr made their first contribution in #3134
• @JustinRush80 made their first contribution in #3136
• @umartin made their first contribution in #3189
• @daphnenhuch-at made their first contribution in #3204
• @dmunch made their first contribution in #3214
• @akesling made their first contribution in #3227

Full Changelog: python-v0.24.0...python-v0.25.0

python-v0.24.0: LakeFS integration + GeneratedColumns

New features

• feat: lakefs integration by @ion-elgreco in #3103
• feat: generated columns by @ion-elgreco in #3123
• feat: retryable config enablement through storage_options by @ion-elgreco in #3129
• feat(python, rust): add statistics_enabled to ColumnProperties by @maxitg in #3126

Bug Fixes

• fix: aws credential resolving, reduce api calls by @ion-elgreco in #3107
• fix: reading cdf from a checkpointed table by @hntd187 in #3110
• fix: ignore crc files when checking if provided path correspond to a valid delta table by @guillotjulien in #3122
• fix: fmt scalar view values by @ion-elgreco in #3130
• fix: docs rendering by @Abdullahsab3 in #3120

Other Changes

• refactor: use kernel table features by @ion-elgreco in #3117
• chore: update readme with latest state of project by @ion-elgreco in #3118
• chore(deps): update itertools requirement from 0.13 to 0.14 by @dependabot in #3104
• chore: allow kernel::visitors to be public for Snapshot usage by @rtyler in #2966
• feat(docs): minor documentation typo by @Milias in #3131
• chore: 0.24 py release by @ion-elgreco in #3127
• chore: raise patch versions for rust crate release by @rtyler in #3114

New Contributors

• @guillotjulien made their first contribution in #3122
• @Milias made their first contribution in #3131

Full Changelog: python-v0.23.2...python-v0.24.0

python-v0.23.2

What's Changed

• fix: introduce a reproduction case for List casting with polars by @rtyler in #3093
• feat(python): add except_cols argument to when_matched_update_all and when_not_matched_insert_all for excluding specific columns by @mrjsj in #3098
• feat(python): add sql() and show() convenience method to QueryBuilder by @DevChrisCross in #3100
• docs: rust usage documentation by @Abdullahsab3 in #3089
• feat: allow multiple Python threads to work with a single DeltaTable instance by @rtyler in #3101

New Contributors

• @DevChrisCross made their first contribution in #3100
• @Abdullahsab3 made their first contribution in #3089

Full Changelog: python-v0.23.1...python-v0.23.2

python-v0.23.1

What's Changed

• fix: scalar extraction view types by @ion-elgreco in #3095

Full Changelog: python-v0.23.0...python-v0.23.1

python-v0.23.0: conditional put for S3 by default

New features

• feat: add out_of_range flag to load_cdf by @pblocz in #3040
• refactor: make put-if-absent default for S3 stores by @ion-elgreco in #3091

Bug Fixes

• fix: add explicit type casts while merge by @t1g0rz in #3050
• fix: add decimal expr parsing by @ion-elgreco in #3090
• fix: raise during checkpoint creating with without_files by @ion-elgreco in #3059
• fix: use of deprecated DeltaTable::peek_next_commit by @jkylling in #3080
• fix: remove println from regular_rename func by @tom1919 in #3071
• fix: use projected_table_schema for projection in DeltaSchemaAdapter by @jkylling in #3068
• fix: use correct aws_endpoint key by @ion-elgreco in #3072
• fix: add test for Parquet column pruning in scans by @jkylling in #3079
• fix: allow more than 15 concurrent transactions to have been committed by @rtyler in #3067

Other Changes

• chore: bump delta-kernel to 0.5.0 by @roeap in #3051
• chore: bump kernel 0.6 and datafusion 44 by @ion-elgreco in #3087
• chore: use uv by @thomas-chauvet in #3042
• Add steps to install uv in venv by @FranArenas in #3085
• feat: move unity catalog integration to it's own crate by @hntd187 in #3044
• chore: bump versions for next release(s) by @rtyler in #3061
• chore: create a new minor version with the MSRV upgrade by @rtyler in #3069

New Contributors

• @pblocz made their first contribution in #3040
• @tom1919 made their first contribution in #3071
• @FranArenas made their first contribution in #3085

Full Changelog: python-v0.22.3...python-v0.23.0

python-v0.22.3

What's Changed

• fix: attempt to workaround problems reading actions as empty rather than null by @rtyler in #3045

Full Changelog: python-v0.22.2...python-v0.22.3

python-v0.22.2: QueryBuilder

What's Changed

• fix: check top level nullability during write by @ion-elgreco in #3026
• feat: read delta table using datafusion by @PeterKeDer in #2922
• chore: bump for another python and core release by @rtyler in #3038

Full Changelog: python-v0.22.1...python-v0.22.2

python-v0.22.1

What's Changed

• fix: jsonwriter and recordbatchwriter to respect stats skipping by @jusjosj in #2989
• chore: bump the python version for release by @rtyler in #3024
• chore: refactor some of the writebuilder preconditions into the appropriate function by @rtyler in #3022
• fix(python): pass ending_timestamp correctly by @ion-elgreco in #3025
• chore(deps): update hashbrown requirement from 0.14.3 to 0.15.2 by @dependabot in #3028
• fix: workaround for Add actions being read slightly differently out of parquet files by @rtyler in #3031

Full Changelog: python-v0.22.0...python-v0.22.1

python-v0.22.0

What's Changed

• chore: bump the python package version to 0.21.0 by @rtyler in #2967
• fix: enable readerFeatures in minReaderVersion 3 by @rjancewicz in #2970
• chore(deps): update which requirement from 6 to 7 by @dependabot in #2971
• perf: close partition writers concurrently by @alexwilcoxson-rel in #2984
• chore(deps): update thiserror requirement from 1 to 2 by @dependabot in #2985
• perf: batch json decode checkpoint actions when writing to parquet by @alexwilcoxson-rel in #2983
• docs: fix typo by @RyRyRyNguyen in #2977
• fix: update object_store to 0.10.2 by @thomasfrederikhoeck in #2994
• fix: cache credential resolution with the AWS credential provider by @rtyler in #2987
• fix: jsonwriter should checkpoint by default by @jusjosj in #2993
• fix: correctly recognize existing delta tables using the transaction log by @stretchadito in #3005
• fix: fixed the deprecation warnings in spot check step of the build by @vksx in #3007
• chore: upgrade to datafusion 43 by @ion-elgreco in #2886
• docs: fix the verify table existence example in usage docs by @vksx in #3003
• fix: decimal stat rounding overflow by @gruuya in #2975
• feat: upgrade to delta_kernel 0.4.1 🎉 by @rtyler in #3016
• chore: include license files in published crates by @ankane in #3009
• docs: explain the value of deltalake on first page of docs by @braaannigan in #3017
• feat: provide direct TableProvider integration in datafusion-python by @timsaucer in #3012
• fix: expression with dates to string conversation by @JonasDev1 in #3019
• chore: fixed a bunch of warnings and deprecations by @hntd187 in #3020
• fix: num rows statistics by @lewiszlw in #2990
• docs: mention AWS_ENDPOINT_URL_DYNAMODB by @maxitg in #3021
• feat: override dynamodb config by @thomas-chauvet in #3011

New Contributors

• @rjancewicz made their first contribution in #2970
• @RyRyRyNguyen made their first contribution in #2977
• @stretchadito made their first contribution in #3005
• @vksx made their first contribution in #3007
• @ankane made their first contribution in #3009
• @timsaucer made their first contribution in #3012
• @lewiszlw made their first contribution in #2990
• @maxitg made their first contribution in #3021
• @thomas-chauvet made their first contribution in #3011

Full Changelog: python-v0.21.0...python-v0.22.0