-
Notifications
You must be signed in to change notification settings - Fork 3k
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Co-authored-by: Manfred Moser <[email protected]>
- Loading branch information
Showing
2 changed files
with
165 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,164 @@ | ||
| # Release 423 (10 Aug 2023) | ||
|
|
||
| ## General | ||
|
|
||
| * Add support for renaming nested fields in a column via `RENAME COLUMN`. ({issue}`16757`) | ||
| * Add support for setting the type of a nested field in a column via `SET DATA TYPE`. ({issue}`16959`) | ||
| * Add support for comments on materialized view columns. ({issue}`18016`) | ||
| * Add support for displaying all Unicode characters in string literals. ({issue}`5061`) | ||
| * Improve performance of `INSERT` and `CREATE TABLE AS ... SELECT` queries. ({issue}`18212`) | ||
| * Improve performance when planning queries involving multiple window functions. ({issue}`18491`) | ||
| * Improve performance of queries involving `BETWEEN` clauses. ({issue}`18501`) | ||
| * Improve performance of queries containing redundant `ORDER BY` clauses in | ||
| views or `WITH` clauses. This may affect the semantics of queries that | ||
| incorrectly rely on implementation-specific behavior. The old behavior can be | ||
| restored via the `skip_redundant_sort` session property or the | ||
| `optimizer.skip-redundant-sort` configuration property. ({issue}`18159`) | ||
| * Reduce default values for the `task.partitioned-writer-count` and | ||
| `task.scale-writers.max-writer-count` configuration properties to reduce the | ||
| memory requirements of queries that write data. ({issue}`18488`) | ||
| * Remove the deprecated `optimizer.use-mark-distinct` configuration property, | ||
| which has been replaced with `optimizer.mark-distinct-strategy`. ({issue}`18540`) | ||
| * Fix query planning failure due to dynamic filters in | ||
| [fault tolerant execution mode](/admin/fault-tolerant-execution). ({issue}`18383`) | ||
| * Fix `EXPLAIN` failure when a query contains `WHERE ... IN (NULL)`. ({issue}`18328`) | ||
|
|
||
| ## JDBC driver | ||
|
|
||
| * Add support for | ||
| [constrained delegation](https://web.mit.edu/kerberos/krb5-latest/doc/appdev/gssapi.html#constrained-delegation-s4u) | ||
| with Kerberos. ({issue}`17853`) | ||
|
|
||
| ## CLI | ||
|
|
||
| * Add support for accepting a single Trino JDBC URL with parameters as an | ||
| alternative to passing command line arguments. ({issue}`12587`) | ||
|
|
||
| ## ClickHouse connector | ||
|
|
||
| * Add support for `CASCADE` option in `DROP SCHEMA` statements. ({issue}`18305`) | ||
|
|
||
| ## Blackhole connector | ||
|
|
||
| * Add support for materialized views. ({issue}`18016`) | ||
| * Add support for the `COMMENT ON VIEW` statement. ({issue}`18516`) | ||
|
|
||
| ## Delta Lake connector | ||
|
|
||
| * Add `$properties` system table which can be queried to inspect Delta Lake | ||
| table properties. ({issue}`17294`) | ||
| * Add support for reading the `timestamp_ntz` type. ({issue}`17502`) | ||
| * Add support for writing the `timestamp with time zone` type on partitioned | ||
| columns. ({issue}`16822`) | ||
| * Add option to enforce that a filter on a partition key is present for | ||
| query processing. This can be enabled by setting the | ||
| ``delta.query-partition-filter-required`` configuration property or the | ||
| ``query_partition_filter_required`` session property to ``true``. | ||
| ({issue}`18345`) | ||
| * Improve performance of the `$history` system table. ({issue}`18427`) | ||
| * Improve memory accounting of the Parquet writer. ({issue}`18564`) | ||
| * Allow metadata changes on Delta Lake tables with | ||
| [identity columns](https://github.com/delta-io/delta/blob/master/PROTOCOL.md#identity-columns). ({issue}`18200`) | ||
| * Fix incorrectly creating files smaller than the configured | ||
| `file_size_threshold` as part of `OPTIMIZE`. ({issue}`18388`) | ||
| * Fix query failure when a table has a file with a location ending with | ||
| whitespace. ({issue}`18206`) | ||
|
|
||
| ## Hive connector | ||
|
|
||
| * Add support for `varchar` to `timestamp` coercion in Hive tables. ({issue}`18014`) | ||
| * Improve memory accounting of the Parquet writer. ({issue}`18564`) | ||
| * Remove the legacy Parquet writer, along with the | ||
| `parquet.optimized-writer.enabled` configuration property and the | ||
| `parquet_optimized_writer_enabled ` session property. Replace the | ||
| `parquet.optimized-writer.validation-percentage` configuration property with | ||
| `parquet.writer.validation-percentage`. ({issue}`18420`) | ||
| * Disallow coercing Hive `timestamp` types to `varchar` for dates before 1900. ({issue}`18004`) | ||
| * Fix loss of data precision when coercing Hive `timestamp` values. ({issue}`18003`) | ||
| * Fix incorrectly creating files smaller than the configured | ||
| `file_size_threshold` as part of `OPTIMIZE`. ({issue}`18388`) | ||
| * Fix query failure when a table has a file with a location ending with | ||
| whitespace. ({issue}`18206`) | ||
| * Fix incorrect results when using S3 Select and a query predicate includes a | ||
| quote character (`"`) or a decimal column. ({issue}`17775`) | ||
| * Add the `hive.s3select-pushdown.experimental-textfile-pushdown-enabled` | ||
| configuration property to enable S3 Select pushdown for `TEXTFILE` tables. ({issue}`17775`) | ||
|
|
||
| ## Hudi connector | ||
|
|
||
| * Improve memory accounting of the Parquet writer. ({issue}`18564`) | ||
| * Fix incorrectly creating files smaller than the configured | ||
| `file_size_threshold` as part of `OPTIMIZE`. ({issue}`18388`) | ||
| * Fix query failure when a table has a file with a location ending with | ||
| whitespace. ({issue}`18206`) | ||
|
|
||
| ## Iceberg connector | ||
|
|
||
| * Add support for renaming nested fields in a column via `RENAME COLUMN`. ({issue}`16757`) | ||
| * Add support for setting the type of a nested field in a column via | ||
| `SET DATA TYPE`. ({issue}`16959`) | ||
| * Add support for comments on materialized view columns. ({issue}`18016`) | ||
| * Add support for `tinyint` and `smallint` types in the `migrate` procedure. ({issue}`17946`) | ||
| * Add support for reading Parquet files with time stored in millisecond precision. ({issue}`18535`) | ||
| * Improve performance of `information_schema.columns` queries for tables managed | ||
| by Trino with AWS Glue as metastore. ({issue}`18315`) | ||
| * Improve performance of `system.metadata.table_comments` when querying Iceberg | ||
| tables backed by AWS Glue as metastore. ({issue}`18517`) | ||
| * Improve performance of `information_schema.columns` when using the Glue | ||
| catalog. ({issue}`18586`) | ||
| * Improve memory accounting of the Parquet writer. ({issue}`18564`) | ||
| * Fix incorrectly creating files smaller than the configured | ||
| `file_size_threshold` as part of `OPTIMIZE`. ({issue}`18388`) | ||
| * Fix query failure when a table has a file with a location ending with | ||
| whitespace. ({issue}`18206`) | ||
| * Fix failure when creating a materialized view on a table which has been | ||
| rolled back. ({issue}`18205`) | ||
| * Fix query failure when reading ORC files with nullable `time` columns. ({issue}`15606`) | ||
| * Fix failure to calculate query statistics when referring to `$path` as part of | ||
| a `WHERE` clause. ({issue}`18330`) | ||
| * Fix write conflict detection for `UPDATE`, `DELETE`, and `MERGE` operations. | ||
| In rare situations this issue may have resulted in duplicate rows when | ||
| multiple operations were run at the same time, or at the same time as an | ||
| `optimize` procedure. ({issue}`18533`) | ||
|
|
||
| ## Kafka connector | ||
|
|
||
| * Rename the `ADD_DUMMY` value for the `kafka.empty-field-strategy` | ||
| configuration property and the `empty_field_strategy` session property to | ||
| `MARK` ({issue}`18485`). | ||
|
|
||
| ## Kudu connector | ||
|
|
||
| * Add support for optimized local scheduling of splits. ({issue}`18121`) | ||
|
|
||
| ## MariaDB connector | ||
|
|
||
| * Add support for `CASCADE` option in `DROP SCHEMA` statements. ({issue}`18305`) | ||
|
|
||
| ## MongoDB connector | ||
|
|
||
| * Add support for predicate pushdown on `char` and `decimal` type. ({issue}`18382`) | ||
|
|
||
| ## MySQL connector | ||
|
|
||
| * Add support for predicate pushdown for `=`, `<>`, `IN`, `NOT IN`, and `LIKE` | ||
| operators on case-sensitive `varchar` and `nvarchar` columns. ({issue}`18140`, {issue}`18441`) | ||
| * Add support for `CASCADE` option in `DROP SCHEMA` statements. ({issue}`18305`) | ||
|
|
||
| ## Oracle connector | ||
|
|
||
| * Add support for Oracle `timestamp` types with non-millisecond precision. ({issue}`17934`) | ||
| * Add support for `CASCADE` option in `DROP SCHEMA` statements. ({issue}`18305`) | ||
|
|
||
| ## SingleStore connector | ||
|
|
||
| * Add support for `CASCADE` option in `DROP SCHEMA` statements. ({issue}`18305`) | ||
|
|
||
| ## SPI | ||
|
|
||
| * Deprecate the `ConnectorMetadata.getTableHandle(ConnectorSession, SchemaTableName)` | ||
| method signature. Connectors should implement | ||
| `ConnectorMetadata.getTableHandle(ConnectorSession, SchemaTableName, Optional, Optional)` | ||
| instead. ({issue}`18596`) | ||
| * Remove the deprecated `supportsReportingWrittenBytes` method from | ||
| ConnectorMetadata. ({issue}`18617`) |