Add Trino 449 release notes

[colebow]

Description

Assemble the release notes for the upcoming Trino 449 release.

Verification for each pull request

Format: PR/issue number, ✅ / ❌ rn ✅ / ❌ docs
✅ rn - release note added and verified, or assessed to be not necessary, set to ❌ rn before completion
✅ docs - need for docs assessed and merged, or assessed to be not necessary, set to ❌ docs before completion

16 May 2024

• Close thrift metastore client in tests #21980 ✅ rn ✅ docs
• Fix Azure http client leak in Azure filesystem #21982 ✅ rn ✅ docs
• Updates may 16 #21991 ✅ rn ✅ docs
• Cache maven in maven-checks on JDK 22 #21994 ✅ rn ✅ docs
• Close Nessie client #21996 ✅ rn ✅ docs
• Suppress single table errors during metadata listing #21981 ✅ rn ✅ docs
• Reuse temp variables in Row Constructor code #22003 ✅ rn ✅ docs
• Remove unused classes #22002 ✅ rn ✅ docs
• Reuse more variables in row constructors #22004 ✅ rn ✅ docs
• Allow filesystem caching on coordinator unconditionally #21987 ✅ rn ✅ docs

17 May 2024

• Set air.compiler.fail-warnings as true in Cassandra #21944 ✅ rn ✅ docs
• Revert "Limit product tests Trino nodes memory" #22009 ✅ rn ✅ docs
• Apply workaround for JDK-8329528 #21999 ✅ rn ✅ docs
• Add support for the custom hive catalog to support Hive3 #21502 ✅ rn ✅ docs
• Fix milestone workflow #22012 ✅ rn ✅ docs
• Correct numeric type mapping of Snowflake Connector #21755 ✅ rn ✅ docs
• Reuse temp variables in other code generators #22011 ✅ rn ✅ docs

18 May 2024

• Desugar "not" during initial planning #21986 ✅ rn ✅ docs
• Set air.compiler.fail-warnings as true in lib modules #22019 ✅ rn ✅ docs
• Convert CassandraType to record #22017 ✅ rn ✅ docs
• Minor cleanup in Elasticsearch connector #22016 ✅ rn ✅ docs
• Minor cleanup in Pinot session properties #22014 ✅ rn ✅ docs
• Minor cleanup in OpenSearch connector #22015 ✅ rn ✅ docs

19 May 2024

• Use unnamed variables #22021 ✅ rn ✅ docs
• Avoid redundant tail slash check in TrinoRestCatalog #22023 ✅ rn ✅ docs
• Fix indentation #22018 ✅ rn ✅ docs
• Avoid unnecessary unboxing in SnapshotsTable #22025 ✅ rn ✅ docs
• Add $partitions system table to Delta Lake Connector #20993 ✅ rn ✅ docs
• Replace TimeStat.BlockTimer ignored with unnamed variable #22024 ✅ rn ✅ docs

20 May 2024

• Prevent IntelliJ from failing to import Maven project #22029 ✅ rn ✅ docs
• Throw TrinoException in dropNamespace when REST error #22030 ✅ rn ✅ docs
• Fix test comment typo #22034 ✅ rn ✅ docs
• Increase the default page size for listing BigQuery schemas and tables #22037 ✅ rn ✅ docs
• Specify RoundingMode explicitly in OrcMetrics #22038 ✅ rn ✅ docs
• Enable varchar equality predicate pushdown for ClickHouse connector #21557 ✅ rn ✅ docs
• Support type coercion for structural types in Iceberg and Delta Lake #21721 ✅ rn ✅ docs
• Remove deprecated method getTableHandle from spi #21532 ✅ rn ✅ docs

21 May 2024

• Unimplement deprecated fastutil method #22031 ✅ rn ✅ docs
• Resolve jjwt deprecations #22028 ✅ rn ✅ docs
• Set air.compiler.fail-warnings as true in Hudi #22047 ✅ rn ✅ docs
• Improve speed when bigquery.case-insensitive-name-matching is enabled #22033 ✅ rn ✅ docs
• Use storage API in BigQueryMetadata.finishInsert #22044 ✅ rn ✅ docs
• Remove unused UriInfo argument #22051 ✅ rn ✅ docs
• Add configurable retry policy for S3 client #21900 ✅ rn ✅ docs
• Set air.compiler.fail-warnings as true in BigQuery #22050 ✅ rn ✅ docs
• Do not slice ListVector #22041 ✅ rn ✅ docs
• Remove redundant testng exclusion from trino-thrift-testing-server #22061 ✅ rn ✅ docs

22 May 2024

• Provide roleSessionName for Glue metastore assume role credentials #22052 ✅ rn ✅ docs
• Fix GlueContext when catalog ID is present #22048 ✅ rn ✅ docs
• Remove testng-specific configuration #22053 ✅ rn ✅ docs
• Remove REST, JDBC, Nessie from some tests in TestIcebergSparkCompatibility #22062 ✅ rn ✅ docs
• Set air.compiler.fail-warnings as true in HTTP and MySQL event listeners #22060 ✅ rn ✅ docs
• Remove redundant empty lines from documentation #22056 ✅ rn ✅ docs
• Use Supplier to list datasets in BigQuery #22059 ✅ rn ✅ docs
• Replace deprecated QueryAssert.assertThat with Assertions.assertThat #22063 ✅ rn ✅ docs
• Throw TrinoException in case of not found catalog #22070 ✅ rn ✅ docs
• Speculative execution stats fixes #22076 ✅ rn ✅ docs
• Validate unsupported configuration options for Glue v2 #22069 ✅ rn ✅ docs
• Avoid using deprecated method in IcebergMetadata #22058 ✅ rn ✅ docs
• Throw TrinoException for Glue external failures #22065 ✅ rn ✅ docs
• Remove unused members of InformationSchemaMetadata #22077 ✅ rn ✅ docs
• Isolate selected tests from TestCassandraConnectorTest #22080 ✅ rn ✅ docs
• Iceberg View Rest Catalog support #19818 ✅ rn ✅ docs
• Improve Snowflake Iceberg catalog docs  #22001 ✅ rn ✅ docs
• Document query passthrough to Snowflake #21876 ✅ rn ✅ docs

23 May 2024

• Fix flush_metadata_cache with Glue v2 #22075 ✅ rn ✅ docs
• Import the right Preconditions class #22078 ✅ rn ✅ docs
• Delete temporary files in TestIcebergGlueCatalogAccessOperations #22079 ✅ rn ✅ docs
• Use hive.metastore of JVM options in DeltaLakeExternalQueryRunnerMain #22088 ✅ rn ✅ docs
• Inform about ignored cache config options with Glue v2 #22090 ✅ rn ✅ docs
• Use mayFail in PreAggregateCaseAggregations #22067 ✅ rn ✅ docs
• Fix typo in hive connectors documentation #22093 ✅ rn ✅ docs
• Throw TrinoException for not supported CSV #22064 ✅ rn ✅ docs
• Remove unused methods from DockerContainer #22094 ✅ rn ✅ docs
• Add estimatedMemoryReservationDistribution to stage task statistic in… #22095 ✅ rn ✅ docs
• Fix Iceberg value for varbinary #22072 ✅ rn ✅ docs

24 May 2024

• Minor refactoring in Kudu #22084 ✅ rn ✅ docs
• Upgrade Pinot Libraries to 1.1.0 #21234 ✅ rn ✅ docs
• Advise to disable IntelliJ warning to mark vars final #22107 ✅ rn ✅ docs
• Avoid flakiness in test when dropping potentially inexistent table #22109 ✅ rn ✅ docs
• Dependency updates #22108 ✅ rn ✅ docs
• Update docker-images version to 95 #22111 ✅ rn ✅ docs
• Equality delete #21441 ✅ rn ✅ docs
• Fix ArrayType indeterminateOperator with a DictionaryBlock #22125 ✅ rn ✅ docs
• Update maven-wrapper to 3.3.2 #22112 ✅ rn ✅ docs
• Set air.compiler.fail-warnings as true in Prometheus #22128 ✅ rn ✅ docs
• Throw TrinoException for invalid Iceberg sort field #22132 ✅ rn ✅ docs
• Remove unused dependencies from Hudi #22127 ✅ rn ✅ docs
• Set air.compiler.fail-warnings as true in trino-exchange-filesystem and trino-exchange-hdfs modules #22126 ✅ rn ✅ docs
• Revert "Avoid flakiness in test when dropping table" #22113 ✅ rn ✅ docs
• Convert some classes to record in Accumulo #22129 ✅ rn ✅ docs
• Convert some classes to record in Atop #22130 ✅ rn ✅ docs

25 May 2024

• Update nessie to 0.83.2 #22110 ✅ rn ✅ docs
• Avoid using some deprecated methods of Parquet #22134 ✅ rn ✅ docs
• Allow adding and droping fields to records wrapped in array  #22115 ✅ rn ✅ docs
• Update docker-images version to 96 #22140 ✅ rn ✅ docs
• Update Maven to 3.9.7 #22139 ✅ rn ✅ docs
• Do not add BUILDHOST to rpm #22135 ✅ rn ✅ docs
• Remove unused method from TransactionLogAccess in Delta Lake #22141 ✅ rn ✅ docs
• Set air.compiler.fail-warnings as true in Kafka #22085 ✅ rn ✅ docs

26 May 2024

• Unwrap short error message #22145 ✅ rn ✅ docs
• Verify deletion vector checksum in Delta Lake #22150 ✅ rn ✅ docs
• Improve performance of SortedRangeSet discrete union #22073 ✅ rn ✅ docs
• Add support for vacuumProtocolCheck feature in Delta Lake #22144 ✅ rn ✅ docs
• Implement streamRelationColumns in Cassandra #22146 ✅ rn ✅ docs

27 May 2024

• Implement streamRelationComments in Cassandra #22155 ✅ rn ✅ docs
• Fail when multiple JVM args matching #22160 ✅ rn ✅ docs
• Add junit-extensions to modules missing it #22161 ✅ rn ✅ docs
• Simple event listener exposing data via HTTP #22158 ✅ rn ❌ docs
• Simplify JVM flag checking logic #22164 ✅ rn ✅ docs
• Convert query runner to builder in ClickHouse #22154 ✅ rn ✅ docs
• Enable pushdown of a few aggregation functions for ClickHouse Connector #21840 ✅ rn ✅ docs

28 May 2024

• Write checkpoint if necessary for CREATE OR REPLACE statements #21609 ✅ rn ✅ docs
• Disable HTTP/2 negotiation for trino-client/jdbc #22171 ✅ rn ✅ docs
• Add more product tests coverage for native filesystem GCS and Azure #21958 ✅ rn ✅ docs
• Updates #22156 ✅ rn ✅ docs
• Add extra diagnostics to pinpoint issue with missing spoolingOutputStats #22170 ✅ rn ✅ docs
• Reuse getAllTableComments for getTableNames in BaseJdbcClient #22173 ✅ rn ✅ docs
• Optimize writing RLE runs in parquet column descriptors #22089 ✅ rn ✅ docs

29 May 2024

• Convert PinotQueryRunner to builder #22131 ✅ rn ✅ docs
• Enable warning/error logs from libraries in tests #22186 ✅ rn ✅ docs
• Revert "Enable warning/error logs from libraries in tests" #22189 ✅ rn ✅ docs
• Update trino-maven-plugin to v15 #22191 ✅ rn ✅ docs
• Docs: Update Iceberg REST docs to reflect that view management via Iceberg views are supported #22169 ✅ rn ✅ docs
• Clarify register_table requirement #21874 ✅ rn ✅ docs

30 May 2024

• Revert "Enable JMX metrics for resource groups by default" #22185 ✅ rn ✅ docs
• Use Statistics.Builder instead of mutating Statistics in Parquet MetadataReader #22136 ✅ rn ✅ docs
• Set air.compiler.fail-warnings as true in Redis and remove deprecated DateTimeUtils.parseLegacyTime #22202 ✅ rn ✅ docs
• Set air.compiler.fail-warnings as true in Pinot #22200 ✅ rn ✅ docs

31 May 2024

• Remove legacy non-gRPC client from Pinot #22213 ✅ rn ✅ docs
• feat: add OpenLineage EventListener plugin #21265 ✅ rn ✅ docs

[findepi]

How rare is the "rare"? What does it mean from user perspective?
Asking for guidance when formulating future proposed release notes entries.

[findepi]

Not sure whether "syntax" here is right. Maybe "serde" or "storage format"?

[findepi]

All Delta data files are Parquet, so maybe we should just say "Improve writing performance".

[findepi]

I believe this fixed writes to tables partitioned on varbinary column, not just tables with varbinary column

[findepi]

Should this also be {{breaking}}?

cc @ebyhr

[mosabua]

I dont think so from what I can tell following along on the PR, but @ebyhr should confirm

[findepi]

we wanted initial snowflake PR to have as little type mapping as possible, because fixing it later is a breaking change (results are different). or was it not a correctness fix?

[mosabua]

I think it was just narrowing down to smaller types on the snowflake side .. @lxynov and @ebyhr should confirm

[mosabua]

@colebow can you send a PR to address the various feedback

[oneonestar]

* Add support for configuring the query retry policy on the S3 filesystem with
  the `s3.retry-mode` and `s3.max-error-retries` configuration properties.

missing a link to issue.

[oneonestar]

- `hive.metastore.thrift.catalog-name` configuration property. (`10287`)
+ `hive.metastore.thrift.catalog-name` configuration property. ({issue}`10287`)

[mosabua]

A follow up PR - #22262