Release notes for 331 #2880

electrum · 2020-02-19T05:12:03Z

Dain Sundstrom

all checked
02-19 08:06:48 c32c44b Remove option to disable internal JWT
02-19 08:16:20 fa98e89 Change JWT configuration properties to match naming convention
02-19 08:17:21 9b917d1 Add product tests for full acid reads
02-19 08:17:21 c58ff37 Simplify cleanup in test
02-19 08:17:21 c9c16a3 Add DELETE_DELTA locations in HiveSplit
02-19 08:17:21 d2aeb08 Add support for reading ORC ACID files
02-19 08:17:21 e498a33 Add support for reading full acid tables having deleted files
02-19 09:44:14 402fb11 Simplify LiteralEncoder
02-19 09:44:14 ae407a1 Cleanup TypeRegistry constructor
02-19 09:44:14 b839a3d Add config to Re2JRegexpType
02-19 09:55:05 b97777d Add simple login page to UI
02-19 11:21:04 70b1289 Add native parquet writer
02-19 16:32:40 8a89c29 Ensure QueryCompletedEvent occurs when query fails during planning
02-19 16:32:40 c271488 Add StateMachine.trySet()
02-19 16:35:25 8416bac Improve testability and extensibility of S3 filesystem
02-19 16:35:25 d7ef48a Improve readability of TestPrestoS3FileSystem
02-19 17:22:15 3488e89 Remove deprecated constructors in Identity
02-19 17:22:15 e8e0835 Add builder to ConnectorIdentity
02-19 17:22:15 f7a012e Remove unused ConnectorIdentity equals and hashCode
02-20 16:33:45 4aaa1cd Resolve IS DISTINCT FROM operator only for join columns
02-21 11:44:39 5f2caa0 Implement query rules in file based system access control
02-21 11:44:39 ba6ed24 Add query authorization
02-22 15:27:37 2fbe07f Add access control check for SHOW CRETAE TABLE and VIEW
02-25 19:42:07 d66e2c6 Request delegate credentials for Kerberos
02-26 12:18:27 38f6527 Add identity destroy to free up authenticator resources
02-27 14:30:20 ad98ab4 Do not return coordinator in NodeSelector.allNodes() if include-coordinator=false

David Phillips

all checked
02-24 13:46:15 3e95224 Remove unnecessary plugin extensions
02-24 13:46:15 7d51633 Update presto-maven-plugin version
02-26 10:08:06 b356a87 Use JAXB for Base64 encoding in aws sdk with Java 9+
02-26 12:11:52 39043a5 Update to Iceberg 0.7.0
02-26 12:11:52 83e8b1e Add support for Iceberg manifests tables
02-26 12:11:52 c97e3dd Add support for Iceberg files tables
02-26 17:02:41 1e81a5a Simplify connector differences for testDescribeTable
02-26 17:02:41 337dd30 Make testDuplicatedRowCreateTable engine only
02-26 17:02:41 4335b05 Implement DROP SCHEMA for JDBC connectors
02-26 17:02:41 5de3231 Move schema creation tests to distributed query tests
02-26 17:02:41 60dad01 Allow overriding image for TestingMySqlServer
02-26 17:02:41 65a5712 Add CredentialPropertiesProvider for base JDBC
02-26 17:02:41 8cb956f Use bean validation for MySQL connector URL
02-26 17:02:41 b863870 Move insert default tests to distributed query tests
02-26 17:02:41 e5a0d78 Make assertExplainAnalyze protected
02-27 16:55:22 6d3ebaa Rename to Web UI
02-28 14:50:36 b5da8a7 Refactor blackhole connector
02-28 23:28:40 cf033ed Add BigQuery connector
02-28 23:56:06 455d6b9 Implement JDBC PreparedStatement.getMetaData
03-01 11:19:40 457397a Cleanup JDBC connector modules
03-01 11:19:40 f4bb205 Make test servers protected in JDBC smoke tests
03-06 11:51:30 4374841 Cache AWS Current Region Result
03-06 14:48:45 8a63f26 Increase default HTTP request/response header size
03-06 14:48:45 e8e0d5e Update to Airlift 0.193
03-06 18:21:19 d1f86a1 Allow specifying rounding mode when encoding decimals
03-06 18:22:33 34312cd Make randomTableSuffix utility method public
03-09 13:34:39 65d4633 bump aws-sdk to 1.11.697

Grzegorz Kokosiński

all checked
02-21 02:17:47 dbca08a Remove obsolete product tests README.md content
02-22 13:31:20 0e379a3 Extract pluggable KafkaTableDescriptionSupplier
02-22 13:31:20 103ca30 Extract Kafka EnvironmentExtender
02-22 13:31:20 1edcc50 Introduce Builder for KafkaQueryRunner
02-22 13:31:20 21cde55 Do not close not created testing Kafka
02-22 13:31:20 293baec Remove not needed sleep
02-22 13:31:20 6754427 Do not set kafka.table-names in tests
02-22 13:31:20 6fefc66 Do not close parameter testingKafka
02-22 13:31:20 92e8b7b Allow to extend Kafka connector
02-22 13:31:20 9fa65b6 Make KafkaConnectorFactory constructor public
02-22 13:31:20 b7719be Extract temporaryDirectory
02-22 13:31:20 d5ee56c Configure KafkaConsumer as Kafka extension
02-24 02:31:42 2b85e5e Remove access control checkCanShowTablesMetadata
02-25 05:47:32 36ecbb3 Update docker images version to 27

Karol Sobczak

all checked
02-19 01:35:32 dba8855 Display Physical Input Read Rate in UI
02-20 03:29:27 083df41 Wait for running queries issued during grace period to finish
02-20 04:12:53 4a5c26c Avoid getPositionsSizeInBytes call in calculateCompactSize
02-20 04:14:44 bd9c744 Always compact pages in OrderBy operator
02-20 05:14:08 26ad3fb Port AssignUniqueIdOperator to work processor
02-20 05:14:08 310ffec Add task id to ProcessorContext
02-20 05:14:08 534d9ea Add WorkProcessorOperatorAdapter#createAdapterOperatorFactory
02-20 05:14:08 73b542c Add BasicWorkProcessorOperatorAdapter
02-20 05:14:08 73e1a0e Provide default empty implementation for WorkProcessorOperator#close
02-20 05:14:08 90dcbe8 Add javadoc description to WorkProcessorOperatorAdapter
02-20 05:14:08 aad1951 Reorganize methods in LookupJoinOperatorFactory
02-20 05:14:08 d5fbc32 Make LookupJoinOperator constructor package private
02-20 05:14:08 d7d5fb0 Move private fields below public interfaces
02-20 05:14:08 e0f567e Port StreamingAggregationOperator to work processor
02-21 02:17:11 1a9ec60 Fix copying to clipboard on UI, update ClipboardJS version
02-21 02:47:31 2efa01d Remove redundant type check
02-21 02:47:31 4a52b0b Remove redundant remote exchanges due to missing unaliasing
02-22 12:28:31 c31ed4f Add missing support for bucket sort order in Glue

Martin Traverso

all checked
02-19 10:53:40 5cb9de3 Extend SortExpressionExtractor for BETWEEN predicate
02-19 11:59:35 2085190 Move ConnectorObjectNameGenerator to plugin toolkit
02-19 11:59:35 a836ce3 Add timing and logging for Elasticsearch calls
02-19 12:00:33 de97d15 Implement toString in LimitMatcher
02-25 08:43:54 7e0d88e Add support for column masking
02-25 08:43:54 a5b186d Import method statically
02-25 08:43:54 fae3147 Add support for row filtering
02-27 22:10:40 b9cab68 Implement optional check that query has partition filter
02-28 17:05:10 5f5e57f Memoize ATN visit states to avoid exponential backtracking
02-28 17:08:47 47be37156a Add 331 release notes

Piotr Findeisen

all checked
02-20 13:48:35 8241b61 Fix invalid span ids
02-21 04:21:38 13e53d7 Fix last_day_of_month for timestamp with time zone
02-21 05:05:42 5f29411 Add Hive 3 metastore config for CSV and Avro support
02-21 05:16:41 228ab1f Support bucketed ACID files
02-21 05:16:41 41625e4 Simplify & unify test code for transactional tables
02-21 05:16:41 88dc473 Extract enum as top level class
02-21 05:16:41 ccc65e7 Merge transactional tables tests
02-21 08:43:12 242137c Remove obsolete TODO notes
02-21 09:53:03 0ce467e Document query management properties
02-21 13:40:47 7419534 Document log properties and launcher options
02-22 05:03:56 2e52bd1 Fix reading bucketing version for Glue
02-22 05:03:56 789027e Mark skipped tests as skipped
02-22 05:03:56 da15255 Remove unnecessary overload
02-24 03:37:16 0a13a2e Format data sizes across web UI
02-24 04:28:11 0e6980b Add sort asc/desc icons to table
02-24 04:32:25 4ab76c2 Fix redirect to /ui behind proxy
02-24 04:32:25 bdb27e7 Fix resource leak in tests
02-26 06:46:03 c7362ff Fix displaying prepared query in UI
02-26 13:13:40 440bbee Change field placeholder to reflect behaviour on UI
02-27 13:47:22 5838df5 Test reading decimals with different parquet storage primitive
02-27 13:47:22 7f0de1a Fix decimal precision so it can represent test values
02-27 13:47:22 dbc9cee Short circuit when no conversion happens
02-27 13:47:22 e36dbff Allow rescaling parquet decimals
02-28 11:00:13 b184eb1 Fix typo in docs
02-28 12:27:29 c6c7cb7 Fail parsing dates beyond a representable range
02-28 13:03:35 ebf1cca Add new GC option for JVM version > 9

The text was updated successfully, but these errors were encountered:

sopel39 · 2020-02-19T09:36:21Z

UI
--

* Display physical input read rate in UI. (:issue:`2873`)

#2873

dain · 2020-02-19T16:10:41Z

Security
--------
* Remove unused `internal-communication.jwt.enabled` configuration property. (:issue:`2709`)

#2709

dain · 2020-02-19T16:18:53Z

Hive
----
* Add support for Hive full ACID tables. (:issue:`2068`, :issue:`1591`)

#2068 #1591

#2790 #2989

dain · 2020-02-19T18:08:34Z

UI
--
* Add simple form based authentication. Users can be authenticated with either the LDAP or the file based authentication services. (:issue:`2755`)
* Add support for disabling the web ui.  The UI can be disabled with the ``web-ui.enabled`` configuration property. (:issue:`2755`)

#2755

martint · 2020-02-19T18:55:05Z

* Improve performance of inequality joins involving ``BETWEEN``. (:issue:`2859`)

#2859

dain · 2020-02-20T00:34:55Z

General
-------
* Ensure query completed event is fired when there is an error during analysis or planning. (:issue:`2842`)

#2842

dain · 2020-02-20T01:25:05Z

SPI
---
* Remove deprecated ``Identity`` constructors. (:issue:`2877`)
* Introduce a builder for ``ConnectorIdentity`` and deprecate its public constructors. (:issue:`2877`)

#2877

dain · 2020-02-20T01:28:01Z

Security
--------
* Rename JWT configuration properties from ``http.authentication.jwt.*`` to ``http-server.authentication.jwt``. (:issue:`2712`)

#2712

sopel39 · 2020-02-20T11:32:01Z

General
-------

* Prevent queries to fail when worker is being shut down gracefully. (:issue:`2648`)

#2648

sopel39 · 2020-02-20T12:14:06Z

General
-------

* Improve engine performance in joins. (:issue:`2862`)

#2862

sopel39 · 2020-02-20T12:15:34Z

General
-------

* Fix query memory accounting for ``ORDER BY`` queries. (:issue:`2612`)

#2612

findepi · 2020-02-20T21:50:09Z

UI
* Fix copying worker address to clipboard. (:issue:`2865`)

#2869 #2865

sopel39 · 2020-02-21T10:18:14Z

UI
--

* Fix copying of query ID to clipboard. (:issue:`2872`)

#2872

sopel39 · 2020-02-21T10:49:02Z

General
-------

* Improve query performance by removing redundant data reshuffling. (:issue:`2853`)

#2853

findepi · 2020-02-21T12:24:21Z

General
* Fix :func:`last_day_of_month` for ``timestamp with time zone`` values. (:issue:`2851`)

#2851 #2852

dain · 2020-02-21T19:52:35Z

Security
--------
* Add access control checks for query execution, view query, and kill query. This can be configured using :ref:`query_rules` in the file based system access control. (:issue:`2213`)

#2213

findepi · 2020-02-22T13:06:24Z

Hive
* Fix query failure when using Glue metastore and table's storage descriptor has no properties. (:issue:`2905`)
* Respect ``bucketing_version`` table property when using Glue metastore. (:issue:`2905`)

#2905

sopel39 · 2020-02-22T20:30:44Z

Hive
----

* Add support for bucket sort order in Glue when creating or updating table or partition. (:issue:`1870`)

#1870

findepi · 2020-02-24T11:38:21Z

UI
* Fix display of data size values. (:issue:`2810`)

#2810 #2867

findepi · 2020-02-24T12:33:21Z

UI
* Fix redirect from ``/`` to ``/ui/`` when Presto is run behind a proxy. (:issue:`2908`)

#2908 #2916

martint · 2020-02-25T16:48:23Z

SPI
* Add support for row filtering and column masking via the ``getRowFilter()`` and ``getColumnMask()`` APIs in ``SystemAccessControl`` and ``ConnectorAccessControl``. (:issue:`1480`)

#1480

findepi · 2020-02-26T14:48:03Z

UI
* Fix ``Prepared Query`` section for :doc:`/sql/prepare` queries. (issue:`2784`)

#2784 #2871

findepi · 2020-02-27T21:48:50Z

Hive
* Allow data conversion when reading decimal data from Parquet files and precision or scale in the file schema 
  is different from the precision or scale in partition (table) schema. (:issue:`2823`)

#2823

martint · 2020-02-28T06:14:26Z

Hive
* Add option to enforce that a filter on a partition key be present in the query. This can be enabled by setting the 
  ``hive.query-partition-filter-required`` config property or the ``query_partition_filter_required`` session property 
  to ``true``. (:issue:`2334`)

#2334

findepi · 2020-02-28T20:28:48Z

General
* Correctly reject ``date`` literals that cannot be represented in Presto. (:issue:`2888`)

#2888 #2949

martint · 2020-02-29T01:06:49Z

* Fix excessive runtime when parsing deeply nested expressions with unmatched parenthesis. (:issue:`2968`)

#2968

Praveen2112 · 2020-02-29T17:20:52Z

General 
 * Fix join failures for queries involving OR predicate with non comparable functions

#2861

sopel39 · 2020-03-02T11:55:27Z

General
-------

* Enable dynamic filtering by default. (:issue:`2793`)

#2793

sopel39 · 2020-03-03T12:43:17Z

Hive
----

* Fix Hive connector deadlock when Hive caching is enabled with refresh TTL. (:issue:`2984`)

#2984

kokosing · 2020-03-03T21:14:14Z

Security
—-
 - Prevent displaying columns of tables that user has no privilege granted in file based access control. (:issue:`2925`)

#2925

findepi · 2020-03-05T09:05:20Z

CLI
* Fix formatting of ``varbinary`` in nested data types. (:issue:`2858`)

#2858 #2870

sopel39 · 2020-03-05T15:22:08Z

General
-------

* Show reorder join cost in ``EXPLAIN ANALYZE VERBOSE`` (:issue:`2725`)

#2725

kokosing · 2020-03-06T11:41:58Z

SPI
----
- Add access control check for executing procedure. (:issue:`2924`)

#2924

findepi · 2020-03-07T22:15:44Z

Hive
* Allow selecting ``Intelligent-Tiering`` S3 storage class when writing data to S3. This can be enabled using
  ``hive.s3.storage-class=INTELLIGENT_TIERING`` catalog configuration property. (:issue:`3032`)

#3032

kokosing · 2020-03-09T11:00:10Z

Security:
---
 - Add ``ALTER SCHEMA ... SET AUTHORIZATION`` syntax that allows to change the owner of the schema. (:issue:`2673`)

Hive:
 - Add  support for``ALTER SCHEMA ... SET AUTHORIZATION`` statement. (:issue:`2673`)

Iceberg:
 - Add  support for``ALTER SCHEMA ... SET AUTHORIZATION`` statement. (:issue:`2673`)

#2673

findepi · 2020-03-09T13:21:16Z

Hive
* Fix incorrect results of metadata queries and reads from ``information_schema`` tables
  where connecting to Hive 3 metastore. (:issue:`3008`)
* Hide ``sys`` Hive system schema. It is hidden for security reasons. (:issue:`3008`)

#3008

findepi · 2020-03-09T14:30:39Z

General
* Allow configuring resource groups selection based on user's groups. (:issue:`3023`)

#3023

sopel39 · 2020-03-11T09:59:35Z

Hive
----

* Improve performance of partition fetching from Glue. (:issue:`3024`)

#3024

electrum · 2020-03-11T16:23:23Z

General Changes
----

* Add support for large prepared statements. (:issue:`2719`)

#2719

electrum · 2020-03-11T16:25:06Z

JDBC Driver Changes
---

* Implement ``PreparedStatement.getMetaData()``. (:issue:`2770`)

#2770

electrum · 2020-03-11T16:26:06Z

General Changes
---

* Add :doc:`/connector/bigquery`. (:issue:`2532`)

#2532

electrum · 2020-03-11T16:29:52Z

Other Connector Changes
-----------------------

These changes apply to the MemSQL, MySQL, PostgreSQL, Redshift, Phoenix, and SQL Server connectors.

* Add support for dropping schemas. (:issue:`2956`)

#2956

findepi · 2020-03-12T08:26:40Z

CLI
* Add ``--timezone`` parameter. (:issue:`2961`)

#2977 #2961

findepi · 2020-03-16T11:08:44Z

MongoDB
* Fix incorrect pushdown. Previously, the connector would return incorrect results for pushdown on certain types. (:issue:`1781`)

#1781
#3053

electrum added the release-notes label Feb 19, 2020

electrum added this to the 331 milestone Feb 19, 2020

martint mentioned this issue Feb 26, 2020

Add 331 release notes #2955

Merged

electrum pinned this issue Feb 28, 2020

martint closed this as completed in #2955 Mar 16, 2020

martint unpinned this issue Mar 16, 2020

Release notes for 331 #2880

Release notes for 331 #2880

Comments

electrum commented Feb 19, 2020 • edited Loading

Dain Sundstrom

David Phillips

Grzegorz Kokosiński

Karol Sobczak

Martin Traverso

Piotr Findeisen

sopel39 commented Feb 19, 2020

dain commented Feb 19, 2020

dain commented Feb 19, 2020 • edited by findepi Loading

dain commented Feb 19, 2020

martint commented Feb 19, 2020

dain commented Feb 20, 2020

dain commented Feb 20, 2020

dain commented Feb 20, 2020

sopel39 commented Feb 20, 2020

sopel39 commented Feb 20, 2020

sopel39 commented Feb 20, 2020

findepi commented Feb 20, 2020

sopel39 commented Feb 21, 2020 • edited Loading

sopel39 commented Feb 21, 2020

findepi commented Feb 21, 2020

dain commented Feb 21, 2020

findepi commented Feb 22, 2020

sopel39 commented Feb 22, 2020 • edited Loading

findepi commented Feb 24, 2020

findepi commented Feb 24, 2020

martint commented Feb 25, 2020 • edited Loading

findepi commented Feb 26, 2020

findepi commented Feb 27, 2020

martint commented Feb 28, 2020 • edited Loading

findepi commented Feb 28, 2020

martint commented Feb 29, 2020 • edited Loading

Praveen2112 commented Feb 29, 2020

sopel39 commented Mar 2, 2020

sopel39 commented Mar 3, 2020

kokosing commented Mar 3, 2020

findepi commented Mar 5, 2020

sopel39 commented Mar 5, 2020

kokosing commented Mar 6, 2020

findepi commented Mar 7, 2020

kokosing commented Mar 9, 2020

findepi commented Mar 9, 2020

findepi commented Mar 9, 2020

sopel39 commented Mar 11, 2020

electrum commented Mar 11, 2020

electrum commented Mar 11, 2020

electrum commented Mar 11, 2020

electrum commented Mar 11, 2020

findepi commented Mar 12, 2020 • edited Loading

findepi commented Mar 16, 2020 • edited Loading

electrum commented Feb 19, 2020 •

edited

Loading

dain commented Feb 19, 2020 •

edited by findepi

Loading

sopel39 commented Feb 21, 2020 •

edited

Loading

sopel39 commented Feb 22, 2020 •

edited

Loading

martint commented Feb 25, 2020 •

edited

Loading

martint commented Feb 28, 2020 •

edited

Loading

martint commented Feb 29, 2020 •

edited

Loading

findepi commented Mar 12, 2020 •

edited

Loading

findepi commented Mar 16, 2020 •

edited

Loading