Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Release notes for 0.206 #10928

Closed
nezihyigitbasi opened this issue Jun 27, 2018 · 15 comments
Closed

Release notes for 0.206 #10928

nezihyigitbasi opened this issue Jun 27, 2018 · 15 comments

Comments

@nezihyigitbasi
Copy link
Contributor

Issue to track release notes for next release.
@findepi
Copy link
Contributor

findepi commented Jun 27, 2018 

General
-------
* Fix query processing error for certain queries when ``dictionary_aggregation`` is enabled.

#10857

@findepi
Copy link
Contributor

findepi commented Jun 27, 2018 

General
-------
* Implement new TIMESTAMP and TIME behavior that conforms to SQL standard in the engine. Note
  that the legacy behavior remains default, as connectors have not been updated yet.

#10193

@mbasmanova
Copy link
Contributor

mbasmanova commented Jun 28, 2018 •
edited
Loading 

General
--------
* Add :func:`ST_Union`, :func:`ST_Geometries`, :func:`ST_PointN`, :func:`ST_InteriorRings`, :func:`ST_InteriorRingN` geospatial functions
* Fix query plan for aggregations over a single group, e.g. `select c1, sum(c2) from t where c1 = 'foo' group by c1`

@kokosing
Copy link
Contributor

kokosing commented Jul 4, 2018 

Hive
-----
 * Support read from tables with `skip.footer.line.count` and `skip.header.line.count` in kerberized environments

@nezihyigitbasi
Copy link
Contributor Author 

Hive
-----
* Add support for case-insensitive column lookup for Parquet readers.

@bowdencm
Copy link
Contributor

bowdencm commented Jul 10, 2018 •
edited
Loading 

General
----
* Implement SET PATH statement and CURRENT_PATH expression - note that
  path-based function resolution is not yet implemented - only the parser rules.

@haozhun
Copy link
Contributor

haozhun commented Jul 11, 2018 •
edited
Loading

Andrii Rosa

  • all checked
  • 06-29 14:16:42 c63b7ea Disallow indeterminate key in MAP type
  • 06-29 14:16:42 d036334 Add INDETERMINATE scalar operator to detect nulls
  • 07-03 08:39:32 937c425 Invalidate statistics caches after Table/Partition modifications
  • 07-03 08:42:28 76ca281 Invalidate all metastore caches upon flushCache
  • 07-09 10:09:54 906f97a Fix compilation failure
  • 07-09 19:15:19 02a44d5 Move createPartitionValues method to a utility class
  • 07-09 19:15:19 0befbff Change getStatistics signature for HiveMetastore interface
  • 07-09 19:15:19 398184c Refactor HiveColumnStatistics to be statically typed
  • 07-09 19:15:19 68adfec Return HiveColumnStatistics from the HiveMetastore interface
  • 07-09 19:15:19 7e46bbc Move HiveBasicStatistics serialization methods
  • 07-09 19:15:19 8a6f1bb Make FileHiveMetastore#get*Statistics methods synchronized
  • 07-09 19:15:19 ba34d33 Introduce updateStatistics methods in the HiveMetastore
  • 07-09 19:15:20 42c727f Use updateStatistics methods to store basic statistics

Cole Bowden

  • all checked
  • 06-27 11:53:31 3c543f9 Add SqlPath to Session
  • 06-27 11:53:31 60fb20d Add parsing for SET PATH and CURRENT_PATH
  • 07-02 14:27:06 aa8f7d6 Implement CURRENT_PATH expression
  • 07-10 12:13:13 2d2aca7 Add client capabilities header
  • 07-10 12:13:13 b9824f0 Reformat SetPathTask constructor
  • 07-10 12:13:13 e811d00 Implement SET PATH statement
  • 07-10 12:13:13 eeaafc8 Reorder process method in Console
  • 07-10 12:13:13 fb60a48 Add check to ensure client supports SET PATH task

Dain Sundstrom

  • all checked
  • 07-10 15:54:51 36a60a6 Destroy exchange sources for finished tasks on the coordinator
  • 07-10 15:54:51 6f72f25 Fix typo in variable name

David Phillips

  • all checked
  • 07-02 09:12:59 bbd2598 Add applicationNamePrefix property to JDBC driver
  • 07-02 09:21:41 f51c55c Code cleanup for ColumnInfo#getType
  • 07-06 09:36:08 d9e7cd8 Remove support for Hadoop 1.x
  • 07-09 12:45:18 389c93f Fix error categorization for Hive split loader

Elon Azoulay

  • all checked
  • 06-29 15:45:38 c268d46 Add resource group to queries system table
  • 06-29 15:45:38 fd80383 Replace resourceGroupName with resourceGroupId in QueryInfo

Gerlou Shyy

  • all checked
  • 06-28 16:20:39 17e8f3d Implement null convention by passing block and position

Grzegorz Kokosiński

  • all checked
  • 06-27 22:47:25 2830c46 Expose debug port for Presto server in product tests
  • 06-27 22:53:10 3543397 Start Presto and Hadoop at the same time in product tests
  • 06-29 01:47:55 415487a Update to docker images version 6
  • 07-02 01:03:28 e6ca22b rename misleading variable name hasOrderBy to noOrderBy
  • 07-03 04:10:59 1b95fc5 Test read snappy compressed parquet table loaded in hive
  • 07-03 04:10:59 3267883 Remove obvious comments
  • 07-03 04:10:59 69af055 Remove dependency version usage from presto-hive
  • 07-03 05:04:38 b10fc91 Minor fixes in TestHiveCoercion
  • 07-03 05:04:38 e131241 Update simba drivers tests results
  • 07-04 02:01:43 67ce2ed Fix reading table with headers in kerberized environments
  • 07-09 04:17:55 49be67a Use PlanNodeSercher for plan node searching
  • 07-09 04:18:21 9e828bc Prefer String.toLowerCase(ENGLISH) over String.toLowerCase()
  • 07-10 03:54:43 6a52346 Remove PlanBuilder method which was not following convention

Haozhun Jin

  • all checked
  • 06-27 17:38:16 0cb371e Make TestLegacyLogFunction single threaded
  • 06-29 17:52:59 66d6417 Add comment about Future to FixedSourcePartitionedScheduler
  • 06-29 17:52:59 d792f8a Fix listener object retention issue in SourcePartitionedScheduler

Karol Sobczak

  • all checked
  • 07-03 01:26:36 bb04ca8 Add BasePlanTest#assertDistributedPlan method
  • 07-03 01:58:23 0e41d92 Do not use static METADATA, LITERAL_ENCODER and DOMAIN_TRANSLATOR
  • 07-03 01:58:23 15ec6a0 Pass argument FeaturesConfig to TypeManager
  • 07-03 01:58:23 3d9d004 Flip char to varchar coercion into varchar to char coercion
  • 07-03 01:58:23 5469bd7 Fix formatting
  • 07-04 01:21:27 05ea5a8 Add concat(CHAR(x), CHAR(y)): CHAR(x + y)
  • 07-04 01:21:27 1301133 Remove padding in char predicates in TPCDS queries
  • 07-04 01:21:27 f5f81da Add LIKE function that accepts CHAR(x) value
  • 07-04 03:02:14 6a73908 Take into account nulls fraction when computing data size
  • 07-04 03:02:14 ee6a090 Remove redundant isNaN check
  • 07-04 03:41:57 01517c8 Further remove trailing spaces from char predicates in TPC-DS
  • 07-05 02:18:00 a773d63 Compute average row size by using non-null rows only
  • 07-05 02:18:00 cc40ca1 Use 0 when null fraction estimate is not available
  • 07-09 03:26:06 171e4cb Fix formatting
  • 07-09 03:26:06 205e1c4 Add distributed sort benchto benchmarks
  • 07-09 03:26:06 25cf481 Add OperatorContext#aggregateUserMemoryContext
  • 07-09 03:26:06 26bb48f Add support for OrderingScheme in PushProjectionThroughExchange
  • 07-09 03:26:06 2bad830 Add support for testing OrderingScheme in SortNode
  • 07-09 03:26:06 4303d9c Rename generateCompareTo to generatePageIndexCompareTo
  • 07-09 03:26:06 6609662 Planner part of Merge
  • 07-09 03:26:06 6a407a2 Make LocalExchange aware of writer finish
  • 07-09 03:26:06 715c2db Add OperatorContext#localSystemMemoryContext
  • 07-09 03:26:06 8a639b9 Introduce local merge sort
  • 07-09 03:26:06 920bfe3 Add non-distributed sort query test
  • 07-09 03:26:06 97daf2c Add PagesSortBenchmark
  • 07-09 03:26:06 990a507 Add passthrough local exchanger
  • 07-09 03:26:06 afb6e40 Add distributed sort documentation
  • 07-09 03:26:06 bd0d136 Add ordering to RemoteSourceNode and ExchangeNode
  • 07-09 03:26:06 d888384 Add support for testing OrderingScheme in ExchangeNode
  • 07-09 03:26:06 e76c318 Add TODO for determining if stream after Exchange is parallelised
  • 07-09 03:26:06 eaa588a Add assertDistributedPlan that accepts session
  • 07-09 03:26:06 ec8ab6c Add planner tests for distributed sort
  • 07-09 03:26:06 f007570 Implement MergeOperator
  • 07-09 03:26:06 f8b0e4b Compile merge sort comparator
  • 07-09 03:26:06 f8fa47d Extract HttpClientHandler from TestExchangeOperator
  • 07-09 03:26:06 fb7a2e5 Introduce MoreLists.mappedCopy method
  • 07-09 05:30:40 4278c9b Heuristically account for auxiliary structures in getOutputSizeInBytes
  • 07-09 05:30:40 e6b2251 Estimate average row size based on symbol type
  • 07-09 05:30:40 f568948 Increase DEFAULT_DATA_SIZE_PER_COLUMN value

Maria Basmanova

  • all checked
  • 06-28 08:25:43 c044d9c Add ST_PointN function
  • 06-28 10:22:48 0db1dc3 Add ST_Geometries function
  • 06-28 16:03:17 f5f2a3b Add ST_Union geospatial function
  • 06-28 18:44:25 ab0c640 Add ST_InteriorRings and ST_InteriorRingN functions
  • 07-09 17:58:54 2855114 Drop streaming when splitting streaming aggregation over exchange

Martin Traverso

  • all checked
  • 07-06 12:15:21 77ba0c4 Preserve original window frame expressions in plan instead of AST
  • 07-07 15:05:19 31d9128 Use Optional to represent missing LIKE escape character
  • 07-09 08:31:25 9eb51ac Extract ConstantExpressionVerifier
  • 07-09 08:31:56 36a38e3 Remove unnecessary use of addIntermediateMappings
  • 07-09 08:31:56 d013371 Remove unnecessary method in TranslationMap
  • 07-09 08:34:41 90abb14 Simplify GroupId node
  • 07-09 08:35:18 3b403fd Generalize grouping set rewriter
  • 07-09 09:49:35 50e4bd4 Rename CurrentTime.Type to Function
  • 07-09 09:49:35 7410021 Rename ComparisonExpression.getType() to getOperator()
  • 07-09 09:49:35 88b93f3 Rename ArithmeticBinaryExpression.Type to Operator
  • 07-09 09:49:35 d83f9be Rename LogicalBinaryExpression.Type to Operator
  • 07-09 18:17:29 20b879f Encapsulate type map in TypeProvider

Nezih Yigitbasi

  • all checked
  • 07-05 09:32:22 06a9d73 Remove redundant type arguments
  • 07-05 09:32:22 5396b0b Update deprecated use of Futures.transformAsync
  • 07-05 09:32:22 7817c43 Remove unused method
  • 07-05 09:32:22 8bf5ae3 Update deprecated use of Futures.transform
  • 07-05 09:32:22 8e42a6e Fix null check
  • 07-05 09:32:22 e19fe18 Remove useless null checks
  • 07-05 23:35:08 92fe232 Make sure to close AWS credentials provider
  • 07-09 16:03:05 8e47c5b Add parquet_use_column_names session property
  • 07-09 16:03:05 c91807d Support case-insensitive column lookup in Parquet readers

Piotr Findeisen

  • all checked
  • 06-27 12:22:59 02cf3e3 Add warning concerning legacy_timestamp session property
  • 06-27 12:22:59 0465d9b Add new TIME/TIMESTAMP semantic variant to Expression parsing
  • 06-27 12:22:59 0e06356 Introduce new TIME/TIMESTAMP semantics SPI types
  • 06-27 12:22:59 2826680 Fix current_time, localtime & localtimestamp semantics
  • 06-27 12:22:59 2a55098 Use non-JVM timezone in TestDateTimeFunctionsBase
  • 06-27 12:22:59 319d495 Add new date time semantics to date time cast operators
  • 06-27 12:22:59 3af8743 Add documentation for DateTimeUtils#parse* methods
  • 06-27 12:22:59 42fd12f Fix current_time, localtime timezone offset
  • 06-27 12:22:59 52c35b8 Rename DateTimeUtils#parseTime to parseTimeLiteral
  • 06-27 12:22:59 61970c1 Use legacy-flag aware wrappers for SqlTime/SqlTimestamp cration in tests
  • 06-27 12:22:59 661e348 Introduce new TIME/TIMESTAMP semantics to scalar functions
  • 06-27 12:22:59 764412a Remove transitional TestingSqlTime#sqlTimestampOf method
  • 06-27 12:22:59 824baf0 Always use fixed TIME as session base in TestDateTimeFunctions
  • 06-27 12:22:59 828f3c6 Rename SqlTime#millisUtc to millis
  • 06-27 12:22:59 a89838d Use Asia/Kathmandu as Cassandra timezone in product-tests
  • 06-27 12:22:59 ae5f8ad Parse TIMESTAMP literal with parseTimestampLiteral
  • 06-27 12:22:59 bd41fe1 Accept values with zone in varchar to timestamp cast
  • 06-27 12:22:59 c10da8d Enable tests for non-legacy timestamp semantics
  • 06-27 12:22:59 c2b018d Fix timestamp related Teradata Function product-tests
  • 06-27 12:22:59 cda9951 Introduce new TIME/TIMESTAMP semantics to SQL types
  • 06-27 12:22:59 d7792fc Use named constant for time zone mask in DateTimeEncoding
  • 06-27 12:22:59 f0b59e4 Rename SqlTimestamp#millisUtc to millis
  • 06-27 12:22:59 f8ca96d Add tests covering Time types representation
  • 06-27 12:22:59 fb8d4c4 Add new TIME/TIMESTAMP parsing/printing to DateTimeUtils
  • 06-27 12:22:59 fdd4598 Introduce new TIMESTAMP semantics to to_iso8601 scalar
  • 06-27 12:22:59 fe35527 Fix at_timezone(TIME WITH TIME ZONE)
  • 06-27 12:23:42 e2328cd Fix typo
  • 06-27 12:24:01 4cf2a4e Handle DictionaryBlocks from different sources in dictionary aggregation
  • 06-27 12:24:01 6f18e2b Add basic test for dictionary aggregation
  • 06-27 12:24:18 761e913 Document SingleMapBlock.seekKey returns -1 when not found
  • 06-27 12:24:18 d860ac0 Avoid constructing default values in Map IS DISTINCT FROM
  • 06-27 12:24:48 a920752 Log Presto version during server start
  • 06-27 12:29:21 9292622 Allow re-running TestSqlStandardAccessControlChecks
  • 06-29 03:11:48 9778718 Remove redundant check on orders table
  • 06-29 03:11:48 a9e63f8 Remove redundant TypeRegistry constructor
  • 07-09 13:17:21 13cb346 Fix TestTeradataDateFunctions to work in zones with negative offset
  • 07-09 13:17:21 a74f754 Simplify to_date function not to depend on cast to TIMESTAMP
  • 07-09 14:04:34 11c6ce2 Avoid using special time zone when not needed
  • 07-09 14:04:34 3bd04ec Fix typo
  • 07-09 14:04:34 609b2f6 Remove repeated call to .close()
  • 07-09 14:04:34 c3d154c Remove unused method
  • 07-09 14:04:34 fe78496 Introduce new TIME/TIMESTAMP semantics to date_add, date_diff

Wenlei Xie

  • all checked
  • 07-10 21:34:26 00119d5 Add getLoadedBlock/Page in Block/Page to supersede assureLoaded
  • 07-10 21:34:26 678ab19 Revert "Support LazyBlock in ColumnarArray/Map/Row"
  • 07-10 21:34:26 91db2c7 Replace usage of LazyBlock.getBlock with getLoadedBlock

Yi He

  • all checked
  • 06-27 21:27:52 e362895 Fix NPE for missing SqlPath

rongrong

  • all checked
  • 06-28 10:42:31 2f00cd3 Add UDF split_to_multimap

yingsu00

  • all checked
  • 07-02 15:25:15 b132580 Limit the size of local buffers for stream readers

@sopel39
Copy link
Contributor

sopel39 commented Jul 11, 2018 

* Add distributed execution of ORDER BY without LIMIT
* Improve data size estimation heuristics to account for auxiliary objects overhead
* Fix average row size computation to account for non-null rows only
* VARCHAR(n) is now coerced to CHAR(n) which provides trailing space insensitive
  CHAR comparison semantics

@rongrong
Copy link
Contributor

* Add string function split_to_multimap

@yingsu00
Copy link
Contributor

* Limit the size of local buffers for stream readers

@jessesleeping
Copy link
Contributor 

General 
------- 
* Add APPROX_DISTINCT supports for INTEGER, SMALLINT, TINYINT, DECIMAL, REAL, DATE, 
TIMESTAMP, TIMESTAMP WITH TIME ZONE, TIME, TIME WITH TIME ZONE, IPADDRESS

@findepi
Copy link
Contributor

findepi commented Jul 12, 2018

regarding TIMESTAMP - quoting my earlier bullet (#10928 (comment)):

General
-------
* Implement new TIMESTAMP and TIME behavior that conforms to SQL standard in the engine. Note
  that the legacy behavior remains default, as connectors have not been updated yet.

I think we may want to mention "the new semantics are experimental" or something like that. @haozhun ?

@elonazoulay
Copy link
Contributor

elonazoulay commented Jul 13, 2018 •
edited by haozhun
Loading 

General
--------
* Expose the resource group id for a query in the system.runtime.queries table.
  The type is varchar<array> to accurately represent the resource group id.

@haozhun
Copy link
Contributor

haozhun commented Jul 14, 2018 

General
-------

* Fix high memory pressure on the coordinator when scheduling queries using bucketed execution.

Hive Changes
------------
* Remove support for Hadoop 1.x

JDBC Changes
------------
* Add ``applicationNamePrefix`` parameter, which is combined with
  the ``ApplicationName`` property to construct the client source name.

@kokosing kokosing mentioned this issue Jul 17, 2018
Closed
@haozhun
Copy link
Contributor

haozhun commented Jul 18, 2018

Release notes for 0.207 at #11068

@haozhun haozhun closed this as completed Jul 18, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests