From 42427c882f0d381ad438625d517ef1b8bb62abb6 Mon Sep 17 00:00:00 2001 From: Terry Blessing Date: Wed, 29 Jun 2022 13:49:13 -0500 Subject: [PATCH 1/2] correct config description --- docs/src/main/sphinx/connector/delta-lake.rst | 9 +++++---- 1 file changed, 5 insertions(+), 4 deletions(-) diff --git a/docs/src/main/sphinx/connector/delta-lake.rst b/docs/src/main/sphinx/connector/delta-lake.rst index 68121cd4a2b6..abab5e506b37 100644 --- a/docs/src/main/sphinx/connector/delta-lake.rst +++ b/docs/src/main/sphinx/connector/delta-lake.rst @@ -136,10 +136,11 @@ connector. - Description - Default * - ``delta.domain-compaction-threshold`` - - Sets the number of transactions to act as threshold. Once reached the - connector initiates compaction of the underlying files and the delta - files. A higher compaction threshold means reading less data from the - underlying data source, but a higher memory and network consumption. + - Minimum size of query predicates above which Trino starts compaction. + Pushing a large list of predicates down to the data source can + compromise performance. For optimization in that situation, Trino can + compact the large predicates. If necessary, adjust the threshold to + ensure a balance between performance and predicate pushdown. - 100 * - ``delta.max-outstanding-splits`` - The target number of buffered splits for each table scan in a query, From 23d29d405fd06f42edd63a1b4e830777b4ee85a9 Mon Sep 17 00:00:00 2001 From: "Terry L. Blessing" Date: Thu, 30 Jun 2022 14:34:36 -0500 Subject: [PATCH 2/2] Update docs/src/main/sphinx/connector/delta-lake.rst Co-authored-by: Ashhar Hasan --- docs/src/main/sphinx/connector/delta-lake.rst | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/src/main/sphinx/connector/delta-lake.rst b/docs/src/main/sphinx/connector/delta-lake.rst index abab5e506b37..ad8fbdca7014 100644 --- a/docs/src/main/sphinx/connector/delta-lake.rst +++ b/docs/src/main/sphinx/connector/delta-lake.rst @@ -136,7 +136,7 @@ connector. - Description - Default * - ``delta.domain-compaction-threshold`` - - Minimum size of query predicates above which Trino starts compaction. + - Minimum size of query predicates above which Trino compacts the predicates. Pushing a large list of predicates down to the data source can compromise performance. For optimization in that situation, Trino can compact the large predicates. If necessary, adjust the threshold to