From 79ff567126ad395f8297ad3b79634c2060b5f9f8 Mon Sep 17 00:00:00 2001 From: Walaa Eldin Moustafa Date: Mon, 12 Feb 2024 12:17:33 -0800 Subject: [PATCH] [Coral-dbt] Update README.md (#488) --- coral-dbt/README.md | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/coral-dbt/README.md b/coral-dbt/README.md index 4b6e88e0d..9b8e96b18 100644 --- a/coral-dbt/README.md +++ b/coral-dbt/README.md @@ -1,6 +1,7 @@ # Using coral-dbt Materialization Modes +This module implements a new materialization mode for dbt called "incremetnal_maintenance". This materialization mode is a drop-in replacement for the "table" materialization mode, but instead of repeatedly replacing tables and computing their data from scratch, it maintains the tables incrementally. This mode leverages Coral to rewrite the input SQL to an incremental version that leverages incremental changes to the input tables, computes the updates to the output tables, and merges them. More details can be found in these [slides](https://www.slideshare.net/walaa_eldin_moustafa/incremental-view-maintenance-with-coral-dbt-and-iceberg). -Note: This project is currently in development and is not intended to be a production ready package. Currently, only Spark adapter is supported. +Note: This project is currently WIP. ## Setup 1. The materialization mode in this package requires a minor modification to the dbt-core source. Clone and setup a local dbt-core source and create/activate a Python virtual environment.