Skip to content

Commit

Permalink
updated change log and documentation
Browse files Browse the repository at this point in the history
  • Loading branch information
jonhopper-dataengineers committed Aug 16, 2022
1 parent 6c92af9 commit efea67c
Show file tree
Hide file tree
Showing 2 changed files with 40 additions and 2 deletions.
26 changes: 26 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,26 @@
# dbt_dataengineers_materilizations Changelog

## 0.1.2

Addition of the pre-hooks

* stages

## 0.1.1

* Addition of User Defined Functions materizations

## 0.1.0

Addition of the materializations:

* File Formats
* Stages
* Stored Procedures
* Tasks
* Streams
* Generic

Addition of the pre-hooks

* source tables
16 changes: 14 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -119,16 +119,21 @@ Usage
description: Customer Information
external:
auto_create_table: true
auto_create_stream: false
```
| property | description | required | default |
| ---------------------- | ---------------------------------------------------------------- | -------- | ------- |
| `auto_create_table` | specifies if the table should be maintianed by dbt or not | yes | `false` |
| `auto_create_stream` * | specifies if the table should have a stream created on it or not | no | `false` |
* it's recommended that a separate stream object is created instead of setting up the stream via the table object as the stream doesn't appear on the DAG when created via this method, nor can you reference it using the `ref` macro.
To action the auto-creation of the tables, you need to add the following pre-hook
```yml
on-run-start:
- "{{ dbt_dataengineers_materilizations.stage_table_sources() }}"
```
## File Formats
Usage
Expand Down Expand Up @@ -170,6 +175,13 @@ example
View [Snowflake `create stage` documentation](https://docs.snowflake.com/en/sql-reference/sql/create-stage.html) for more information on the available options.
To action the auto-creation of the stages before the tables get created, you need to add the following pre-hook before the `stage_table_sources` pre-hook.
```yml
on-run-start:
- "{{ dbt_dataengineers_materilizations.stage_stages() }}"
```
[Storage Integrations](https://docs.snowflake.com/en/sql-reference/sql/create-storage-integration.html) need to be maintained separately as you require `Create integration` privilage on the role you are using to set those up and they are global to snowflake instead of per database.
example
Expand Down

0 comments on commit efea67c

Please sign in to comment.