v1.5.0 dbt_fivetran_log
fivetran-data-model-bot
released this
20 Feb 21:04
·
11 commits
to main
since this release
PR #114 includes the following updates:
Breaking Changes
⚠️ Since the following changes are breaking, we recommend running a--full-refresh
after upgrading to this version.
- For Bigquery and Databricks destinations, updated the
partition_by
config to coordinate with the filter used in the incremental logic. - For Snowflake destinations, added a
cluster_by
config for performance.
Feature Updates
- Updated incremental logic for
fivetran_platform__audit_table
so that it looks back 7 days to catch any late arriving records. - Updated JSON parsing logic in the following models to prevent run failures when incoming JSON-like strings are invalid.
fivetran_platform__audit_table
fivetran_platform__audit_user_activity
fivetran_platform__connector_daily_events
fivetran_platform__connector_status
fivetran_platform__schema_changelog
- Updated
fivetran_platform__connector_status
to parse only a subset of themessage_data
field to improve compute.
Under The Hood
- Added macros:
fivetran_log_json_parse
to handle the updated JSON parsing.fivetran_log_lookback
for use infivetran_platform__audit_table
.
- Updated seeds to test handling of invalid JSON strings.
Full Changelog: v1.4.3...v1.5.0