[Bug] JSON parsing error in Redshift #113
Labels
error:forced
priority:p2
Affects most users; fix needed
status:in_progress
Currently being worked on
type:bug
Something is broken or incorrect
update_type:models
Primary focus requires model updates
Is there an existing issue for this?
Describe the issue
Error downstream in
fivetran_platform_connector_status
andfivetran_platform_audit_table
due to themessage_data
the log table getting truncated due to lengthy json value. The incomplete json is causing the model runs to fail.In order to support these json objects in Redshift the SUPER type is necessary but it is complicated.
As a workaround, we should update in the package to filter
message_data
first for only necessary keys prior to any parsing (event_subtype='status')Relevant error log or model output
No response
Expected behavior
json to be parsed correctly and package to run
dbt Project configurations
na
Package versions
na
What database are you using dbt with?
redshift
dbt Version
na
Additional Context
No response
Are you willing to open a PR to help address this issue?
The text was updated successfully, but these errors were encountered: