You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
An incremental model only filters it's upstream ref/source inputs if the upstream has an event_time config defined. We should emit a warning if none of a microbatch model's ref/source inputs have an event_time defined.
Why
We've found the following to not be an uncommon issue:
Someone creates a microbatch model, model_a
model_a has one or more input model/sources
an event_time config is not added to any of model_a's inputs
model_a gets run, but every batch has the same number of rows (which matches the combined size of the inputs)
This is a problem because it isn't immediately apparent to the person that created model_a what happened / went wrong.
The text was updated successfully, but these errors were encountered:
QMalcolm
changed the title
emit a warning if none of a microbatch model's ref/source inputs have an event_time defined
[Feature] Emit a warning if none of a microbatch model's ref/source inputs have an event_time defined
Oct 28, 2024
Describe the feature
An incremental model only filters it's upstream ref/source inputs if the upstream has an
event_time
config defined. We should emit a warning if none of a microbatch model's ref/source inputs have anevent_time
defined.Why
We've found the following to not be an uncommon issue:
model_a
model_a
has one or more input model/sourcesevent_time
config is not added to any ofmodel_a
's inputsmodel_a
gets run, but every batch has the same number of rows (which matches the combined size of the inputs)This is a problem because it isn't immediately apparent to the person that created
model_a
what happened / went wrong.The text was updated successfully, but these errors were encountered: