-
Notifications
You must be signed in to change notification settings - Fork 1.7k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[#3867] Turn on partial parsing by default #3989
Conversation
ac2bea4
to
d167916
Compare
d167916
to
074eafa
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks like the timestamp format switch threw off a couple integration tests. Assuming those are simple fixes, this LGTM
@@ -41,7 +41,7 @@ | |||
"STATIC_PARSER": True, | |||
"WARN_ERROR": False, | |||
"WRITE_JSON": True, | |||
"PARTIAL_PARSE": False, | |||
"PARTIAL_PARSE": True, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
💯
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yeah. Some parts of the code want the Z ending, and some parts don't, apparently. I moved the kludging of 'generated_at' into a post serialization method in BaseArtifactMetadata.
# We don't want to have stale generated_at dates | ||
manifest.metadata.generated_at = datetime.utcnow() | ||
# or invocation_ids | ||
if dbt.tracking.active_user: | ||
manifest.metadata.invocation_id = dbt.tracking.active_user.invocation_id | ||
else: | ||
manifest.metadata.invocation_id = None |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
👍
24eac63
to
f393481
Compare
The remaining test failure is because we're not handling 'vars' in partial parsing. To fix it the right way we'd have to implement one of the 'vars' solutions we've discussed. (For the case of this test, it's vars passed in as cli args in the rpc server.) Or we could turn off partial parsing for the test. |
f393481
to
e0d2b02
Compare
Have modified the tests to use the --no-partial-parse flag. The issues with vars and env_vars are well known and on the roadmap. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
🎉
resolves #3867
Description
Turn on partial parsing by default.
Checklist
CHANGELOG.md
and added information about my change to the "dbt next" section.