Implement Open lineage extractor for RedshiftAsync Operators #561
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
rajaths010494
changed the title
Codecov Report
@@ Coverage Diff @@
## main #561 +/- ##
=======================================
Coverage 98.24% 98.24%
=======================================
Files 72 73 +1
Lines 3978 3994 +16
=======================================
+ Hits 3908 3924 +16
Misses 70 70
Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here. |
2 tasks
|
@pankajkoti @phanikumv @pankajastro I request you guys to review this PR even if it is in draft state, it helps to address the review comments faster |
rajaths010494
changed the title
rajaths010494
force-pushed
the
ol-extractor-redshift
branch
from
ef89243 to
fe7fd0e
Compare
pankajkoti
reviewed
Aug 9, 2022
rajaths010494
force-pushed
the
ol-extractor-redshift
branch
from
fe7fd0e to
8f23cd0
Compare
rajaths010494
force-pushed
the
ol-extractor-redshift
branch
from
8f23cd0 to
cd72d8d
Compare
|
@rajaths010494 Is anything pending in this PR? |
It is ready for review |
rajaths010494
force-pushed
the
ol-extractor-redshift
branch
2 times, most recently
from
6ee2c9a to
3ce672b
Compare
rajaths010494
force-pushed
the
ol-extractor-redshift
branch
from
3ce672b to
d186506
Compare
rajaths010494
force-pushed
the
ol-extractor-redshift
branch
from
d186506 to
c2a8c46
Compare
kaxil
force-pushed
the
ol-extractor-redshift
branch
from
c2a8c46 to
f1c6f2d
Compare
pankajkoti
approved these changes
Sep 2, 2022
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Export query_ids as XCOM for the Redshift async operators
and add an OpenLineage custom extractor for the same.
Some additional OpenLineage specific environment variables
need to be set which are included as part of the
docker-compose.yaml file change in the commit.
Also adds unit tests for the custom extractor.
Closes #462