-
Notifications
You must be signed in to change notification settings - Fork 26
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Custom backend XCom S3 #820
Conversation
Codecov ReportBase: 98.51% // Head: 98.53% // Increases project coverage by
Additional details and impacted files@@ Coverage Diff @@
## main #820 +/- ##
==========================================
+ Coverage 98.51% 98.53% +0.01%
==========================================
Files 87 88 +1
Lines 4780 4845 +65
==========================================
+ Hits 4709 4774 +65
Misses 71 71
Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here. ☔ View full report at Codecov. |
1f7f95e
to
71e9249
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
can you share a screenshot of data getting uploaded to s3 using this backend?
1f23908
to
58a5163
Compare
Added the screenshot |
Custom XCOM to upload xcom values to the S3 bucket for the given name.
Adding ENV
AIRFLOW__CORE__XCOM_BACKEND: astronomer.providers.amazon.aws.xcom_backends.s3.S3XComBackend
in the docker-compose.yaml or where the airflow is running will enable the custom XCOM for S3.closes #795