Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: rs load using folder #5450

Merged
merged 4 commits into from
Jan 28, 2025
Merged

feat: rs load using folder #5450

merged 4 commits into from
Jan 28, 2025

Conversation

achettyiitr
Copy link
Member

@achettyiitr achettyiitr commented Jan 21, 2025

Description

  • Redshift load using the folder path instead of the Manifest file.
  • Added loadByFolderPath configuration, by default it's false.

Linear Ticket

  • Resolves WAR-185, WAR-216

Security

  • The code changed/added as part of this pull request won't create any security issues with how the software is being used.

@achettyiitr achettyiitr force-pushed the feat.rs-load-using-folder branch from bb73472 to 8db83dd Compare January 21, 2025 20:02
Copy link

codecov bot commented Jan 21, 2025

Codecov Report

Attention: Patch coverage is 84.33735% with 13 lines in your changes missing coverage. Please review.

Project coverage is 74.78%. Comparing base (71efda1) to head (c897f4b).
Report is 2 commits behind head on master.

Files with missing lines Patch % Lines
warehouse/integrations/redshift/redshift.go 71.73% 10 Missing and 3 partials ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##           master    #5450      +/-   ##
==========================================
- Coverage   74.84%   74.78%   -0.07%     
==========================================
  Files         440      440              
  Lines       61425    61490      +65     
==========================================
+ Hits        45974    45985      +11     
- Misses      12916    12966      +50     
- Partials     2535     2539       +4     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

},
{
name: "with IAM Role",
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There is no point in running separate test for password vs Iam role. We already have covered these test above.

@achettyiitr achettyiitr force-pushed the feat.rs-load-using-folder branch from 35ab77d to 6123e58 Compare January 27, 2025 06:49

s3Location, region = warehouseutils.GetS3Location(objectLocation)
if region == "" {
region = "us-east-1"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we declare us-east-1 as a constant and use it here ? Or maybe encapsulate this logic inside warehouseutils.GetS3Location ?

warehouse/integrations/redshift/redshift.go Outdated Show resolved Hide resolved
@achettyiitr achettyiitr merged commit 66139a2 into master Jan 28, 2025
56 checks passed
@achettyiitr achettyiitr deleted the feat.rs-load-using-folder branch January 28, 2025 04:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants