-
Notifications
You must be signed in to change notification settings - Fork 298
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Using aws-sdk-s3 #855
Using aws-sdk-s3 #855
Conversation
3fae903
to
ac069a1
Compare
someone should probably flame test this, since I think this is more or less equivalent to an upgrade to aws-sdk-v3(?), and IDK what the rspec testing looks like. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This is the v3 sdk upgrade we’ve been meaning to do. Thanks for making this happen. This should greatly simplify our deps
@lamont-granquist What does |
someone internal to manually test + double check |
I figured y'all are busy so I ran some tests on this myself. It seems to have identical functionality to what it had prior to this change:
(These happen to be the 3 objects in the given S3 bucket I used as an example) |
@lamont-granquist Pinging on this – I manually tested this myself because I assume nobody's going to prioritize this internally (y'all have real work to do but this week this is my real work :D ) |
looks busted on chef/chef https://github.com/chef/chef/blob/master/omnibus/Gemfile#L3 changing that line to: gem "omnibus", git: "https://github.com/JackDanger/omnibus", branch: "jackdanger/using-aws-sdk-s3" and then doing a "bundle update && bundle exec omnibus build chef" results in:
|
5b2d338
to
519b214
Compare
@lamont-granquist Thanks for sharing a way I can better test this. It looks like the aws-sdk-v3 throws an error when the AWS credentials are blank and no fallback has been specified. I've added 519b214 which fixes this. |
The full aws-sdk gem includes a massive number of dependency gems now that AWS has broken the aws-sdk into many pieces. Trimming this dependency allows applications that depend on omnibus to avoid downloading dozens or hundreds of small packages when they run 'bundle install' Signed-off-by: Jack Danger <[email protected]>
Signed-off-by: Jack Danger <[email protected]>
519b214
to
185f21d
Compare
@lamont-granquist I just rebased this and would love a re-review after fixing the nil credentials problem you found. |
yeah that fixed the S3Fetcher. |
The full aws-sdk gem includes a massive number of dependency gems now that AWS has broken the aws-sdk into many pieces. Trimming this dependency allows applications that depend on omnibus to avoid downloading dozens or hundreds of small packages when they run 'bundle install'