Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fixed S3 Multi-Part Upload #86

Merged
merged 2 commits into from
Apr 15, 2020
Merged

Fixed S3 Multi-Part Upload #86

merged 2 commits into from
Apr 15, 2020

Conversation

mattBrzezinski
Copy link
Member

Depends On: JuliaCloud/AWSCore.jl#117
Resolves: #84

Overview

Previously AWSCore.jl was not returning headers for a request and the s3_upload_part() would break. Changes have been made in that package to return response headers when the kwarg return_headers=true is passed in.

This merge request is just updating the s3_upload_part() to properly pull the returned ETag from Amazon, as well as include a test for multi-part uploading.

@Keno
Copy link

Keno commented Apr 15, 2020

I've been playing with this and it works fine for simple uploads. However, larger uploads quickly run into connection errors from HTTP.jl. A bunch of them are similar to JuliaWeb/HTTP.jl#517, so I've spent some time debugging that, but unfortunately, that doesn't appear sufficient. Shouldn't block this merge of course.

@Keno
Copy link

Keno commented Apr 15, 2020

Ok, the other errors I ended up with were just expirations of the access tokens, though HTTP.jl really didnt't like that.

src/AWSS3.jl Outdated Show resolved Hide resolved
@mattBrzezinski mattBrzezinski merged commit 6ad86c9 into master Apr 15, 2020
@ararslan ararslan deleted the MB/multi-part branch April 17, 2020 20:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants