Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

service/s3/s3manager: Add unit test for S3 Upload manager part retries #2636

Merged
merged 5 commits into from
Jun 14, 2019

Conversation

jasdel
Copy link
Contributor

@jasdel jasdel commented Jun 4, 2019

Adds a new unit test to S3 Upload Manager to verify the SDK will
correctly retry concurrent multipart uploads.

Related to #2525

@jasdel jasdel force-pushed the issue-2525/UploadPartError branch 2 times, most recently from f25f0e2 to 2ea8450 Compare June 4, 2019 23:56
@jasdel
Copy link
Contributor Author

jasdel commented Jun 5, 2019

Go 1.7 on darwin, is periodically failing with protocol wrong type for socket error, which seems to be related to a implementation detail of Go 1.7 and Unix's sockets.

DEBUG: Send Request s3/UploadPart failed, attempt 7/15, error RequestError: send request failed
    		caused by: Put http://127.0.0.1:51638/bucket/key?partNumber=1&uploadId=abc123: write tcp 127.0.0.1:51654->127.0.0.1:51638: write: protocol wrong type for socket

@jasdel jasdel force-pushed the issue-2525/UploadPartError branch from 2ea8450 to f9ff6e1 Compare June 5, 2019 20:42
@jasdel jasdel force-pushed the issue-2525/UploadPartError branch from f9ff6e1 to 17817aa Compare June 12, 2019 23:23
jasdel added 4 commits June 14, 2019 10:19
Adds a new unit test to S3 Upload Manager to verify the SDK will
correctly retry concurrent multipart uploads.

Update SDK's retry logic to include retrying write: connection reset and
broken pipe, but not read: connection reset.
@jasdel jasdel force-pushed the issue-2525/UploadPartError branch from c2eb323 to 235e028 Compare June 14, 2019 17:41
@jasdel jasdel merged commit 4d49ee0 into aws:master Jun 14, 2019
@jasdel jasdel deleted the issue-2525/UploadPartError branch June 14, 2019 20:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant