Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add HTTP timeout config for PutRecords call #178

Closed
jpaskhay opened this issue Oct 27, 2021 · 2 comments · Fixed by #179
Closed

Add HTTP timeout config for PutRecords call #178

jpaskhay opened this issue Oct 27, 2021 · 2 comments · Fixed by #179

Comments

@jpaskhay
Copy link
Contributor

We're running into an intermittent issue in our environment where the PutRecords call in sendCurrentBatch hangs in the AWS SDK and times out after 5m30s (we see a read timeout when we patched in appropriate LogLevelType settings into the aws.Config). When this happens, the request is actually consumed on the Kinesis side, but there appears to be a potential bug in the AWS Go SDK that causes it to fail to parse the response and then retry internally (resulting in duplicates).

We'll be following up in the AWS Go SDK repo in parallel, as this seems similar to issues that have been previously reported for other Kinesis API calls.

In the meantime, we'd like to have the ability to use a smaller timeout to at least reduce the time spent hanging when this occurs. I'll be submitting a PR that allows for configuring the HTTP timeout.

@jpaskhay
Copy link
Contributor Author

I forgot to update this issue to link to aws/aws-sdk-go#4149 that was mentioned in the original description.

@zhonghui12
Copy link
Contributor

This change will be included in our next release.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants