You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
currently when uploading to S3, we buffer 5 GiB chunks to disk before uploading each.
It's necessary to buffer the first part as this is the only way to make the correct choice of PutObject vs CreateMultipartUpload while minimizing API usage.
however, it's probably inefficient to do this for every part. For the second part onward, we should stream the upload directly.
The text was updated successfully, but these errors were encountered:
currently when uploading to S3, we buffer 5 GiB chunks to disk before uploading each.
It's necessary to buffer the first part as this is the only way to make the correct choice of
PutObject
vsCreateMultipartUpload
while minimizing API usage.however, it's probably inefficient to do this for every part. For the second part onward, we should stream the upload directly.
The text was updated successfully, but these errors were encountered: