Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Allow to define chunk size #757

Closed
Farkal opened this issue Mar 18, 2019 · 5 comments
Closed

Allow to define chunk size #757

Farkal opened this issue Mar 18, 2019 · 5 comments
Labels
community priority: medium
Milestone
Current

Comments

@Farkal
Copy link

Farkal commented Mar 18, 2019

I am piping a stream from an http request to minio and the website don't share file size in content-length.

Minio split this file in 3 chunk (the file size is 1.7GB) and the upload become extremely slow.

If I first download the object and send it to minio after with fPutObject, everything is fine and we get lot of small chunks.

Is it possible to allow user to define the chunk size or by default start using small chunk size ?
@kannappanr
Copy link
Contributor

@Farkal In the case of unknown size, the part size is probably set to 512 MB. Will check internally and see if this can be configured in this scenario.

@kannappanr kannappanr added this to the Current milestone Mar 18, 2019
@kannappanr
Copy link
Contributor

@Farkal we will add a way to set the part_size in this scenario.

@Farkal
Copy link
Author

Farkal commented Mar 19, 2019

Ok thank you very much !

@kannappanr
Copy link
Contributor

Here is the PR #759

@kannappanr
Copy link
Contributor

Closing this as #759 has been merged

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
community priority: medium
Projects
None yet
Milestone
Current
Development

No branches or pull requests
2 participants
@Farkal @kannappanr