Is there a bug in Memory usage of 0.21.0 ?

[XiaoGe2030]

Memory usage 95%？？？

[XiaoGe2030]

I want to konw Which version fuse you used ?

[kahing]

fuse version is not relevant here. did memory grow over time? could you note the memory usage before/after doing the 500MB write in #457? If you have a list of steps you take to reproduce this it would be very helpful

[XiaoGe2030]

I use aws S3 bucket ，upload 50G file。the memery usage more than 50%。Finally ，Causing process exit，and upload failed !!!

the upload speed could arrive 120MB/S , but Memory usage is too high。I think there must be a bug !

[XiaoGe2030]

fuse version is not relevant here. did memory grow over time? could you note the memory usage before/after doing the 500MB write in #457? If you have a list of steps you take to reproduce this it would be very helpful

I am looking source code ,hope too find the problem ,why Memeroy Uasge is so high, and goofys process exit.

[XiaoGe2030]

fuse version is not relevant here. did memory grow over time? could you note the memory usage before/after doing the 500MB write in #457? If you have a list of steps you take to reproduce this it would be very helpful

I found goofys binay file ,which make build by myself , it's can upload 50G file ,and Memeroy Uasge is only 50%。 I think if the release version of goofys is not correct?

[kahing]

what does goofys --version say for your own goofys binary?

[diamondap]

For what it's worth, the underlying AWS S3 library is known to use huge amounts of memory when uploading. See aws/aws-sdk-go#2228 and aws/aws-sdk-go#2036.

[kahing]

I don't use the upload manger

[darkdragon-001]

There was a similar bug in rclone (which is also using AWS SDK) but was fixed in their latest version. Maybe you can gain some insights from their fix.