Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fix leaking sockets open in HoodiePartitionMetadata #573

Closed
bhasudha opened this issue Feb 13, 2019 · 2 comments
Closed

Fix leaking sockets open in HoodiePartitionMetadata #573

bhasudha opened this issue Feb 13, 2019 · 2 comments
Assignees
@bhasudha

Comments

@bhasudha
Copy link
Contributor

We tried deploying Presto with latest Hoodie jars and observed sudden increase in the number of open sockets used from Presto coordinator. The sockets are in CLOSE_WAIT state. Since Presto is a long running process this seems like an issue specific for Presto and cannot be observed in short lived process like Hive/Spark applications. Debugging this further, we identified that this could be from HoodiePartitionMetadata.readFromFS() not closing the HOODIE_PARTITION_METAFILE.
@bhasudha
Copy link
Contributor Author

I can work on this if you folks are okay. @vinothchandar @n3nash @bvaradar

@vinothchandar
Copy link
Member

all yours. good catch btw

vinishjail97 added a commit to vinishjail97/hudi that referenced this issue Mar 13, 2024
@vinishjail97
[HUDI-7452] Repartition row dataset in S3/GCS based on task size (apa…
23399fb 
…che#573)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@bhasudha bhasudha

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@vinothchandar @bhasudha