You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
Currently, executors fetch shuffle partition data from upstreams sequentially, which is not efficient.
Describe the solution you'd like
It's better to make it run in parallel with some throughput control. What's more, we can optimize the shuffle data fetching way to avoid hot executor IOs.
Describe alternatives you've considered
Additional context
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
Currently, executors fetch shuffle partition data from upstreams sequentially, which is not efficient.
Describe the solution you'd like
It's better to make it run in parallel with some throughput control. What's more, we can optimize the shuffle data fetching way to avoid hot executor IOs.
Describe alternatives you've considered
Additional context
The text was updated successfully, but these errors were encountered: