Increase the default value for MinPartitionSize
variable
#6384
Labels
P1
Important tasks that we should complete soon
MinPartitionSize
variable
#6384
'32' seems like a very small value for such a variable.
I personally doubt that we would actually need 4 partitions for a dataframe with the shape of
(nrows=256, columns=4)
as the overhead of the execution engine will likely overdo all the benefits we can get from parallelization on such small data:modin/modin/config/envvars.py
Lines 602 to 611 in d6a6cf3
We should run some tests and reconsider the default value for this
The text was updated successfully, but these errors were encountered: