Skip to content
This repository has been archived by the owner on Sep 18, 2023. It is now read-only.

Commit

Permalink
[NSE-784] fallback Sort after SortHashAgg (#780)
Browse files Browse the repository at this point in the history
* fallback Sort after SortHashAgg

Signed-off-by: Yuan Zhou <[email protected]>

* Revert "fallback Sort after SortHashAgg"

This reverts commit 7e2788e.

* fix sort with expand

Signed-off-by: Yuan Zhou <[email protected]>
  • Loading branch information
zhouyuan authored Mar 22, 2022
1 parent a75bd1c commit 1f25067
Showing 1 changed file with 4 additions and 0 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -162,6 +162,10 @@ case class ColumnarPreOverrides() extends Rule[SparkPlan] {
case plan: SortExec =>
val child = replaceWithColumnarPlan(plan.child)
logDebug(s"Columnar Processing for ${plan.getClass} is currently supported.")
if (child.isInstanceOf[ExpandExec]) {
//FIXME: quick for Sort spill bug
return plan.withNewChildren(Seq(child))
}
child match {
case p: CoalesceBatchesExec =>
ColumnarSortExec(plan.sortOrder, plan.global, p.child, plan.testSpillFrequency)
Expand Down

0 comments on commit 1f25067

Please sign in to comment.