Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support broadcast nested loop join for LeftSemi and LeftAnti #3184

Merged
merged 4 commits into from
Aug 17, 2021

Conversation

jlowe
Copy link
Member

@jlowe jlowe commented Aug 10, 2021

Part of #3111.

Adds GPU support for LeftSemi and LeftAnti broadcast nested loop joins for conditions that can be supported by cudf AST expressions. This is dependent upon rapidsai/cudf#9002 for the new conditional join method names.

@jlowe jlowe added the SQL part of the SQL/Dataframe plugin label Aug 10, 2021
@jlowe jlowe added this to the Aug 2 - Aug 13 milestone Aug 10, 2021
@jlowe jlowe self-assigned this Aug 10, 2021
revans2
revans2 previously approved these changes Aug 11, 2021
@jlowe jlowe marked this pull request as ready for review August 17, 2021 13:57
@jlowe
Copy link
Member Author

jlowe commented Aug 17, 2021

build

@jlowe jlowe merged commit ec0cfab into NVIDIA:branch-21.10 Aug 17, 2021
@jlowe jlowe deleted the ast-semi-join branch August 17, 2021 18:08
razajafri pushed a commit to razajafri/spark-rapids that referenced this pull request Aug 23, 2021
…3184)

* Support broadcast nested loop join for LeftSemi and LeftAnti

Signed-off-by: Jason Lowe <[email protected]>

* Handle empty condition for semi/anti join

* Update comments and add assert for unconditional case

* scalastyle fix
Signed-off-by: Raza Jafri <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
SQL part of the SQL/Dataframe plugin
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants