Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEA] Add a Spark 3.X Explain only mode to the plugin #4238

Closed
tgravescs opened this issue Nov 30, 2021 · 0 comments · Fixed by #4322
Closed

[FEA] Add a Spark 3.X Explain only mode to the plugin #4238

tgravescs opened this issue Nov 30, 2021 · 0 comments · Fixed by #4322
Assignees
Labels
feature request New feature or request P0 Must have for release

Comments

@tgravescs
Copy link
Collaborator

Is your feature request related to a problem? Please describe.
For Spark versions 3.0+ add support to the plugin to run on the CPU in explain only mode. This would be similar to the explainPotentialGpuPlan api added but instead of user having to modify their code just have a config that says run the plugin in explain only mode and for each of the plans it just dumps out explain output to the logs but still runs everything on the CPU.

This could be used by customers who are evaluating using the plugin but don't have access to GPUs yet and want to see what parts of their query will run on the GPU and perhaps which features aren't yet supported.

@tgravescs tgravescs added feature request New feature or request ? - Needs Triage Need team to review and classify labels Nov 30, 2021
@Salonijain27 Salonijain27 added this to the Nov 30 - Dec 10 milestone Nov 30, 2021
@Salonijain27 Salonijain27 added P1 Nice to have for release and removed ? - Needs Triage Need team to review and classify labels Nov 30, 2021
@tgravescs tgravescs changed the title [FEA] Add an Explain only mode to the plugin [FEA] Add a Spark 3.X Explain only mode to the plugin Dec 14, 2021
@tgravescs tgravescs added P0 Must have for release and removed P1 Nice to have for release labels Dec 21, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request New feature or request P0 Must have for release
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants