Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEA] allow tighter explicit cudf artifact dependency configuration #5162

Open
gerashegalov opened this issue Apr 7, 2022 · 0 comments
Open
Labels
build Related to CI / CD or cleanly building

Comments

@gerashegalov
Copy link
Collaborator

gerashegalov commented Apr 7, 2022

Is your feature request related to a problem? Please describe.
As a RAPIDS Spark Plugin developer working across cuDF and spark-rapids I wish I could more robustly point to a cudf build dependency without fearing of non-deterministically pulling the cuDF artifact from a remote build instead of the locally-built test artifact. Developers often report bugs or successful tests that cannot be confirmed in CI

Describe the solution you'd like
Have an easy explicit flag/profile that deterministically switch between locally-built cudf artifact and remote artifacts. E.g. -Dcudf.home=/local/path/to/cudfrepo

We may also change local cuDF automation like rapidsai/cudf#10578 produce a version suffix or dedicated classifier -local, and override dependency version via simple Profile switch like -PlocalCudf

Describe alternatives you've considered
carefully inspect the log file and verify the build info

Additional context
N/A

@gerashegalov gerashegalov added feature request New feature or request ? - Needs Triage Need team to review and classify build Related to CI / CD or cleanly building labels Apr 7, 2022
@sameerz sameerz removed feature request New feature or request ? - Needs Triage Need team to review and classify labels Apr 12, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
build Related to CI / CD or cleanly building
Projects
None yet
Development

No branches or pull requests

2 participants