Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BUG] "mvn clean package -DskipTests" is no longer working #3987

Closed
andygrove opened this issue Nov 1, 2021 · 0 comments · Fixed by #3991
Closed

[BUG] "mvn clean package -DskipTests" is no longer working #3987

andygrove opened this issue Nov 1, 2021 · 0 comments · Fixed by #3991
Assignees
@gerashegalov
Labels
bug Something isn't working build Related to CI / CD or cleanly building P0 Must have for release
Milestone
Nov 1 - Nov 12

Comments

@andygrove
Copy link
Contributor

Describe the bug

It seems that we can no longer run mvn clean package -DskipTests so we should fix this or document this if it is no longer possible to support.

[INFO] Resolving com.nvidia:rapids-4-spark-aggregator_2.12:jar:spark301:21.12.0-SNAPSHOT
[INFO] Downloading from snapshots-repo: https://oss.sonatype.org/content/repositories/snapshots/com/nvidia/rapids-4-spark-aggregator_2.12/21.12.0-SNAPSHOT/maven-metadata.xml
[WARNING] Could not transfer metadata com.nvidia:rapids-4-spark-aggregator_2.12:21.12.0-SNAPSHOT/maven-metadata.xml from/to apache-snapshots-repo (${env.URM_URL}): Cannot access ${env.URM_URL} with type default using the available connector factories: BasicRepositoryConnectorFactory
[WARNING] Could not transfer metadata com.nvidia:rapids-4-spark-aggregator_2.12:21.12.0-SNAPSHOT/maven-metadata.xml from/to apache.snapshots.https (${env.URM_URL}): Cannot access ${env.URM_URL} with type default using the available connector factories: BasicRepositoryConnectorFactory
[WARNING] Could not transfer metadata com.nvidia:rapids-4-spark-aggregator_2.12:21.12.0-SNAPSHOT/maven-metadata.xml from/to apache.snapshots (${env.URM_URL}): Cannot access ${env.URM_URL} with type default using the available connector factories: BasicRepositoryConnectorFactory
[WARNING] Could not transfer metadata com.nvidia:rapids-4-spark-aggregator_2.12:21.12.0-SNAPSHOT/maven-metadata.xml from/to snapshots (${env.URM_URL}): Cannot access ${env.URM_URL} with type default using the available connector factories: BasicRepositoryConnectorFactory
[INFO] Downloading from snapshots-repo: https://oss.sonatype.org/content/repositories/snapshots/com/nvidia/rapids-4-spark-aggregator_2.12/21.12.0-SNAPSHOT/rapids-4-spark-aggregator_2.12-21.12.0-SNAPSHOT-spark301.jar
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  2.040 s
[INFO] Finished at: 2021-11-01T13:21:40-06:00
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-dependency-plugin:2.8:get (default-cli) on project rapids-4-spark_2.12: Couldn't download artifact: Could not transfer artifact com.nvidia:rapids-4-spark-aggregator_2.12:jar:spark301:21.12.0-SNAPSHOT from/to apache-snapshots-repo (${env.URM_URL}): Cannot access ${env.URM_URL} with type default using the available connector factories: BasicRepositoryConnectorFactory
[ERROR]   com.nvidia:rapids-4-spark-aggregator_2.12:jar:21.12.0-SNAPSHOT
[ERROR] 
[ERROR] from the specified remote repositories:
[ERROR]   apache-snapshots-repo (${env.URM_URL}, releases=true, snapshots=true),
[ERROR]   apache.snapshots.https (${env.URM_URL}, releases=true, snapshots=true),
[ERROR]   apache.snapshots (${env.URM_URL}, releases=true, snapshots=true),
[ERROR]   central (${env.URM_URL}, releases=true, snapshots=false),
[ERROR]   snapshots (${env.URM_URL}, releases=true, snapshots=true),
[ERROR]   snapshots-repo (https://oss.sonatype.org/content/repositories/snapshots, releases=false, snapshots=true): Cannot access ${env.URM_URL} using the registered transporter factories: WagonTransporterFactory: Unsupported transport protocol
[ERROR] -> [Help 1]

I was able to run mvn clean install -DskipTests instead as a workaround.

Steps/Code to reproduce bug
Run mvn clean package -DskipTests

Expected behavior
Should not fail

Environment details (please complete the following information)
Ubuntu 20.04.03 LTS

Additional context
None
@andygrove andygrove added bug Something isn't working ? - Needs Triage Need team to review and classify build Related to CI / CD or cleanly building labels Nov 1, 2021
@gerashegalov gerashegalov self-assigned this Nov 1, 2021
@gerashegalov gerashegalov added P0 Must have for release and removed ? - Needs Triage Need team to review and classify labels Nov 1, 2021
@gerashegalov gerashegalov added this to the Nov 1 - Nov 12 milestone Nov 1, 2021
gerashegalov added a commit to gerashegalov/spark-rapids that referenced this issue Nov 1, 2021
@gerashegalov
Fix aggegator jar copy logic
a7f8435 
1) Make dependency:get conditional on whether the jar is being created
   in the current build's package phase, fallback on the previously
   installed
2) dependency:get should receive jenkins/settings only on CI

3) propagate maven.repo.local if set

Closes NVIDIA#3987

Signed-off-by: Gera Shegalov <[email protected]>
This was referenced Nov 1, 2021
Merged
Closed
@pxLi pxLi closed this as completed in #3991 Nov 2, 2021
pxLi pushed a commit that referenced this issue Nov 2, 2021
@gerashegalov
Fix aggegator jar copy logic [databricks] (#3991)
c834835 
* Fix aggegator jar copy logic

1) Make dependency:get conditional on whether the jar is being created
   in the current build's package phase, fallback on the previously
   installed
2) dependency:get should receive jenkins/settings only on CI

3) propagate maven.repo.local if set

Closes #3987

Signed-off-by: Gera Shegalov <[email protected]>

* Prefer files in the build dirs

Signed-off-by: Gera Shegalov <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@gerashegalov gerashegalov

Labels
bug Something isn't working build Related to CI / CD or cleanly building P0 Must have for release
Projects
None yet
Milestone
Nov 1 - Nov 12
Development

Successfully merging a pull request may close this issue.

Fix aggregator jar copy logic [databricks] gerashegalov/spark-rapids
2 participants
@andygrove @gerashegalov