Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unarchive Spark test jar for spark.read(ability) #10946

Merged
merged 5 commits into from
May 30, 2024

Conversation

gerashegalov
Copy link
Collaborator

@gerashegalov gerashegalov commented May 29, 2024

Closes #10875
Contributes to #10773

Unjar, cache, and share the test jar content among all test suites from the same jar

Test:

mvn package -Dbuildver=330 -pl tests -am -Dsuffixes='.*\.RapidsJsonSuite'

Signed-off-by: Gera Shegalov [email protected]

Closes NVIDIA#10875
Contributes to NVIDIA#10773

Spark UTs need to be able to spark.read data

Signed-off-by: Gera Shegalov <[email protected]>
Signed-off-by: Gera Shegalov <[email protected]>
@gerashegalov gerashegalov marked this pull request as ready for review May 29, 2024 19:16
@gerashegalov gerashegalov self-assigned this May 29, 2024
@gerashegalov gerashegalov added feature request New feature or request test Only impacts tests labels May 29, 2024
@gerashegalov
Copy link
Collaborator Author

build

Signed-off-by: Gera Shegalov <[email protected]>
@gerashegalov gerashegalov requested a review from jlowe May 29, 2024 23:23
Signed-off-by: Gera Shegalov <[email protected]>
@gerashegalov
Copy link
Collaborator Author

build

@gerashegalov gerashegalov merged commit e23bf38 into NVIDIA:branch-24.08 May 30, 2024
43 of 44 checks passed
@gerashegalov gerashegalov deleted the 10875-spark-ut-data branch May 30, 2024 15:18
SurajAralihalli pushed a commit to SurajAralihalli/spark-rapids that referenced this pull request Jul 12, 2024
Closes NVIDIA#10875
Contributes to NVIDIA#10773
    
Unjar, cache, and share the test jar content among all test suites from the same jar

Test:
```bash
mvn package -Dbuildver=330 -pl tests -am -Dsuffixes='.*\.RapidsJsonSuite'
```

Signed-off-by: Gera Shegalov <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request New feature or request test Only impacts tests
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants