You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
PR 4956 introduced spark-avro jar in the test classpath, so every time when running integration tests, spark-avro jar will be involved which will be OK for avro test cases. But in fact, users may not include spark-avro in their user case, if some spark-avro code is involved by accident, then rapids plugin will throw exceptions.
So we need to add some checks to run integration tests without spark-avro jar to ensure no spark-avro code is involved. See the comments
The text was updated successfully, but these errors were encountered:
Shall we run the avro test cases of integration test separately? So that only avro test cases require to add spark-avro.jar, and the others run without it.
This is a follow up of #4956
PR 4956 introduced spark-avro jar in the test classpath, so every time when running integration tests, spark-avro jar will be involved which will be OK for avro test cases. But in fact, users may not include spark-avro in their user case, if some spark-avro code is involved by accident, then rapids plugin will throw exceptions.
So we need to add some checks to run integration tests without spark-avro jar to ensure no spark-avro code is involved. See the comments
The text was updated successfully, but these errors were encountered: