Pravega Spark Connectors 0.12.0
Release 0.12.0 of Pravega Spark Connectors
This release support Spark version 2.4 on Scala 2.11 and 3.1+ on Scala 2.12. It is tested and validated with Pravega 0.12.0 release.
Spark 3 connector artifacts are listed in the assets. The release artifacts of the supported Spark versions are available on Maven Central.
Highlight features:
- (#149 #147) Unified support for Spark 3.1+
Spark 3 connector now supports Spark 3.1, 3.2 and 3.3, along with this, the artifact name for Spark 3 connector is changed frompravega-connectors-spark-3.1_2.12
into a unifiedpravega-connectors-spark-3_2.12
, you can now import the dependency like this
<dependency>
<groupId>io.pravega</groupId>
<artifactId>pravega-connectors-spark-3_2.12</artifactId>
<version>0.12.0</version>
</dependency>
Here is the complete list of commits: changelog-spark.txt