Skip to content

Pravega Spark Connectors 0.12.0

Compare
Choose a tag to compare
@crazyzhou crazyzhou released this 29 Sep 01:52
· 6 commits to master since this release

Release 0.12.0 of Pravega Spark Connectors

This release support Spark version 2.4 on Scala 2.11 and 3.1+ on Scala 2.12. It is tested and validated with Pravega 0.12.0 release.

Spark 3 connector artifacts are listed in the assets. The release artifacts of the supported Spark versions are available on Maven Central.

Highlight features:

  • (#149 #147) Unified support for Spark 3.1+
    Spark 3 connector now supports Spark 3.1, 3.2 and 3.3, along with this, the artifact name for Spark 3 connector is changed from pravega-connectors-spark-3.1_2.12 into a unified pravega-connectors-spark-3_2.12, you can now import the dependency like this
<dependency>
    <groupId>io.pravega</groupId>
    <artifactId>pravega-connectors-spark-3_2.12</artifactId>
    <version>0.12.0</version>
</dependency>

Here is the complete list of commits: changelog-spark.txt