Spark Release 4.35.0 (#43121)

* Spark release 4.35.0 * spark release 4.35.0 * update pom.xml * update CHANGELOG.md * disable tests due to change in emulator behavior
Azure · Nov 27, 2024 · fce8b13 · fce8b13
1 parent 9ec647d
commit fce8b13
Show file tree

Hide file tree

Showing 20 changed files with 156 additions and 159 deletions.
diff --git a/eng/versioning/version_client.txt b/eng/versioning/version_client.txt
@@ -107,11 +107,11 @@ com.azure:azure-cosmos-benchmark;4.0.1-beta.1;4.0.1-beta.1
 com.azure:azure-cosmos-dotnet-benchmark;4.0.1-beta.1;4.0.1-beta.1
 com.azure.cosmos.spark:azure-cosmos-spark_3_2-12;1.0.0-beta.1;1.0.0-beta.1
 com.azure:azure-cosmos-encryption;2.16.0;2.17.0-beta.1
-com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12;4.34.0;4.35.0-beta.1
-com.azure.cosmos.spark:azure-cosmos-spark_3-2_2-12;4.34.0;4.35.0-beta.1
-com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12;4.34.0;4.35.0-beta.1
-com.azure.cosmos.spark:azure-cosmos-spark_3-4_2-12;4.34.0;4.35.0-beta.1
-com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-12;4.34.0;4.35.0-beta.1
+com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12;4.34.0;4.35.0
+com.azure.cosmos.spark:azure-cosmos-spark_3-2_2-12;4.34.0;4.35.0
+com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12;4.34.0;4.35.0
+com.azure.cosmos.spark:azure-cosmos-spark_3-4_2-12;4.34.0;4.35.0
+com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-12;4.34.0;4.35.0
 com.azure.cosmos.spark:azure-cosmos-spark-account-data-resolver-sample;1.0.0-beta.1;1.0.0-beta.1
 com.azure:azure-cosmos-test;1.0.0-beta.9;1.0.0-beta.10
 com.azure:azure-cosmos-tests;1.0.0-beta.1;1.0.0-beta.1

diff --git a/sdk/cosmos/azure-cosmos-spark-account-data-resolver-sample/pom.xml b/sdk/cosmos/azure-cosmos-spark-account-data-resolver-sample/pom.xml
@@ -97,7 +97,7 @@
     <dependency>
       <groupId>com.azure.cosmos.spark</groupId>
       <artifactId>azure-cosmos-spark_3-5_2-12</artifactId>
-      <version>4.35.0-beta.1</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-12;current} -->
+      <version>4.35.0</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-5_2-12;current} -->
       <scope>provided</scope>
     </dependency>
     <dependency>

diff --git a/sdk/cosmos/azure-cosmos-spark_3-1_2-12/CHANGELOG.md b/sdk/cosmos/azure-cosmos-spark_3-1_2-12/CHANGELOG.md
@@ -1,16 +1,10 @@
 ## Release History
 
-### 4.35.0-beta.1 (Unreleased)
-
-#### Features Added
-
-#### Breaking Changes
+### 4.35.0 (2024-11-27)
 
 #### Bugs Fixed
 * Fixed an issue when using `ChangeFeed` causing some cosmos partitions to not be fully processed in some cases. - See [PR 42553](https://github.com/Azure/azure-sdk-for-java/pull/42553)
 
-#### Other Changes
-
 ### 4.34.0 (2024-10-10)
 > [!IMPORTANT]
 > We strongly recommend our customers to use version 4.34.0 and above.

diff --git a/sdk/cosmos/azure-cosmos-spark_3-1_2-12/README.md b/sdk/cosmos/azure-cosmos-spark_3-1_2-12/README.md
@@ -29,6 +29,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
 #### azure-cosmos-spark_3-1_2-12
 | Connector    | Supported Spark Versions | Supported JVM Versions | Supported Scala Versions | Supported Databricks Runtimes |
 |--------------|--------------------------|------------------------|--------------------------|-------------------------------|
+| 4.35.0       | 3.1.1 - 3.1.2            | [8, 11]                | 2.12                     | 8.\*, 9.\*                    |
 | 4.34.0       | 3.1.1 - 3.1.2            | [8, 11]                | 2.12                     | 8.\*, 9.\*                    |
 | 4.33.1       | 3.1.1 - 3.1.2            | [8, 11]                | 2.12                     | 8.\*, 9.\*                    |
 | 4.33.0       | 3.1.1 - 3.1.2            | [8, 11]                | 2.12                     | 8.\*, 9.\*                    |
@@ -100,6 +101,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
 #### azure-cosmos-spark_3-2_2-12
 | Connector | Supported Spark Versions | Supported JVM Versions | Supported Scala Versions | Supported Databricks Runtimes |
 |-----------|--------------------------|------------------------|--------------------------|-------------------------------|
+| 4.35.0    | 3.2.0 - 3.2.1            | [8, 11]                | 2.12                     | 10.\*                         |
 | 4.34.0    | 3.2.0 - 3.2.1            | [8, 11]                | 2.12                     | 10.\*                         |
 | 4.33.1    | 3.2.0 - 3.2.1            | [8, 11]                | 2.12                     | 10.\*                         |
 | 4.33.0    | 3.2.0 - 3.2.1            | [8, 11]                | 2.12                     | 10.\*                         |
@@ -156,6 +158,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
 #### azure-cosmos-spark_3-3_2-12
 | Connector | Supported Spark Versions | Supported JVM Versions | Supported Scala Versions | Supported Databricks Runtimes |
 |-----------|--------------------------|------------------------|--------------------------|-------------------------------|
+| 4.35.0    | 3.3.0                    | [8, 11]                | 2.12                     | 11.\*, 12.\*                  |
 | 4.34.0    | 3.3.0                    | [8, 11]                | 2.12                     | 11.\*, 12.\*                  |
 | 4.33.1    | 3.3.0                    | [8, 11]                | 2.12                     | 11.\*, 12.\*                  |
 | 4.33.0    | 3.3.0                    | [8, 11]                | 2.12                     | 11.\*, 12.\*                  |
@@ -194,6 +197,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
 #### azure-cosmos-spark_3-4_2-12
 | Connector | Supported Spark Versions | Supported JVM Versions | Supported Scala Versions | Supported Databricks Runtimes |
 |-----------|--------------------------|------------------------|--------------------------|-------------------------------|
+| 4.35.0    | 3.4.0                    | [8, 11]                | 2.12                     | 13.\*                         |
 | 4.34.0    | 3.4.0                    | [8, 11]                | 2.12                     | 13.\*                         |
 | 4.33.1    | 3.4.0                    | [8, 11]                | 2.12                     | 13.\*                         |
 | 4.33.0    | 3.4.0                    | [8, 11]                | 2.12                     | 13.\*                         |
@@ -224,6 +228,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
 #### azure-cosmos-spark_3-5_2-12
 | Connector | Supported Spark Versions | Minimum Java Version   | Supported Scala Versions | Supported Databricks Runtimes |
 |-----------|--------------------------|------------------------|--------------------------|-------------------------------|
+| 4.35.0    | 3.5.0                    | [8, 11]                | 2.12                     | 14.*, 15.\*                   |
 | 4.34.0    | 3.5.0                    | [8, 11]                | 2.12                     | 14.*, 15.\*                   |
 | 4.33.1    | 3.5.0                    | [8, 11]                | 2.12                     | 14.*, 15.\*                   |
 | 4.33.0    | 3.5.0                    | [8, 11]                | 2.12                     | 14.*, 15.\*                   |
@@ -239,11 +244,11 @@ to use the same version of Scala that Spark was compiled for.
 ### Download
 
 You can use the maven coordinate of the jar to auto install the Spark Connector to your Databricks Runtime 8 from Maven:
-`com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12:4.34.0`
+`com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12:4.35.0`
 
 You can also integrate against Cosmos DB Spark Connector in your SBT project:
 ```scala
-libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-1_2-12" % "4.34.0"
+libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-1_2-12" % "4.35.0"
 ```
 
 Cosmos DB Spark Connector is available on [Maven Central Repo](https://central.sonatype.com/search?namespace=com.azure.cosmos.spark).

diff --git a/sdk/cosmos/azure-cosmos-spark_3-1_2-12/pom.xml b/sdk/cosmos/azure-cosmos-spark_3-1_2-12/pom.xml
@@ -11,7 +11,7 @@
   </parent>
   <groupId>com.azure.cosmos.spark</groupId>
   <artifactId>azure-cosmos-spark_3-1_2-12</artifactId>
-  <version>4.35.0-beta.1</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12;current} -->
+  <version>4.35.0</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-1_2-12;current} -->
   <packaging>jar</packaging>
   <url>https://github.com/Azure/azure-sdk-for-java/tree/main/sdk/cosmos/azure-cosmos-spark_3-1_2-12</url>
   <name>OLTP Spark 3.1 Connector for Azure Cosmos DB SQL API</name>

diff --git a/sdk/cosmos/azure-cosmos-spark_3-2_2-12/CHANGELOG.md b/sdk/cosmos/azure-cosmos-spark_3-2_2-12/CHANGELOG.md
@@ -1,16 +1,10 @@
 ## Release History
 
-### 4.35.0-beta.1 (Unreleased)
-
-#### Features Added
-
-#### Breaking Changes
+### 4.35.0 (2024-11-27)
 
 #### Bugs Fixed
 * Fixed an issue when using `ChangeFeed` causing some cosmos partitions to not be fully processed in some cases. - See [PR 42553](https://github.com/Azure/azure-sdk-for-java/pull/42553)
 
-#### Other Changes
-
 ### 4.34.0 (2024-10-10)
 > [!IMPORTANT]
 > We strongly recommend our customers to use version 4.34.0 and above.

diff --git a/sdk/cosmos/azure-cosmos-spark_3-2_2-12/README.md b/sdk/cosmos/azure-cosmos-spark_3-2_2-12/README.md
@@ -28,6 +28,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
 #### azure-cosmos-spark_3-2_2-12
 | Connector | Supported Spark Versions | Supported JVM Versions | Supported Scala Versions | Supported Databricks Runtimes |
 |-----------|--------------------------|------------------------|--------------------------|-------------------------------|
+| 4.35.0    | 3.2.0 - 3.2.1            | [8, 11]                | 2.12                     | 10.\*                         |
 | 4.34.0    | 3.2.0 - 3.2.1            | [8, 11]                | 2.12                     | 10.\*                         |
 | 4.33.1    | 3.2.0 - 3.2.1            | [8, 11]                | 2.12                     | 10.\*                         |
 | 4.33.0    | 3.2.0 - 3.2.1            | [8, 11]                | 2.12                     | 10.\*                         |
@@ -84,6 +85,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
 #### azure-cosmos-spark_3-3_2-12
 | Connector | Supported Spark Versions | Supported JVM Versions | Supported Scala Versions | Supported Databricks Runtimes |
 |-----------|--------------------------|------------------------|--------------------------|-------------------------------|
+| 4.35.0    | 3.3.0                    | [8, 11]                | 2.12                     | 11.\*, 12.\*                  |
 | 4.34.0    | 3.3.0                    | [8, 11]                | 2.12                     | 11.\*, 12.\*                  |
 | 4.33.1    | 3.3.0                    | [8, 11]                | 2.12                     | 11.\*, 12.\*                  |
 | 4.33.0    | 3.3.0                    | [8, 11]                | 2.12                     | 11.\*, 12.\*                  |
@@ -122,6 +124,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
 #### azure-cosmos-spark_3-1_2-12
 | Connector    | Supported Spark Versions | Supported JVM Versions | Supported Scala Versions | Supported Databricks Runtimes |
 |--------------|--------------------------|------------------------|--------------------------|-------------------------------|
+| 4.35.0       | 3.2.0 - 3.2.1            | [8, 11]                | 2.12                     | 8.\*, 9.\*                    |
 | 4.34.0       | 3.2.0 - 3.2.1            | [8, 11]                | 2.12                     | 8.\*, 9.\*                    |
 | 4.33.1       | 3.2.0 - 3.2.1            | [8, 11]                | 2.12                     | 8.\*, 9.\*                    |
 | 4.33.0       | 3.2.0 - 3.2.1            | [8, 11]                | 2.12                     | 8.\*, 9.\*                    |
@@ -193,6 +196,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
 #### azure-cosmos-spark_3-4_2-12
 | Connector | Supported Spark Versions | Supported JVM Versions | Supported Scala Versions | Supported Databricks Runtimes |
 |-----------|--------------------------|------------------------|--------------------------|-------------------------------|
+| 4.35.0    | 3.4.0                    | [8, 11]                | 2.12                     | 13.*                          |
 | 4.34.0    | 3.4.0                    | [8, 11]                | 2.12                     | 13.*                          |
 | 4.33.1    | 3.4.0                    | [8, 11]                | 2.12                     | 13.*                          |
 | 4.33.0    | 3.4.0                    | [8, 11]                | 2.12                     | 13.*                          |
@@ -222,6 +226,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
 #### azure-cosmos-spark_3-5_2-12
 | Connector | Supported Spark Versions | Minimum Java Version   | Supported Scala Versions | Supported Databricks Runtimes |
 |-----------|--------------------------|------------------------|--------------------------|-------------------------------|
+| 4.35.0    | 3.5.0                    | [8, 11]                | 2.12                     | 14.*, 15.\*                   |
 | 4.34.0    | 3.5.0                    | [8, 11]                | 2.12                     | 14.*, 15.\*                   |
 | 4.33.0    | 3.5.0                    | [8, 11]                | 2.12                     | 14.*, 15.\*                   |
 | 4.32.1    | 3.5.0                    | [8, 11]                | 2.12                     | 14.*, 15.\*                   |
@@ -236,11 +241,11 @@ to use the same version of Scala that Spark was compiled for.
 ### Download
 
 You can use the maven coordinate of the jar to auto install the Spark Connector to your Databricks Runtime 10 from Maven:
-`com.azure.cosmos.spark:azure-cosmos-spark_3-2_2-12:4.34.0`
+`com.azure.cosmos.spark:azure-cosmos-spark_3-2_2-12:4.35.0`
 
 You can also integrate against Cosmos DB Spark Connector in your SBT project:
 ```scala
-libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-2_2-12" % "4.34.0"
+libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-2_2-12" % "4.35.0"
 ```
 
 Cosmos DB Spark Connector is available on [Maven Central Repo](https://central.sonatype.com/search?namespace=com.azure.cosmos.spark).

diff --git a/sdk/cosmos/azure-cosmos-spark_3-2_2-12/pom.xml b/sdk/cosmos/azure-cosmos-spark_3-2_2-12/pom.xml
@@ -11,7 +11,7 @@
   </parent>
   <groupId>com.azure.cosmos.spark</groupId>
   <artifactId>azure-cosmos-spark_3-2_2-12</artifactId>
-  <version>4.35.0-beta.1</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-2_2-12;current} -->
+  <version>4.35.0</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-2_2-12;current} -->
   <packaging>jar</packaging>
   <url>https://github.com/Azure/azure-sdk-for-java/tree/main/sdk/cosmos/azure-cosmos-spark_3-2_2-12</url>
   <name>OLTP Spark 3.2 Connector for Azure Cosmos DB SQL API</name>

diff --git a/sdk/cosmos/azure-cosmos-spark_3-3_2-12/CHANGELOG.md b/sdk/cosmos/azure-cosmos-spark_3-3_2-12/CHANGELOG.md
@@ -1,16 +1,10 @@
 ## Release History
 
-### 4.35.0-beta.1 (Unreleased)
-
-#### Features Added
-
-#### Breaking Changes
+### 4.35.0 (2024-11-27)
 
 #### Bugs Fixed
 * Fixed an issue when using `ChangeFeed` causing some cosmos partitions to not be fully processed in some cases. - See [PR 42553](https://github.com/Azure/azure-sdk-for-java/pull/42553)
 
-#### Other Changes
-
 ### 4.34.0 (2024-10-10)
 > [!IMPORTANT]
 > We strongly recommend our customers to use version 4.34.0 and above.

diff --git a/sdk/cosmos/azure-cosmos-spark_3-3_2-12/README.md b/sdk/cosmos/azure-cosmos-spark_3-3_2-12/README.md
@@ -28,6 +28,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
 #### azure-cosmos-spark_3-3_2-12
 | Connector | Supported Spark Versions | Supported JVM Versions | Supported Scala Versions | Supported Databricks Runtimes |
 |-----------|--------------------------|------------------------|--------------------------|-------------------------------|
+| 4.35.0    | 3.3.0                    | [8, 11]                | 2.12                     | 11.\*, 12.\*                  |
 | 4.34.0    | 3.3.0                    | [8, 11]                | 2.12                     | 11.\*, 12.\*                  |
 | 4.33.1    | 3.3.0                    | [8, 11]                | 2.12                     | 11.\*, 12.\*                  |
 | 4.33.0    | 3.3.0                    | [8, 11]                | 2.12                     | 11.\*, 12.\*                  |
@@ -66,6 +67,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
 #### azure-cosmos-spark_3-2_2-12
 | Connector | Supported Spark Versions | Supported JVM Versions | Supported Scala Versions | Supported Databricks Runtimes |
 |-----------|--------------------------|------------------------|--------------------------|-------------------------------|
+| 4.35.0    | 3.2.0 - 3.2.1            | [8, 11]                | 2.12                     | 10.\*                         |
 | 4.34.0    | 3.2.0 - 3.2.1            | [8, 11]                | 2.12                     | 10.\*                         |
 | 4.33.1    | 3.2.0 - 3.2.1            | [8, 11]                | 2.12                     | 10.\*                         |
 | 4.33.0    | 3.2.0 - 3.2.1            | [8, 11]                | 2.12                     | 10.\*                         |
@@ -122,6 +124,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
 #### azure-cosmos-spark_3-1_2-12
 | Connector    | Supported Spark Versions | Supported JVM Versions | Supported Scala Versions | Supported Databricks Runtimes |
 |--------------|--------------------------|------------------------|--------------------------|-------------------------------|
+| 4.35.0       | 3.2.0 - 3.2.1            | [8, 11]                | 2.12                     | 10.\*                         |
 | 4.34.0       | 3.2.0 - 3.2.1            | [8, 11]                | 2.12                     | 10.\*                         |
 | 4.33.1       | 3.2.0 - 3.2.1            | [8, 11]                | 2.12                     | 10.\*                         |
 | 4.33.0       | 3.2.0 - 3.2.1            | [8, 11]                | 2.12                     | 10.\*                         |
@@ -193,6 +196,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
 #### azure-cosmos-spark_3-4_2-12
 | Connector | Supported Spark Versions | Supported JVM Versions | Supported Scala Versions | Supported Databricks Runtimes |
 |-----------|--------------------------|------------------------|--------------------------|-------------------------------|
+| 4.35.0    | 3.4.0                    | [8, 11]                | 2.12                     | 13.*                          |
 | 4.34.0    | 3.4.0                    | [8, 11]                | 2.12                     | 13.*                          |
 | 4.33.1    | 3.4.0                    | [8, 11]                | 2.12                     | 13.*                          |
 | 4.33.0    | 3.4.0                    | [8, 11]                | 2.12                     | 13.*                          |
@@ -222,6 +226,7 @@ https://github.com/Azure/azure-sdk-for-java/issues/new
 #### azure-cosmos-spark_3-5_2-12
 | Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions   | Supported Databricks Runtimes |
 |-----------|--------------------------|----------------------|----------------------------|-------------------------------|
+| 4.35.0    | 3.5.0                    | [8, 11]              | 2.12                       | 14.*, 15.\*                   |
 | 4.34.0    | 3.5.0                    | [8, 11]              | 2.12                       | 14.*, 15.\*                   |
 | 4.33.1    | 3.5.0                    | [8, 11]              | 2.12                       | 14.*, 15.\*                   |
 | 4.33.0    | 3.5.0                    | [8, 11]              | 2.12                       | 14.*, 15.\*                   |
@@ -237,11 +242,11 @@ to use the same version of Scala that Spark was compiled for.
 ### Download
 
 You can use the maven coordinate of the jar to auto install the Spark Connector to your Databricks Runtime 11 from Maven:
-`com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12:4.34.0`
+`com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12:4.35.0`
 
 You can also integrate against Cosmos DB Spark Connector in your SBT project:
 ```scala
-libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-3_2-12" % "4.34.0"
+libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-3_2-12" % "4.35.0"
 ```
 
 Cosmos DB Spark Connector is available on [Maven Central Repo](https://central.sonatype.com/search?namespace=com.azure.cosmos.spark).

diff --git a/sdk/cosmos/azure-cosmos-spark_3-3_2-12/pom.xml b/sdk/cosmos/azure-cosmos-spark_3-3_2-12/pom.xml
@@ -11,7 +11,7 @@
   </parent>
   <groupId>com.azure.cosmos.spark</groupId>
   <artifactId>azure-cosmos-spark_3-3_2-12</artifactId>
-  <version>4.35.0-beta.1</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12;current} -->
+  <version>4.35.0</version> <!-- {x-version-update;com.azure.cosmos.spark:azure-cosmos-spark_3-3_2-12;current} -->
   <packaging>jar</packaging>
   <url>https://github.com/Azure/azure-sdk-for-java/tree/main/sdk/cosmos/azure-cosmos-spark_3-3_2-12</url>
   <name>OLTP Spark 3.3 Connector for Azure Cosmos DB SQL API</name>