.NET for Apache Spark 0.7 Release Notes

New Features and Improvements

Expose SparkContext.setLogLevel() to change log level programmatically (#360)
Expose Schema() for DataFrameReader and DataStreamReader(#248)
Expose Column.Apply() (#323)
"Deprecated" annotation is added to the following functions:
- WindowSpec.RangeBetween(Column start, Column end)
- Window.RangeBetween(Column start, Column end)
- Functions.UnboundedPreceding()
- Functions.UnboundedFollowing()
- Functions.CurrentRow()

Breaking Changes

The following APIs have been removed due to the thread-local variable dependency (see #332 and #333 for more detail):
- SparkSession.ClearActiveSession()
- SparkSession.GetActiveSession()
- SparkSession.SetActiveSession()

Supported Spark Versions

The following table outlines the supported Spark versions along with the microsoft-spark JAR to use with:

Spark Version	microsoft-spark JAR
2.3.*	microsoft-spark-2.3.x-0.7.0.jar
2.4.0	microsoft-spark-2.4.x-0.7.0.jar
2.4.1
2.4.3
2.4.4
2.4.2	Not supported