Release v0.5.0 (#272)

Author: imback82

README.md

@@ -39,7 +39,7 @@
     <tbody align="center">
         <tr>
             <td >2.3.*</td>
-            <td rowspan=4><a href="https://github.com/dotnet/spark/releases/tag/v0.4.0">v0.4.0</a></td>
+            <td rowspan=5><a href="https://github.com/dotnet/spark/releases/tag/v0.5.0">v0.5.0</a></td>
         </tr>
         <tr>
             <td>2.4.0</td>
@@ -50,6 +50,9 @@
         <tr>
             <td>2.4.3</td>
         </tr>
+        <tr>
+            <td>2.4.4</td>
+        </tr>
         <tr>
             <td>2.4.2</td>
             <td><a href="https://github.com/dotnet/spark/issues/60">Not supported</a></td>

benchmark/scala/pom.xml

@@ -3,7 +3,7 @@
   <modelVersion>4.0.0</modelVersion>
   <groupId>com.microsoft.spark</groupId>
   <artifactId>microsoft-spark-benchmark</artifactId>
-  <version>0.4.0</version>
+  <version>0.5.0</version>
   <inceptionYear>2019</inceptionYear>
   <properties>
     <encoding>UTF-8</encoding>

docs/release-notes/0.5/release-0.5.md

@@ -0,0 +1,57 @@
+# .NET for Apache Spark 0.5 Release Notes
+
+### New Features and Improvements
+
+* Support for `DeltaTable` APIs in [Delta Lake](https://github.com/delta-io/delta) ([#236](https://github.com/dotnet/spark/pull/236))
+* Support for Spark 2.3.4/2.4.4 ([#232](https://github.com/dotnet/spark/pull/232), [#240](https://github.com/dotnet/spark/pull/240))
+* Support for UDF taking a `Row` object as input ([#214](https://github.com/dotnet/spark/pull/214))
+* Exposing new APIs:
+   * `Column.IsIn` ([#171](https://github.com/dotnet/spark/pull/171))
+   * `SparkSession.Range(), *ActiveSession(), *DefaultSession()` ([#225](https://github.com/dotnet/spark/pull/225), [#266](https://github.com/dotnet/spark/pull/266))
+   * `SparkSession.Catalog` ([#231](https://github.com/dotnet/spark/pull/231))
+   * `SparkFiles` ([#255](https://github.com/dotnet/spark/pull/255))
+   * `DataFrameReader.Jdbc()` ([#262](https://github.com/dotnet/spark/pull/262)) 
+   * `RelationalGroupedDataset.Agg(), Sum(), Mean(), Min(), Max(), Avg()` ([#263](https://github.com/dotnet/spark/pull/263), [#265](https://github.com/dotnet/spark/pull/265))
+   * `DataStreamWriter.PartitionBy` ([#270](https://github.com/dotnet/spark/pull/270))
+* Ground work to support [dotnet-try](https://github.com/dotnet/try) as C# REPL ([#251](https://github.com/dotnet/spark/pull/251))
+* Bug fix in generating Nuget package ([#234](https://github.com/dotnet/spark/pull/234))
+* Support for `MapType` ([#235](https://github.com/dotnet/spark/pull/235))
+
+### Breaking Changes
+* None, but the new `Microsoft.Spark.Worker` needs to be used to enable UDF taking `Row` object as input ([#214](https://github.com/dotnet/spark/pull/214)).
+
+### Supported Spark Versions
+
+The following table outlines the supported Spark versions along with the microsoft-spark JAR to use with:
+
+<table>
+    <thead>
+        <tr>
+            <th>Spark Version</th>
+            <th>microsoft-spark JAR</th>
+        </tr>
+    </thead>
+    <tbody align="center">
+        <tr>
+            <td>2.3.*</td>
+            <td>microsoft-spark-2.3.x-0.4.0.jar</td>
+        </tr>
+        <tr>
+            <td>2.4.0</td>
+            <td rowspan=4>microsoft-spark-2.4.x-0.4.0.jar</td>
+        </tr>
+        <tr>
+            <td>2.4.1</td>
+        </tr>
+        <tr>
+            <td>2.4.3</td>
+        </tr>
+        <tr>
+            <td>2.4.4</td>
+        </tr>
+        <tr>
+            <td>2.4.2</td>
+            <td><a href="https://github.com/dotnet/spark/issues/60">Not supported</a></td>
+        </tr>
+    </tbody>
+</table>

eng/Versions.props

@@ -1,7 +1,7 @@
 <?xml version="1.0" encoding="utf-8"?>
 <Project ToolsVersion="4.0" xmlns="http://schemas.microsoft.com/developer/msbuild/2003">
   <PropertyGroup>
-    <VersionPrefix>0.4.0</VersionPrefix>
+    <VersionPrefix>0.5.0</VersionPrefix>
     <PreReleaseVersionLabel>prerelease</PreReleaseVersionLabel>
     <RestoreSources>
       $(RestoreSources);

src/scala/microsoft-spark-2.3.x/pom.xml

@@ -4,7 +4,7 @@
   <parent>
     <groupId>com.microsoft.scala</groupId>
     <artifactId>microsoft-spark</artifactId>
-    <version>0.4.0</version>
+    <version>0.5.0</version>
   </parent>
   <artifactId>microsoft-spark-2.3.x</artifactId>
   <inceptionYear>2019</inceptionYear>

src/scala/microsoft-spark-2.4.x/pom.xml

@@ -4,7 +4,7 @@
   <parent>
     <groupId>com.microsoft.scala</groupId>
     <artifactId>microsoft-spark</artifactId>
-    <version>0.4.0</version>
+    <version>0.5.0</version>
   </parent>
   <artifactId>microsoft-spark-2.4.x</artifactId>
   <inceptionYear>2019</inceptionYear>

src/scala/pom.xml

@@ -4,7 +4,7 @@
   <groupId>com.microsoft.scala</groupId>
   <artifactId>microsoft-spark</artifactId>
   <packaging>pom</packaging>
-  <version>0.4.0</version>
+  <version>0.5.0</version>
   <properties>
     <encoding>UTF-8</encoding>
   </properties>