-
Notifications
You must be signed in to change notification settings - Fork 329
Prep 0.12.0 release #564
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Prep 0.12.0 release #564
Changes from 2 commits
122caa1
1d0861c
064fcdc
8d1fccb
e14afaa
1e10110
4540df2
9ea9239
9234d1d
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,109 @@ | ||
# .NET for Apache Spark 0.11 Release Notes | ||
|
||
### New Features and Improvements | ||
|
||
* Improve build pipeline ([#510](https://github.com/dotnet/spark/pull/510)) ([#511](https://github.com/dotnet/spark/pull/511)) ([#512](https://github.com/dotnet/spark/pull/512)) ([#513](https://github.com/dotnet/spark/pull/513)) ([#524](https://github.com/dotnet/spark/pull/524)) | ||
suhsteve marked this conversation as resolved.
Outdated
Show resolved
Hide resolved
|
||
* Support for [dotnet-interactive](https://github.com/dotnet/interactive) ([#515](https://github.com/dotnet/spark/pull/515)) ([#517](https://github.com/dotnet/spark/pull/517)) ([#554](https://github.com/dotnet/spark/pull/554)) | ||
* Update `Microsoft.Data.Analysis` to v`0.4.0` ([#528](https://github.com/dotnet/spark/pull/528)) | ||
* Support for Spark 2.4.6 ([#547](https://github.com/dotnet/spark/pull/547)) | ||
* Update AppName for the C# Spark Examples ([548](https://github.com/dotnet/spark/pull/548)) | ||
suhsteve marked this conversation as resolved.
Outdated
Show resolved
Hide resolved
|
||
* Support for [Hyperspace v0.1.0](https://github.com/microsoft/hyperspace) APIs ([555](https://github.com/dotnet/spark/pull/555)) | ||
* Update maven links in build documentation ([558](https://github.com/dotnet/spark/pull/558)) ([560](https://github.com/dotnet/spark/pull/560)) | ||
* Bug fix caused by `BroadcastVariablesRegistry` ([551](https://github.com/dotnet/spark/pull/551)) | ||
|
||
### Breaking Changes | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Can you add a known issue section and add the issue where broadcast variables do not work with dotnet-interactive and reference #561? There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Also if #530 goes in before 9am tomorrow, let's add it. I will update this thread. There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Can we add #530 now? |
||
|
||
* None | ||
|
||
### Compatibility | ||
|
||
#### Backward compatibility | ||
|
||
The following table describes the oldest version of the worker that the current version is compatible with, along with new features that are incompatible with the worker. | ||
|
||
<table> | ||
<thead> | ||
<tr> | ||
<th>Oldest compatible Microsoft.Spark.Worker version</th> | ||
<th>Incompatible features</th> | ||
</tr> | ||
</thead> | ||
<tbody align="center"> | ||
<tr> | ||
<td rowspan=4>v0.9.0</td> | ||
<td>DataFrame with Grouped Map UDF <a href="https://github.com/dotnet/spark/pull/277">(#277)</a></td> | ||
</tr> | ||
<tr> | ||
<td>DataFrame with Vector UDF <a href="https://github.com/dotnet/spark/pull/277">(#277)</a></td> | ||
</tr> | ||
<tr> | ||
<td>Support for Broadcast Variables <a href="https://github.com/dotnet/spark/pull/414">(#414)</a></td> | ||
</tr> | ||
<tr> | ||
<td>Support for TimestampType <a href="https://github.com/dotnet/spark/pull/428">(#428)</a></td> | ||
</tr> | ||
<tr> | ||
<td rowspan=1>v0.12.0</td> | ||
imback82 marked this conversation as resolved.
Outdated
Show resolved
Hide resolved
|
||
<td>Support for dotnet-interactive <a href="https://github.com/dotnet/spark/pull/515">(#515)</a> <a href="https://github.com/dotnet/spark/pull/517">(#517)</a> <a href="https://github.com/dotnet/spark/pull/554">(#554)</a></td> | ||
</tr> | ||
</tbody> | ||
</table> | ||
|
||
#### Forward compatibility | ||
|
||
The following table describes the oldest version of .NET for Apache Spark release that the current worker is compatible with. | ||
|
||
<table> | ||
<thead> | ||
<tr> | ||
<th>Oldest compatible .NET for Apache Spark release version</th> | ||
</tr> | ||
</thead> | ||
<tbody align="center"> | ||
<tr> | ||
<td>v0.9.0</td> | ||
</tr> | ||
</tbody> | ||
</table> | ||
|
||
### Supported Spark Versions | ||
|
||
The following table outlines the supported Spark versions along with the microsoft-spark JAR to use with: | ||
|
||
<table> | ||
<thead> | ||
<tr> | ||
<th>Spark Version</th> | ||
<th>microsoft-spark JAR</th> | ||
</tr> | ||
</thead> | ||
<tbody align="center"> | ||
<tr> | ||
<td>2.3.*</td> | ||
<td>microsoft-spark-2.3.x-0.12.0.jar</td> | ||
</tr> | ||
<tr> | ||
<td>2.4.0</td> | ||
<td rowspan=6>microsoft-spark-2.4.x-0.12.0.jar</td> | ||
</tr> | ||
<tr> | ||
<td>2.4.1</td> | ||
</tr> | ||
<tr> | ||
<td>2.4.3</td> | ||
</tr> | ||
<tr> | ||
<td>2.4.4</td> | ||
</tr> | ||
<tr> | ||
<td>2.4.5</td> | ||
</tr> | ||
<tr> | ||
<td>2.4.6</td> | ||
</tr> | ||
<tr> | ||
<td>2.4.2</td> | ||
<td><a href="https://github.com/dotnet/spark/issues/60">Not supported</a></td> | ||
</tr> | ||
</tbody> | ||
</table> |
Uh oh!
There was an error while loading. Please reload this page.