Skip to content

Commit bd5b401

Browse files
mhamilton723mhamilton723
authored
chore: bump synapseml to 1.0.7 (#2298)
1 parent 9905ae8 commit bd5b401

21 files changed

+125
-125
lines changed

‎README.md

+12-12
Original file line numberDiff line numberDiff line change
@@ -11,10 +11,10 @@ SynapseML requires Scala 2.12, Spark 3.4+, and Python 3.8+.
1111
| Topics | Links |
1212
| :------ | :------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ |
1313
| Build | [![Build Status](https://msdata.visualstudio.com/A365/_apis/build/status/microsoft.SynapseML?branchName=master)](https://msdata.visualstudio.com/A365/_build/latest?definitionId=17563&branchName=master) [![codecov](https://codecov.io/gh/Microsoft/SynapseML/branch/master/graph/badge.svg)](https://codecov.io/gh/Microsoft/SynapseML) [![Code style: black](https://img.shields.io/badge/code%20style-black-000000.svg)](https://github.com/psf/black) |
14-
| Version | [![Version](https://img.shields.io/badge/version-1.0.6-blue)](https://github.com/Microsoft/SynapseML/releases) [![Release Notes](https://img.shields.io/badge/release-notes-blue)](https://github.com/Microsoft/SynapseML/releases) [![Snapshot Version](https://mmlspark.blob.core.windows.net/icons/badges/master_version3.svg)](#sbt) |
15-
| Docs | [![Website](https://img.shields.io/badge/SynapseML-Website-blue)](https://aka.ms/spark) [![Scala Docs](https://img.shields.io/static/v1?label=api%20docs&message=scala&color=blue&logo=scala)](https://mmlspark.blob.core.windows.net/docs/1.0.6/scala/index.html#package) [![PySpark Docs](https://img.shields.io/static/v1?label=api%20docs&message=python&color=blue&logo=python)](https://mmlspark.blob.core.windows.net/docs/1.0.6/pyspark/index.html) [![Academic Paper](https://img.shields.io/badge/academic-paper-7fdcf7)](https://arxiv.org/abs/1810.08744) |
14+
| Version | [![Version](https://img.shields.io/badge/version-1.0.7-blue)](https://github.com/Microsoft/SynapseML/releases) [![Release Notes](https://img.shields.io/badge/release-notes-blue)](https://github.com/Microsoft/SynapseML/releases) [![Snapshot Version](https://mmlspark.blob.core.windows.net/icons/badges/master_version3.svg)](#sbt) |
15+
| Docs | [![Website](https://img.shields.io/badge/SynapseML-Website-blue)](https://aka.ms/spark) [![Scala Docs](https://img.shields.io/static/v1?label=api%20docs&message=scala&color=blue&logo=scala)](https://mmlspark.blob.core.windows.net/docs/1.0.7/scala/index.html#package) [![PySpark Docs](https://img.shields.io/static/v1?label=api%20docs&message=python&color=blue&logo=python)](https://mmlspark.blob.core.windows.net/docs/1.0.7/pyspark/index.html) [![Academic Paper](https://img.shields.io/badge/academic-paper-7fdcf7)](https://arxiv.org/abs/1810.08744) |
1616
| Support | [![Gitter](https://badges.gitter.im/Microsoft/MMLSpark.svg)](https://gitter.im/Microsoft/MMLSpark?utm_source=badge&utm_medium=badge&utm_campaign=pr-badge) [![Mail](https://img.shields.io/badge/mail-synapseml--support-brightgreen)](mailto:[email protected]) |
17-
| Binder | [![Binder](https://mybinder.org/badge_logo.svg)](https://mybinder.org/v2/gh/microsoft/SynapseML/v1.0.6?labpath=notebooks%2Ffeatures) |
17+
| Binder | [![Binder](https://mybinder.org/badge_logo.svg)](https://mybinder.org/v2/gh/microsoft/SynapseML/v1.0.7?labpath=notebooks%2Ffeatures) |
1818
| Usage | [![Downloads](https://static.pepy.tech/badge/synapseml)](https://pepy.tech/project/synapseml) |
1919
<!-- markdownlint-disable MD033 -->
2020
<details open>
@@ -119,7 +119,7 @@ In Azure Synapse notebooks please place the following in the first cell of your
119119
{
120120
"name": "synapseml",
121121
"conf": {
122-
"spark.jars.packages": "com.microsoft.azure:synapseml_2.12:1.0.6",
122+
"spark.jars.packages": "com.microsoft.azure:synapseml_2.12:1.0.7",
123123
"spark.jars.repositories": "https://mmlspark.azureedge.net/maven",
124124
"spark.jars.excludes": "org.scala-lang:scala-reflect,org.apache.spark:spark-tags_2.12,org.scalactic:scalactic_2.12,org.scalatest:scalatest_2.12,com.fasterxml.jackson.core:jackson-databind",
125125
"spark.yarn.user.classpath.first": "true",
@@ -155,15 +155,15 @@ cloud](http://community.cloud.databricks.com), create a new [library from Maven
155155
coordinates](https://docs.databricks.com/user-guide/libraries.html#libraries-from-maven-pypi-or-spark-packages)
156156
in your workspace.
157157

158-
For the coordinates use: `com.microsoft.azure:synapseml_2.12:1.0.6`
158+
For the coordinates use: `com.microsoft.azure:synapseml_2.12:1.0.7`
159159
with the resolver: `https://mmlspark.azureedge.net/maven`. Ensure this library is
160160
attached to your target cluster(s).
161161

162162
Finally, ensure that your Spark cluster has at least Spark 3.2 and Scala 2.12. If you encounter Netty dependency issues please use DBR 10.1.
163163

164164
You can use SynapseML in both your Scala and PySpark notebooks. To get started with our example notebooks import the following databricks archive:
165165

166-
`https://mmlspark.blob.core.windows.net/dbcs/SynapseMLExamplesv1.0.6.dbc`
166+
`https://mmlspark.blob.core.windows.net/dbcs/SynapseMLExamplesv1.0.7.dbc`
167167

168168
### Python Standalone
169169

@@ -174,7 +174,7 @@ the above example, or from python:
174174
```python
175175
import pyspark
176176
spark = pyspark.sql.SparkSession.builder.appName("MyApp") \
177-
.config("spark.jars.packages", "com.microsoft.azure:synapseml_2.12:1.0.6") \
177+
.config("spark.jars.packages", "com.microsoft.azure:synapseml_2.12:1.0.7") \
178178
.getOrCreate()
179179
import synapse.ml
180180
```
@@ -185,9 +185,9 @@ SynapseML can be conveniently installed on existing Spark clusters via the
185185
`--packages` option, examples:
186186

187187
```bash
188-
spark-shell --packages com.microsoft.azure:synapseml_2.12:1.0.6
189-
pyspark --packages com.microsoft.azure:synapseml_2.12:1.0.6
190-
spark-submit --packages com.microsoft.azure:synapseml_2.12:1.0.6 MyApp.jar
188+
spark-shell --packages com.microsoft.azure:synapseml_2.12:1.0.7
189+
pyspark --packages com.microsoft.azure:synapseml_2.12:1.0.7
190+
spark-submit --packages com.microsoft.azure:synapseml_2.12:1.0.7 MyApp.jar
191191
```
192192

193193
### SBT
@@ -196,7 +196,7 @@ If you are building a Spark application in Scala, add the following lines to
196196
your `build.sbt`:
197197

198198
```scala
199-
libraryDependencies += "com.microsoft.azure" % "synapseml_2.12" % "1.0.6"
199+
libraryDependencies += "com.microsoft.azure" % "synapseml_2.12" % "1.0.7"
200200
```
201201

202202
### Apache Livy and HDInsight
@@ -210,7 +210,7 @@ Excluding certain packages from the library may be necessary due to current issu
210210
{
211211
"name": "synapseml",
212212
"conf": {
213-
"spark.jars.packages": "com.microsoft.azure:synapseml_2.12:1.0.6",
213+
"spark.jars.packages": "com.microsoft.azure:synapseml_2.12:1.0.7",
214214
"spark.jars.excludes": "org.scala-lang:scala-reflect,org.apache.spark:spark-tags_2.12,org.scalactic:scalactic_2.12,org.scalatest:scalatest_2.12,com.fasterxml.jackson.core:jackson-databind"
215215
}
216216
}

‎core/src/main/scala/com/microsoft/azure/synapse/ml/core/env/PackageUtils.scala

+1-1
Original file line numberDiff line numberDiff line change
@@ -19,7 +19,7 @@ object PackageUtils {
1919
val PackageName = s"synapseml_$ScalaVersionSuffix"
2020
val PackageMavenCoordinate = s"$PackageGroup:$PackageName:${BuildInfo.version}"
2121
// Use a fixed version for local testing
22-
// val PackageMavenCoordinate = s"$PackageGroup:$PackageName:1.0.6"
22+
// val PackageMavenCoordinate = s"$PackageGroup:$PackageName:1.0.7"
2323

2424
private val AvroCoordinate = "org.apache.spark:spark-avro_2.12:3.4.1"
2525
val PackageRepository: String = SparkMLRepository

0 commit comments

Comments
 (0)