Skip to content

Commit 6cdd969

Browse files
Remove Scala Docs Page, keep backup (#155)
* Remove Scala Docs Page, keep backup --------- Co-authored-by: Mufaddal Rohawala <[email protected]>
1 parent e27ccff commit 6cdd969

File tree

5 files changed

+18
-18
lines changed

5 files changed

+18
-18
lines changed

buildspec-release.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -32,7 +32,7 @@ phases:
3232
- tox -e flake8,twine,sphinx
3333

3434
# pyspark unit tests (no coverage)
35-
- tox -e py37 -- tests/
35+
- tox -e py38 -- tests/
3636

3737
# todo consider adding subset of integration tests
3838

buildspec.yml

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -41,7 +41,7 @@ phases:
4141
# pyspark linters and unit tests
4242
- cd $CODEBUILD_SRC_DIR/sagemaker-pyspark-sdk
4343
- tox -e flake8,twine,sphinx
44-
- tox -e py37,stats -- tests/
44+
- tox -e py38,stats -- tests/
4545

4646
# spark integration tests
4747
- cd $CODEBUILD_SRC_DIR/integration-tests/sagemaker-spark-sdk
@@ -51,6 +51,6 @@ phases:
5151

5252
# pyspark integration tests
5353
- cd $CODEBUILD_SRC_DIR/sagemaker-pyspark-sdk
54-
- IGNORE_COVERAGE=- tox -e py37 -- $CODEBUILD_SRC_DIR/integration-tests/sagemaker-pyspark-sdk/tests/ -n 10 --boxed --reruns 2
55-
# - test_cmd="IGNORE_COVERAGE=- tox -e py37 -- $CODEBUILD_SRC_DIR/integration-tests/sagemaker-pyspark-sdk/tests/ -n 10 --boxed --reruns 2"
54+
- IGNORE_COVERAGE=- tox -e py38 -- $CODEBUILD_SRC_DIR/integration-tests/sagemaker-pyspark-sdk/tests/ -n 10 --boxed --reruns 2
55+
# - test_cmd="IGNORE_COVERAGE=- tox -e py38 -- $CODEBUILD_SRC_DIR/integration-tests/sagemaker-pyspark-sdk/tests/ -n 10 --boxed --reruns 2"
5656
# - execute-command-if-has-matching-changes "$test_cmd" "src/" "tests/" "setup.*" "requirements.txt" "tox.ini" "buildspec.yml"
File renamed without changes.

sagemaker-pyspark-sdk/src/sagemaker_pyspark/algorithms/PCASageMakerEstimator.py

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -33,10 +33,10 @@ class PCASageMakerEstimator(SageMakerEstimatorBase):
3333
dictionary with entries in trainingSparkDataFormatOptions with key "labelColumnName" or
3434
"featuresColumnName", with values corresponding to the desired label and features columns.
3535
36-
PCASageMakerEstimator uses
37-
:class:`~sagemaker_pyspark.transformation.serializers.ProtobufRequestRowSerializer` to serialize
38-
Rows into RecordIO-encoded Amazon Record protobuf messages for inference, by default selecting
39-
the column named "features" expected to contain a Vector of Doubles.
36+
:class:`~sagemaker_pyspark.transformation.serializers.ProtobufRequestRowSerializer` is used
37+
by PCASageMakerEstimator to serialize Rows into RecordIO-encoded Amazon Record protobuf
38+
messages for inference, by default selecting the column named "features" expected to contain
39+
a Vector of Doubles.
4040
4141
Inferences made against an Endpoint hosting a PCA model contain a "projection" field appended
4242
to the input DataFrame as a Dense Vector of Doubles.

sagemaker-pyspark-sdk/tox.ini

Lines changed: 10 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -1,14 +1,14 @@
11
[tox]
2-
envlist = flake8,twine,sphinx,py37,stats
2+
envlist = flake8,twine,sphinx,py38,stats
33
skip_missing_interpreters = False
44

55
[testenv]
66
deps =
7-
coverage == 4.4
8-
pytest
9-
pytest-cov
10-
pytest-rerunfailures
11-
pytest-xdist
7+
coverage>=5.2, <6.2
8+
pytest==6.2.5
9+
pytest-cov==3.0.0
10+
pytest-rerunfailures==10.2
11+
pytest-xdist==2.4.0
1212

1313
LANG=en_US.UTF-8
1414
LANGUAGE=en_US:en
@@ -28,8 +28,8 @@ passenv =
2828
[testenv:sphinx]
2929
basepython=python3
3030
deps =
31-
sphinx
32-
sphinx_rtd_theme
31+
sphinx==5.1.1
32+
sphinx-rtd-theme==0.5.0
3333

3434
commands = sphinx-build -b html docs html
3535

@@ -44,8 +44,8 @@ commands =
4444
[testenv:flake8]
4545
basepython=python3
4646
deps =
47-
flake8
48-
flake8_formatter_abspath
47+
flake8==4.0.1
48+
flake8_formatter_abspath==1.0.1
4949

5050
skip_install = true
5151
commands=flake8 src/sagemaker_pyspark/ tests/ setup.py

0 commit comments

Comments
 (0)