Skip to content

Commit 79d1820

Browse files
committed
[SPARK-54042] Use 4.1.0-preview3 in integration-test-(token|mac-spark41)
### What changes were proposed in this pull request? This PR aims to use Apache Spark `4.1.0-preview3` in the following test pipelines. - `integration-test-token` - `integration-test-mac-spark41` ### Why are the changes needed? To update the test coverage with the latest Apache Spark 4.1.0-preview3. ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Pass the CIs. ### Was this patch authored or co-authored using generative AI tooling? No. Closes #251 from dongjoon-hyun/SPARK-54042. Authored-by: Dongjoon Hyun <[email protected]> Signed-off-by: Dongjoon Hyun <[email protected]>
1 parent 89b02b0 commit 79d1820

File tree

1 file changed

+6
-6
lines changed

1 file changed

+6
-6
lines changed

.github/workflows/build_and_test.yml

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -153,9 +153,9 @@ jobs:
153153
run: swift test --filter NOTHING -c release
154154
- name: Test
155155
run: |
156-
curl -LO https://www.apache.org/dyn/closer.lua/spark/spark-4.1.0-preview2/spark-4.1.0-preview2-bin-hadoop3.tgz?action=download
157-
tar xvfz spark-4.1.0-preview2-bin-hadoop3.tgz && rm spark-4.1.0-preview2-bin-hadoop3.tgz
158-
mv spark-4.1.0-preview2-bin-hadoop3 /tmp/spark
156+
curl -LO https://dist.apache.org/repos/dist/dev/spark/v4.1.0-preview3-rc1-bin/spark-4.1.0-preview3-bin-hadoop3.tgz
157+
tar xvfz spark-4.1.0-preview3-bin-hadoop3.tgz && rm spark-4.1.0-preview3-bin-hadoop3.tgz
158+
mv spark-4.1.0-preview3-bin-hadoop3 /tmp/spark
159159
cd /tmp/spark/sbin
160160
./start-connect-server.sh
161161
cd -
@@ -198,9 +198,9 @@ jobs:
198198
run: swift test --filter NOTHING -c release
199199
- name: Test
200200
run: |
201-
curl -LO https://www.apache.org/dyn/closer.lua/spark/spark-4.1.0-preview2/spark-4.1.0-preview2-bin-hadoop3.tgz?action=download
202-
tar xvfz spark-4.1.0-preview2-bin-hadoop3.tgz && rm spark-4.1.0-preview2-bin-hadoop3.tgz
203-
mv spark-4.1.0-preview2-bin-hadoop3 /tmp/spark
201+
curl -LO https://dist.apache.org/repos/dist/dev/spark/v4.1.0-preview3-rc1-bin/spark-4.1.0-preview3-bin-hadoop3.tgz
202+
tar xvfz spark-4.1.0-preview3-bin-hadoop3.tgz && rm spark-4.1.0-preview3-bin-hadoop3.tgz
203+
mv spark-4.1.0-preview3-bin-hadoop3 /tmp/spark
204204
cd /tmp/spark/sbin
205205
./start-connect-server.sh
206206
cd -

0 commit comments

Comments
 (0)