Skip to content

Commit 07a276e

Browse files
committed
[SPARK-53724] Update Examples and documentations to use 4.0.1
### What changes were proposed in this pull request? This PR aims to update `Examples` and documentations to use `4.0.1`. ### Why are the changes needed? Apache Spark community highly recommends to use `4.0.1` for all Spark 4.0 users. ### Does this PR introduce _any_ user-facing change? No behavior change. ### How was this patch tested? Pass the CIs and manual review. ### Was this patch authored or co-authored using generative AI tooling? No. Closes #245 from dongjoon-hyun/SPARK-53724. Authored-by: Dongjoon Hyun <[email protected]> Signed-off-by: Dongjoon Hyun <[email protected]>
1 parent e02cfb8 commit 07a276e

File tree

7 files changed

+18
-18
lines changed

7 files changed

+18
-18
lines changed

Examples/app/README.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@ This is an example Swift application to show how to use Apache Spark Connect Swi
77
Prepare `Spark Connect Server` via running Docker image.
88

99
```bash
10-
docker run --rm -p 15002:15002 apache/spark:4.0.0 bash -c "/opt/spark/sbin/start-connect-server.sh --wait"
10+
docker run --rm -p 15002:15002 apache/spark:4.0.1 bash -c "/opt/spark/sbin/start-connect-server.sh --wait"
1111
```
1212

1313
Build an application Docker image.
@@ -23,7 +23,7 @@ Run `app` docker image.
2323

2424
```bash
2525
$ docker run --rm -e SPARK_REMOTE=sc://host.docker.internal:15002 apache/spark-connect-swift:app
26-
Connected to Apache Spark 4.0.0 Server
26+
Connected to Apache Spark 4.0.1 Server
2727
EXECUTE: DROP TABLE IF EXISTS t
2828
EXECUTE: CREATE TABLE IF NOT EXISTS t(a INT) USING ORC
2929
EXECUTE: INSERT INTO t VALUES (1), (2), (3)
@@ -52,7 +52,7 @@ Run from source code.
5252
```bash
5353
$ swift run
5454
...
55-
Connected to Apache Spark 4.0.0 Server
55+
Connected to Apache Spark 4.0.1 Server
5656
EXECUTE: DROP TABLE IF EXISTS t
5757
EXECUTE: CREATE TABLE IF NOT EXISTS t(a INT) USING ORC
5858
EXECUTE: INSERT INTO t VALUES (1), (2), (3)

Examples/pi/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@ This is an example Swift application to show how to use Apache Spark Connect Swi
77
Prepare `Spark Connect Server` via running Docker image.
88

99
```bash
10-
docker run --rm -p 15002:15002 apache/spark:4.0.0 bash -c "/opt/spark/sbin/start-connect-server.sh --wait"
10+
docker run --rm -p 15002:15002 apache/spark:4.0.1 bash -c "/opt/spark/sbin/start-connect-server.sh --wait"
1111
```
1212

1313
Build an application Docker image.

Examples/spark-sql/README.md

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@ This is an example Swift application to show how to develop a Spark SQL REPL(Rea
77
Prepare `Spark Connect Server` via running Docker image.
88

99
```bash
10-
docker run -it --rm -p 15002:15002 apache/spark:4.0.0 bash -c "/opt/spark/sbin/start-connect-server.sh --wait"
10+
docker run -it --rm -p 15002:15002 apache/spark:4.0.1 bash -c "/opt/spark/sbin/start-connect-server.sh --wait"
1111
```
1212

1313
Build an application Docker image.
@@ -23,7 +23,7 @@ Run `spark-sql` docker image.
2323

2424
```bash
2525
$ docker run -it --rm -e SPARK_REMOTE=sc://host.docker.internal:15002 apache/spark-connect-swift:spark-sql
26-
Connected to Apache Spark 4.0.0 Server
26+
Connected to Apache Spark 4.0.1 Server
2727
spark-sql (default)> SHOW DATABASES;
2828
+---------+
2929
|namespace|
@@ -85,13 +85,13 @@ spark-sql (default)> DROP DATABASE db1 CASCADE;
8585
spark-sql (default)> exit;
8686
```
8787

88-
Apache Spark 4 supports [SQL Pipe Syntax](https://spark.apache.org/docs/4.0.0/sql-pipe-syntax.html).
88+
Apache Spark 4 supports [SQL Pipe Syntax](https://spark.apache.org/docs/4.0.1/sql-pipe-syntax.html).
8989

9090
```bash
9191
$ swift run
9292
...
9393
Build of product 'SparkSQLRepl' complete! (2.33s)
94-
Connected to Apache Spark 4.0.0 Server
94+
Connected to Apache Spark 4.0.1 Server
9595
spark-sql (default)>
9696
FROM ORC.`/opt/spark/examples/src/main/resources/users.orc`
9797
|> AGGREGATE COUNT(*) cnt
@@ -113,6 +113,6 @@ Run from source code.
113113
```bash
114114
$ swift run
115115
...
116-
Connected to Apache Spark 4.0.0 Server
116+
Connected to Apache Spark 4.0.1 Server
117117
spark-sql (default)>
118118
```

Examples/stream/README.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@ This is an example Swift stream processing application to show how to count word
55
## Run `Spark Connect Server`
66

77
```bash
8-
docker run --rm -p 15002:15002 apache/spark:4.0.0 bash -c "/opt/spark/sbin/start-connect-server.sh --wait -c spark.log.level=ERROR"
8+
docker run --rm -p 15002:15002 apache/spark:4.0.1 bash -c "/opt/spark/sbin/start-connect-server.sh --wait -c spark.log.level=ERROR"
99
```
1010

1111
## Run `Netcat` as a streaming input server
@@ -81,5 +81,5 @@ Batch: 2
8181
```bash
8282
$ swift run
8383
...
84-
Connected to Apache Spark 4.0.0 Server
84+
Connected to Apache Spark 4.0.1 Server
8585
```

Examples/web/README.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -90,7 +90,7 @@ index 2edcc8f..dd918a9 100644
9090
Prepare `Spark Connect Server` via running Docker image.
9191
9292
```bash
93-
docker run --rm -p 15002:15002 apache/spark:4.0.0 bash -c "/opt/spark/sbin/start-connect-server.sh --wait"
93+
docker run --rm -p 15002:15002 apache/spark:4.0.1 bash -c "/opt/spark/sbin/start-connect-server.sh --wait"
9494
```
9595
9696
Build an application Docker image.
@@ -116,7 +116,7 @@ $ curl http://127.0.0.1:8080/
116116
Welcome to the Swift world. Say hello!%
117117

118118
$ curl http://127.0.0.1:8080/hello
119-
Hi, this is powered by the Apache Spark 4.0.0.%
119+
Hi, this is powered by the Apache Spark 4.0.1.%
120120
```
121121
122122
Run from source code.

README.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -16,7 +16,7 @@ So far, this library project is tracking the upstream changes of [Apache Arrow](
1616

1717
## Requirement
1818

19-
- [Apache Spark 4.0.0 (May 2025)](https://github.com/apache/spark/releases/tag/v4.0.0)
19+
- [Apache Spark 4.0.1 (September 2025)](https://github.com/apache/spark/releases/tag/v4.0.1)
2020
- [Swift 6.0/6.1/6.2 (September 2025)](https://swift.org)
2121
- [gRPC Swift 2.1 (July 2025)](https://github.com/grpc/grpc-swift-2/releases/tag/2.1.0)
2222
- [gRPC Swift Protobuf 2.1 (August 2025)](https://github.com/grpc/grpc-swift-protobuf/releases/tag/2.1.1)
@@ -91,7 +91,7 @@ Run your Swift application.
9191
```bash
9292
$ swift run
9393
...
94-
Connected to Apache Spark 4.0.0 Server
94+
Connected to Apache Spark 4.0.1 Server
9595
EXECUTE: DROP TABLE IF EXISTS t
9696
EXECUTE: CREATE TABLE IF NOT EXISTS t(a INT)
9797
EXECUTE: INSERT INTO t VALUES (1), (2), (3)

Sources/SparkConnect/Documentation.docc/Examples.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@ This document provides an overview of the example applications inside [Examples]
77
Start a Spark Connect Server:
88

99
```bash
10-
docker run -it --rm -p 15002:15002 apache/spark:4.0.0 bash -c "/opt/spark/sbin/start-connect-server.sh --wait -c spark.log.level=ERROR"
10+
docker run -it --rm -p 15002:15002 apache/spark:4.0.1 bash -c "/opt/spark/sbin/start-connect-server.sh --wait -c spark.log.level=ERROR"
1111
```
1212

1313
## Basic Application Example
@@ -154,7 +154,7 @@ Welcome to the Swift world. Say hello!%
154154

155155
# Spark-powered endpoint
156156
curl http://127.0.0.1:8080/hello
157-
Hi, this is powered by the Apache Spark 4.0.0.%
157+
Hi, this is powered by the Apache Spark 4.0.1.%
158158
```
159159

160160
## Development Environment
@@ -166,4 +166,4 @@ All examples include:
166166
- A README.md with detailed instructions
167167
- Source code in the Sources directory
168168

169-
These examples are designed to be used with Apache Spark 4.0.0 or newer, using the Spark Connect protocol for client-server interaction.
169+
These examples are designed to be used with Apache Spark 4.0 or newer, using the Spark Connect protocol for client-server interaction.

0 commit comments

Comments
 (0)