Skip to content

[SPARK-46412][K8S][DOCS] Update Java and JDK info in K8S testing #44589

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
engrravijain wants to merge 2 commits into from
Closed

[SPARK-46412][K8S][DOCS] Update Java and JDK info in K8S testing #44589

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
f6e5290
SPARK-46412 update java and jdk info
engrravijain Jan 4, 2024
a48c379
SPARK-46412 Update the doc to speciy the image tag as required insted…
engrravijain Jan 4, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
11 changes: 6 additions & 5 deletions resource-managers/kubernetes/integration-tests/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,9 +13,10 @@ directory:

./dev/dev-run-integration-tests.sh

To run tests with Java 11 instead of Java 8, use `--java-image-tag` to specify the base image.
To run tests with a specific Java version instead of Java 21, use `--java-image-tag` to specify the
[base image](https://hub.docker.com/r/azul/zulu-openjdk/tags) accordingly.

./dev/dev-run-integration-tests.sh --java-image-tag 11-jre-slim
./dev/dev-run-integration-tests.sh --java-image-tag 17-jre

To run tests with a custom docker image, use `--docker-file` to specify the Dockerfile.
Note that if both `--docker-file` and `--java-image-tag` are used, `--docker-file` is preferred,
Expand Down Expand Up @@ -130,7 +131,7 @@ properties to Maven. For example:
mvn integration-test -am -pl :spark-kubernetes-integration-tests_2.13 \
-Pkubernetes -Pkubernetes-integration-tests \
-Phadoop-3 -Dhadoop.version=3.3.6 \
-Dspark.kubernetes.test.sparkTgz=spark-3.0.0-SNAPSHOT-bin-example.tgz \
-Dspark.kubernetes.test.sparkTgz=spark-4.0.0-SNAPSHOT-bin-example.tgz \
-Dspark.kubernetes.test.imageTag=sometag \
-Dspark.kubernetes.test.imageRepo=docker.io/somerepo \
-Dspark.kubernetes.test.namespace=spark-int-tests \
Expand Down Expand Up @@ -198,9 +199,9 @@ to the wrapper scripts and using the wrapper scripts will simply set these appro
<tr>
<td><code>spark.kubernetes.test.javaImageTag</code></td>
<td>
A specific OpenJDK base image tag to use, when set uses it instead of 8-jre-slim.
A specific OpenJDK base image tag to use, when set uses it instead of azul/zulu-openjdk.
</td>
<td><code>8-jre-slim</code></td>
<td><code>azul/zulu-openjdk</code></td>
Comment thread
engrravijain marked this conversation as resolved.
</tr>
<tr>
<td><code>spark.kubernetes.test.imageTagFile</code></td>
Expand Down