Skip to content

[SPARK-45497][FOLLOWUP] Simplify symbolic link creation of spark-examples.jar#73

Merged
yaooqinn merged 2 commits intoapache:masterfrom
yaooqinn:SPARK-45497
Oct 8, 2024
Merged

[SPARK-45497][FOLLOWUP] Simplify symbolic link creation of spark-examples.jar#73
yaooqinn merged 2 commits intoapache:masterfrom
yaooqinn:SPARK-45497

Conversation

@yaooqinn
Copy link
Member

@yaooqinn yaooqinn commented Oct 8, 2024

What changes were proposed in this pull request?

Address comments docker-library/official-images#17622 (comment) from docker official owners

Why are the changes needed?

Use less fiddly subshell layers in between where things could unintentionally go wrong

Does this PR introduce any user-facing change?

no

How was this patch tested?

docker run -it --rm scala2.13-java17-ubuntu ls -al /opt/spark/examples/jars  | tail -n6
drwxr-xr-x 4 spark spark    4096 Sep 16 04:02 ..
-rw-r--r-- 1 spark spark  232248 Sep 16 04:02 jackson-core-asl-1.9.13.jar
-rw-r--r-- 1 spark spark  780664 Sep 16 04:02 jackson-mapper-asl-1.9.13.jar
-rw-r--r-- 1 spark spark   80424 Sep 16 04:02 scopt_2.13-3.7.1.jar
-rw-r--r-- 1 spark spark 1591043 Sep 16 04:02 spark-examples_2.13-4.0.0-preview2.jar
lrwxrwxrwx 1 root  root       38 Oct  8 05:41 spark-examples.jar -> spark-examples_2.13-4.0.0-preview2.jar

@yaooqinn
Copy link
Member Author

yaooqinn commented Oct 8, 2024

cc @dongjoon-hyun @cloud-fan

@yaooqinn yaooqinn merged commit 059a281 into apache:master Oct 8, 2024
@yaooqinn yaooqinn deleted the SPARK-45497 branch October 8, 2024 09:12
@yaooqinn
Copy link
Member Author

yaooqinn commented Oct 8, 2024

Thanks @HyukjinKwon, Merged to master

@dongjoon-hyun
Copy link
Member

Thank you, @HyukjinKwon and @yaooqinn .

dongjoon-hyun added a commit to apache/spark that referenced this pull request Oct 31, 2024
….jar`

### What changes were proposed in this pull request?

This PR aims to simplify symbolic link creation of `spark-examples.jar` according to the downstream `docker-library` and `spark-docker` repository change.

### Why are the changes needed?

- `docker-library`
  - docker-library/official-images#17622 (comment)

- `spark-docker`
  - apache/spark-docker#73
  - apache/spark-docker#74
  - apache/spark-docker#76

### Does this PR introduce _any_ user-facing change?

No behavior change.

### How was this patch tested?

Pass the CIs.

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes #48723 from dongjoon-hyun/SPARK-50192.

Authored-by: Dongjoon Hyun <dongjoon@apache.org>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants