Skip to content

Conversation

@dongjoon-hyun
Copy link
Member

@dongjoon-hyun dongjoon-hyun commented Mar 21, 2021

What changes were proposed in this pull request?

Apache Spark 3.1.x doesn't support Scala 2.13.

Why are the changes needed?

Currently, Scala 2.13 Build GitHub Action job is broken.
We had better focus on Apache Spark 3.2.0 because branch-3.1 has old SBT/Scala versions and we don't support Scala 2.13 officially.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

This is a removal from GitHub Action jobs.

BEFORE
Screen Shot 2021-03-21 at 2 29 40 PM

AFTER
Screen Shot 2021-03-21 at 2 29 10 PM

@dongjoon-hyun
Copy link
Member Author

dongjoon-hyun commented Mar 21, 2021

Could you review this, @HyukjinKwon , @srowen , @sarutak , @viirya , @attilapiros ?
We don't need to put our efforts on the recovery of unsupported feature (Scala 2.13 on Apache Spark 3.1). Also, this will save our testing infra resource from today and until the EOL of Apache Spark 3.1.x.

@dongjoon-hyun dongjoon-hyun removed the request for review from HyukjinKwon March 21, 2021 21:26
@dongjoon-hyun
Copy link
Member Author

Thank you, @srowen !

@dongjoon-hyun
Copy link
Member Author

dongjoon-hyun commented Mar 21, 2021

I verified that the newly triggered GitHub Action doesn't have Scala 2.13 build test.
Merged to branch-3.1 to recover it.

dongjoon-hyun added a commit that referenced this pull request Mar 21, 2021
…rom branch-3.1

### What changes were proposed in this pull request?

Apache Spark 3.1.x doesn't support Scala 2.13.

### Why are the changes needed?

Currently, Scala 2.13 Build GitHub Action job is broken.
We had better focus on Apache Spark 3.2.0 because branch-3.1 has old SBT/Scala versions and we don't support Scala 2.13 officially.

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

This is a removal from GitHub Action jobs.

**BEFORE**
<img width="530" alt="Screen Shot 2021-03-21 at 2 29 40 PM" src="https://user-images.githubusercontent.com/9700541/111921457-ec842780-8a51-11eb-80ff-f07f0f103db9.png">

**AFTER**
<img width="834" alt="Screen Shot 2021-03-21 at 2 29 10 PM" src="https://user-images.githubusercontent.com/9700541/111921464-f73ebc80-8a51-11eb-81f0-f6751db69911.png">

Closes #31915 from dongjoon-hyun/SPARK-34813.

Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
@dongjoon-hyun dongjoon-hyun deleted the SPARK-34813 branch March 21, 2021 21:32
Copy link
Member

@HyukjinKwon HyukjinKwon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@viirya
Copy link
Member

viirya commented Mar 22, 2021

lgtm

@dongjoon-hyun
Copy link
Member Author

Thank you, @HyukjinKwon and @viirya .

@sarutak
Copy link
Member

sarutak commented Mar 22, 2021

Late +1. Thanks you @dongjoon-hyun .

flyrain pushed a commit to flyrain/spark that referenced this pull request Sep 21, 2021
…rom branch-3.1

### What changes were proposed in this pull request?

Apache Spark 3.1.x doesn't support Scala 2.13.

### Why are the changes needed?

Currently, Scala 2.13 Build GitHub Action job is broken.
We had better focus on Apache Spark 3.2.0 because branch-3.1 has old SBT/Scala versions and we don't support Scala 2.13 officially.

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

This is a removal from GitHub Action jobs.

**BEFORE**
<img width="530" alt="Screen Shot 2021-03-21 at 2 29 40 PM" src="https://user-images.githubusercontent.com/9700541/111921457-ec842780-8a51-11eb-80ff-f07f0f103db9.png">

**AFTER**
<img width="834" alt="Screen Shot 2021-03-21 at 2 29 10 PM" src="https://user-images.githubusercontent.com/9700541/111921464-f73ebc80-8a51-11eb-81f0-f6751db69911.png">

Closes apache#31915 from dongjoon-hyun/SPARK-34813.

Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
(cherry picked from commit d1de69f)
Signed-off-by: Dongjoon Hyun <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants