Skip to content

Conversation

@dongjoon-hyun
Copy link
Member

@dongjoon-hyun dongjoon-hyun commented Nov 8, 2018

What changes were proposed in this pull request?

This PR fixes the Scala-2.12 build.

How was this patch tested?

Manual build with Scala-2.12 profile.

@dongjoon-hyun
Copy link
Member Author

@dbtsai . The PR is ready. Could you review this?

@dbtsai
Copy link
Member

dbtsai commented Nov 8, 2018

LGTM. Thanks.

@dbtsai
Copy link
Member

dbtsai commented Nov 8, 2018

Merged into master as the compilation finished. Thanks!

@dongjoon-hyun
Copy link
Member Author

Thank you, @dbtsai !

@asfgit asfgit closed this in d68f3a7 Nov 8, 2018
@dongjoon-hyun dongjoon-hyun deleted the SPARK-25676-2.12 branch November 8, 2018 06:01
@SparkQA
Copy link

SparkQA commented Nov 8, 2018

Test build #98578 has finished for PR 22970 at commit 770cc33.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@dongjoon-hyun
Copy link
Member Author

The failures are irrelevant to this PR because this PR only updates benchmark code.

benchmark.addCase(s"split threshold $n", numIters = 5) { iter =>
withSQLConf(SQLConf.CODEGEN_METHOD_SPLIT_THRESHOLD.key -> n) {
df.selectExpr(columns: _*).foreach(identity(_))
df.selectExpr(columns: _*).foreach((x => x): Row => Unit)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

shall we use foreach(_ => ())?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sure. I'll try to make another follow-ups with the benchmark result.

asfgit pushed a commit that referenced this pull request Nov 8, 2018
## What changes were proposed in this pull request?

#22970 fixed Scala 2.12 build error, and this PR updates the function according to the review comments.

## How was this patch tested?

This is also manually tested with Scala 2.12 build.

Closes #22978 from dongjoon-hyun/SPARK-25676-3.

Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Wenchen Fan <[email protected]>
jackylee-ch pushed a commit to jackylee-ch/spark that referenced this pull request Feb 18, 2019
## What changes were proposed in this pull request?

This PR fixes the Scala-2.12 build.

## How was this patch tested?

Manual build with Scala-2.12 profile.

Closes apache#22970 from dongjoon-hyun/SPARK-25676-2.12.

Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: DB Tsai <[email protected]>
jackylee-ch pushed a commit to jackylee-ch/spark that referenced this pull request Feb 18, 2019
## What changes were proposed in this pull request?

apache#22970 fixed Scala 2.12 build error, and this PR updates the function according to the review comments.

## How was this patch tested?

This is also manually tested with Scala 2.12 build.

Closes apache#22978 from dongjoon-hyun/SPARK-25676-3.

Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Wenchen Fan <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants