Skip to content

Conversation

@dongjoon-hyun
Copy link
Member

@dongjoon-hyun dongjoon-hyun commented Sep 20, 2019

What changes were proposed in this pull request?

This PR aims to extend the existing benchmarks to save JDK9+ result separately.
All core module benchmark test results are added. I'll run the other test suites in another PR.
After regenerating all results, we will check JDK11 performance regressions.

Why are the changes needed?

From Apache Spark 3.0, we support both JDK8 and JDK11. We need to have a way to find the performance regression.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Manually run the benchmark.

@dongjoon-hyun dongjoon-hyun changed the title [SPARK-29192][TESTS] Extend BenchmarkBase to write JDK9+ results separately [WIP][SPARK-29192][TESTS] Extend BenchmarkBase to write JDK9+ results separately Sep 20, 2019
@dongjoon-hyun
Copy link
Member Author

cc, @srowen and @wangyum .

@dongjoon-hyun
Copy link
Member Author

Thank you for review and approval. I'll proceed in this way!

@dongjoon-hyun dongjoon-hyun changed the title [WIP][SPARK-29192][TESTS] Extend BenchmarkBase to write JDK9+ results separately [SPARK-29192][TESTS] Extend BenchmarkBase to write JDK9+ results separately Sep 20, 2019
@SparkQA
Copy link

SparkQA commented Sep 20, 2019

Test build #111090 has finished for PR 25873 at commit 941fcb7.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Sep 21, 2019

Test build #111094 has finished for PR 25873 at commit c4f8c2a.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@dongjoon-hyun
Copy link
Member Author

Thank you for review, @srowen . For the other module, I'll proceed one by one. Some test suite seems to change the number of iterations because it requires too much time.

Merged to master.

@dongjoon-hyun dongjoon-hyun deleted the SPARK-JDK11-PERF branch November 23, 2019 22:53
@dongjoon-hyun dongjoon-hyun restored the SPARK-JDK11-PERF branch November 23, 2019 22:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants