Skip to content

Conversation

@viirya
Copy link
Member

@viirya viirya commented Apr 26, 2021

What changes were proposed in this pull request?

This patch moves DS v2 custom metric classes to org.apache.spark.sql.connector.metric package. Moving CustomAvgMetric and CustomSumMetric to above package and make them as public java abstract class too.

Why are the changes needed?

CustomAvgMetric and CustomSumMetric should be public APIs for developers to extend. As there are a few metric classes, we should put them together in one package.

Does this PR introduce any user-facing change?

No, dev only and they are not released yet.

How was this patch tested?

Unit tests.

* Returns the name of custom metric.
*/
String name();
/**
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

indentation was wrong. Fixed them together.

@viirya
Copy link
Member Author

viirya commented Apr 26, 2021

cc @cloud-fan

@SparkQA
Copy link

SparkQA commented Apr 26, 2021

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42466/

@SparkQA
Copy link

SparkQA commented Apr 26, 2021

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/42466/

@SparkQA
Copy link

SparkQA commented Apr 26, 2021

Test build #137944 has finished for PR 32348 at commit 7d5c2cd.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):
  • public abstract class CustomAvgMetric implements CustomMetric
  • public abstract class CustomSumMetric implements CustomMetric

Copy link
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, LGTM. Thank you, @viirya and @cloud-fan .
Merged to master.

@viirya
Copy link
Member Author

viirya commented Apr 26, 2021

Thank you @dongjoon-hyun and @cloud-fan

@viirya viirya deleted the move-custom-metric-classes branch December 27, 2023 18:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants