Skip to content

Conversation

@gengliangwang
Copy link
Member

@gengliangwang gengliangwang commented Oct 5, 2018

What changes were proposed in this pull request?

The total run time of HiveSparkSubmitSuite is about 10 minutes.
While the related code is stable, add tag ExtendedHiveTest for it.

How was this patch tested?

Unit test.

@dilipbiswal
Copy link
Contributor

@gengliangwang I have a question. What happens when we place this tag ? It is skipped on regular runs ?

Copy link
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, LGTM (pending Jenkins).

@dongjoon-hyun
Copy link
Member

cc @gatorsmile for final sign-off since this is a test coverage.

@dongjoon-hyun
Copy link
Member

dongjoon-hyun commented Oct 5, 2018

@dilipbiswal . It's not skipped in the regular Jenkins run until now. As you know, those test will be skipped when we give that explicitly. For example, -Dtest.exclude.tags=org.apache.spark.tags.ExtendedHiveTest.

@dilipbiswal
Copy link
Contributor

@dongjoon-hyun Ah.. got it.. thanks a lot.

@dongjoon-hyun
Copy link
Member

BTW, @gengliangwang . Please create a different JIRA issue for this. This doesn't resolve SPARK-25613 and SPARK-25614. If we close them with this, we will not improve those test cases eventually.

cc @gatorsmile

@SparkQA
Copy link

SparkQA commented Oct 5, 2018

Test build #96998 has finished for PR 22642 at commit a85a843.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@gengliangwang gengliangwang changed the title [SPARK-25613][SPARK-25614][TEST] Add tag ExtendedHiveTest for HiveSparkSubmitSuite [SPARK-25653][TEST] Add tag ExtendedHiveTest for HiveSparkSubmitSuite Oct 5, 2018
@gengliangwang
Copy link
Member Author

@dongjoon-hyun thanks, I have created new Jira ticket: https://issues.apache.org/jira/browse/SPARK-25653

@dongjoon-hyun
Copy link
Member

Thank you, @gengliangwang !

/**
* This suite tests spark-submit with applications using HiveContext.
*/
@ExtendedHiveTest
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

With this tag, the test suite will still run if we do a code change in sql/hive. Right? cc @cloud-fan @vanzin

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That was the original intent of the tag. I believe originally it ran whenever there was a change to any of the SQL code, but not sure if the module mappings have been updated in the meantime.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

@gatorsmile
Copy link
Member

LGTM

Thanks! Merged to master.

@asfgit asfgit closed this in bbd038d Oct 6, 2018
jackylee-ch pushed a commit to jackylee-ch/spark that referenced this pull request Feb 18, 2019
## What changes were proposed in this pull request?

The total run time of `HiveSparkSubmitSuite` is about 10 minutes.
While the related code is stable, add tag `ExtendedHiveTest` for it.
## How was this patch tested?

Unit test.

Closes apache#22642 from gengliangwang/addTagForHiveSparkSubmitSuite.

Authored-by: Gengliang Wang <[email protected]>
Signed-off-by: gatorsmile <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants