Skip to content

Conversation

@gengliangwang
Copy link
Member

What changes were proposed in this pull request?

Improve Avro unit test:

  1. use QueryTest/SharedSQLContext/SQLTestUtils, instead of the duplicated test utils.
  2. replace deprecated methods

This is a follow up PR for #21760, the PR passes pull request tests but failed in: https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Compile/job/spark-master-compile-maven-hadoop-2.6/7842/

This PR is to fix it.

How was this patch tested?

Unit test.
Compile with different commands:

./build/mvn --force -DzincPort=3643 -DskipTests -Phadoop-2.6 -Phive-thriftserver -Pkinesis-asl -Pspark-ganglia-lgpl -Pmesos -Pyarn  compile test-compile
./build/mvn --force -DzincPort=3643 -DskipTests -Phadoop-2.7 -Phive-thriftserver -Pkinesis-asl -Pspark-ganglia-lgpl -Pmesos -Pyarn  compile test-compile
./build/mvn --force -DzincPort=3643 -DskipTests -Phadoop-3.1 -Phive-thriftserver -Pkinesis-asl -Pspark-ganglia-lgpl -Pmesos -Pyarn  compile test-compile

@SparkQA
Copy link

SparkQA commented Jul 14, 2018

Test build #92999 has finished for PR 21768 at commit 4a7e60b.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@HyukjinKwon
Copy link
Member

@gengliangwang, mind if I ask to fix the PR title like Deduplicates codes and replace deprecated methods in Avro unit tests?

@gengliangwang gengliangwang changed the title [SPARK-24776][SQL]Improve Avro unit test [SPARK-24776][SQL]Avro unit test: Deduplicates codes and replace deprecated methods Jul 14, 2018
@gengliangwang gengliangwang changed the title [SPARK-24776][SQL]Avro unit test: Deduplicates codes and replace deprecated methods [SPARK-24776][SQL]Avro unit test: deduplicates code and replace deprecated methods Jul 14, 2018
@gengliangwang
Copy link
Member Author

@HyukjinKwon sure, thanks for the suggestion.

@gengliangwang gengliangwang changed the title [SPARK-24776][SQL]Avro unit test: deduplicates code and replace deprecated methods [SPARK-24776][SQL]Avro unit test: deduplicate code and replace deprecated methods Jul 14, 2018
Copy link
Member

@HyukjinKwon HyukjinKwon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Member

@gatorsmile gatorsmile left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Thanks! Merged to master.

@asfgit asfgit closed this in 3e7dc82 Jul 15, 2018
otterc pushed a commit to linkedin/spark that referenced this pull request Mar 22, 2023
…cated methods

Improve Avro unit test:
1. use QueryTest/SharedSQLContext/SQLTestUtils, instead of the duplicated test utils.
2. replace deprecated methods

This is a follow up PR for apache#21760, the PR passes pull request tests but failed in: https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Compile/job/spark-master-compile-maven-hadoop-2.6/7842/

This PR is to fix it.
Unit test.
Compile with different commands:

```
./build/mvn --force -DzincPort=3643 -DskipTests -Phadoop-2.6 -Phive-thriftserver -Pkinesis-asl -Pspark-ganglia-lgpl -Pmesos -Pyarn  compile test-compile
./build/mvn --force -DzincPort=3643 -DskipTests -Phadoop-2.7 -Phive-thriftserver -Pkinesis-asl -Pspark-ganglia-lgpl -Pmesos -Pyarn  compile test-compile
./build/mvn --force -DzincPort=3643 -DskipTests -Phadoop-3.1 -Phive-thriftserver -Pkinesis-asl -Pspark-ganglia-lgpl -Pmesos -Pyarn  compile test-compile

```

Author: Gengliang Wang <gengliang.wang@databricks.com>

Closes apache#21768 from gengliangwang/improve_avro_test.

(cherry picked from commit 3e7dc82)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants