Skip to content

Conversation

@dongjoon-hyun
Copy link
Member

@dongjoon-hyun dongjoon-hyun commented Dec 12, 2022

What changes were proposed in this pull request?

This PR is a follow-up to fix Scala 2.13 test failure by using toAttributeMap before comparion.

Why are the changes needed?

To recover Scala 2.13 tests.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Pass the CIs and manually run Scala 2.13.

$ dev/change-scala-version.sh 2.13
$ build/sbt -Pscala-2.13 "sql/testOnly *.DataSourceV2SQLSuiteV1Filter -- -z SPARK-41378"
...
[info] DataSourceV2SQLSuiteV1Filter:
[info] - SPARK-41378: test column stats (3 seconds, 312 milliseconds)
[info] Run completed in 11 seconds, 159 milliseconds.
[info] Total number of tests run: 1
[info] Suites: completed 1, aborted 0
[info] Tests: succeeded 1, failed 0, canceled 0, ignored 0, pending 0
[info] All tests passed.

@dongjoon-hyun
Copy link
Member Author

cc @huaxingao and @HyukjinKwon

@dongjoon-hyun
Copy link
Member Author

Thank you, @huaxingao .
I verified this test PR on both Scala 2.12 and 2.13. I'll merge this to recover Scala 2.13 scheduled CI.

@dongjoon-hyun dongjoon-hyun deleted the SPARK-41378 branch December 12, 2022 19:32
@HyukjinKwon
Copy link
Member

Thx!

@cloud-fan
Copy link
Contributor

thanks for the quick fix!

@LuciferYang
Copy link
Contributor

Thanks @dongjoon-hyun

beliefer pushed a commit to beliefer/spark that referenced this pull request Dec 18, 2022
### What changes were proposed in this pull request?

This PR is a follow-up to fix Scala 2.13 test failure by using `toAttributeMap` before comparion.

### Why are the changes needed?

To recover Scala 2.13 tests.

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Pass the CIs and manually run Scala 2.13.
```
$ dev/change-scala-version.sh 2.13
$ build/sbt -Pscala-2.13 "sql/testOnly *.DataSourceV2SQLSuiteV1Filter -- -z SPARK-41378"
...
[info] DataSourceV2SQLSuiteV1Filter:
[info] - SPARK-41378: test column stats (3 seconds, 312 milliseconds)
[info] Run completed in 11 seconds, 159 milliseconds.
[info] Total number of tests run: 1
[info] Suites: completed 1, aborted 0
[info] Tests: succeeded 1, failed 0, canceled 0, ignored 0, pending 0
[info] All tests passed.
```

Closes apache#39038 from dongjoon-hyun/SPARK-41378.

Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants