-
Notifications
You must be signed in to change notification settings - Fork 29k
[SPARK-15062] [SQL] fix list type infer serializer issue #12849
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
| } | ||
| } | ||
|
|
||
| test("SPARK-15062") { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
should document the test case more than just the issue number
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
is it possible to turn this into a unit test on scalareflection rather than an end-to-end test?
|
is this original issue that i used List instead of Seq? if so, is this even an issue at all? Should i simply have used Seq? |
|
Making the changes based on the comments. Will post it shortly. |
|
Test build #57559 has finished for PR 12849 at commit
|
|
Test build #57568 has finished for PR 12849 at commit
|
|
cc @marmbrus |
|
Thanks, merging to master and 2.0 |
## What changes were proposed in this pull request? Make serializer correctly inferred if the input type is `List[_]`, since `List[_]` is type of `Seq[_]`, before it was matched to different case (`case t if definedByConstructorParams(t)`). ## How was this patch tested? New test case was added. Author: bomeng <[email protected]> Closes #12849 from bomeng/SPARK-15062. (cherry picked from commit 0fd95be) Signed-off-by: Michael Armbrust <[email protected]>
What changes were proposed in this pull request?
Make serializer correctly inferred if the input type is
List[_], sinceList[_]is type ofSeq[_], before it was matched to different case (case t if definedByConstructorParams(t)).How was this patch tested?
New test case was added.