Skip to content

Conversation

@MaxGekk
Copy link
Member

@MaxGekk MaxGekk commented Sep 14, 2022

What changes were proposed in this pull request?

In the PR, I propose to sort error message parameters in the MINIMAL and STANDARD formats (JSON formats) by parameter names.

Why are the changes needed?

To make the output in JSON format stable.

Does this PR introduce any user-facing change?

Yes.

How was this patch tested?

By running the modified test suites:

$ build/sbt "sql/testOnly org.apache.spark.sql.SQLQueryTestSuite"

@MaxGekk MaxGekk changed the title [WIP][SPARK-40420][SQL] Sort error message parameters by names in the JSON formats [SPARK-40420][SQL] Sort error message parameters by names in the JSON formats Sep 14, 2022
@MaxGekk MaxGekk marked this pull request as ready for review September 14, 2022 08:14
@MaxGekk
Copy link
Member Author

MaxGekk commented Sep 14, 2022

@cloud-fan @gengliangwang @srielau @anchovYu @HyukjinKwon Could you review this PR, please. I have faced to an issue while slightly changing the implementation in #37871 - the output in the JSON formats is not stable and depends on Map's impls (actually Scala's map cannot guarantee the order obviously).

@MaxGekk
Copy link
Member Author

MaxGekk commented Sep 14, 2022

The failure Run / Scala 2.13 build with SBT is not related to the PR but I will re-trigger it just in case.

@MaxGekk
Copy link
Member Author

MaxGekk commented Sep 14, 2022

Run / Scala 2.13 build with SBT passed successfully. Merging to master. Thank you, @cloud-fan for review.

@MaxGekk MaxGekk closed this in 801faba Sep 14, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants