-
Notifications
You must be signed in to change notification settings - Fork 29k
[SPARK-44254][SQL] Move QueryExecutionErrors that used by DataType to sql/api as DataTypeErrors #41794
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
c3c39c1 to
1d9c33c
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Do other similar items need to be moved? eg:
QueryExecutionErrors.unscaledValueTooLargeForPrecisionError(this, precision, scale)
It seems that it is only called in DataType.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
For those we haven't moved, they are using SQLConf inside and we are still discussing how to better deal withSQLConf now.
sql/api/pom.xml
Outdated
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Which one requires this?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
def outOfDecimalTypeRangeError(str: UTF8String): SparkArithmeticException
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
UTF8String stays into spark-unsafe.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
DataTypeErrors?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
done
fa4f479 to
208e5c6
Compare
|
@amaliujia Could you adjust PR title and description according to your recent commit, please. |
|
@MaxGekk tried to update title and description. |
|
+1, LGTM. Merging to master. |
What changes were proposed in this pull request?
Moving some QueryExecutionErrors that are used by data types to
sql/apiand name those as DataType erros so that DataType can use those if DataType only stay insql/apimodule.Why are the changes needed?
Towards a simpler DataType interface.
Does this PR introduce any user-facing change?
No
How was this patch tested?
Existing test