[SPARK-34385][SQL] Unwrap SparkUpgradeException in v2 Parquet datasource

[MaxGekk]

What changes were proposed in this pull request?

Unwrap SparkUpgradeException from ParquetDecodingException in v2 FilePartitionReader in the same way as v1 implementation does:

spark/sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/FileScanRDD.scala

Lines 180 to 183 in 3a299aa

	case e: ParquetDecodingException =>
	if (e.getCause.isInstanceOf[SparkUpgradeException]) {
	throw e.getCause
	} else if (e.getMessage.contains("Can not read value at")) {

Why are the changes needed?

1. To be compatible with v1 implementation of the Parquet datasource.
2. To improve UX with Spark SQL by making SparkUpgradeException more visible.

Does this PR introduce any user-facing change?

Yes, it can.

How was this patch tested?

By running the affected test suites:

$ build/sbt "sql/test:testOnly *ParquetRebaseDatetimeV1Suite"
$ build/sbt "sql/test:testOnly *ParquetRebaseDatetimeV2Suite"

[SparkQA]

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39538/

[SparkQA]

Kubernetes integration test status success
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39538/

[Archish27]

If this is user-facing is it possible that it returns null? If it returns null message won't be helpful.

[MaxGekk]

In practice, this never happens since ParquetDecodingException always wraps an exception there https://github.com/apache/parquet-mr/blob/ee30b13bb5c3f6848c76641d3b93c9858e6746cb/parquet-hadoop/src/main/java/org/apache/parquet/hadoop/InternalParquetRecordReader.java#L253-L255

[SparkQA]

Test build #134955 has finished for PR 31497 at commit 09d454a.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[Archish27]

LGTM! 🚀

[dongjoon-hyun]

+1, LGTM. Thank you, @MaxGekk and all.
Merged to master.