[SPARK-32986][SQL] Add bucketed scan info in query plan of data source v1

[c21]

What changes were proposed in this pull request?

As a followup from discussion in #29804 (comment) , currently the query plan for data source v1 scan operator - FileSourceScanExec has no information to indicate whether the table is read as bucketed table or not. And if table not read as bucketed table, what's the reason behind it. Add this info into FileSourceScanExec physical query plan output, can help users and developers understand query plan more easily without spending a lot of time debugging why table is not read as bucketed table.

Why are the changes needed?

Help users and developers debug query plan for bucketed table.

Does this PR introduce any user-facing change?

The added Bucketed information in physical query plan when reading bucketed table.
Note for reading non-bucketed table, the query plan stays same and nothing is changed.

Example:

Seq((1, 2), (2, 3)).toDF("i", "j").write.bucketBy(8, "i").saveAsTable("t1")
Seq(2, 3).toDF("i").write.bucketBy(8, "i").saveAsTable("t2")
val df1 = spark.table("t1")
val df2 = spark.table("t2")
df1.join(df2, df1("i") === df2("i"))

AdaptiveSparkPlan isFinalPlan=false
+- SortMergeJoin [i#20], [i#24], Inner
   :- Sort [i#20 ASC NULLS FIRST], false, 0
   :  +- Filter isnotnull(i#20)
   :     +- FileScan parquet default.t1[i#20,j#21] Batched: true, Bucketed: true, DataFilters: [isnotnull(i#20)], Format: Parquet, Location: InMemoryFileIndex(1 paths)[file:/Users/chengsu/spark/sql/core/spark-warehouse/org.apache.spark.sq..., PartitionFilters: [], PushedFilters: [IsNotNull(i)], ReadSchema: struct<i:int,j:int>, SelectedBucketsCount: 8 out of 8
   +- Sort [i#24 ASC NULLS FIRST], false, 0
      +- Filter isnotnull(i#24)
         +- FileScan parquet default.t2[i#24] Batched: true, Bucketed: true, DataFilters: [isnotnull(i#24)], Format: Parquet, Location: InMemoryFileIndex(1 paths)[file:/Users/chengsu/spark/sql/core/spark-warehouse/org.apache.spark.sq..., PartitionFilters: [], PushedFilters: [IsNotNull(i)], ReadSchema: struct<i:int>, SelectedBucketsCount: 8 out of 8

How was this patch tested?

Added unit test in ExplainSuite.scala.

[c21]

@cloud-fan and @maropu could you help take a look when you have time? Thanks!

[SparkQA]

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46813/

[SparkQA]

Kubernetes integration test status success
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46813/

[dongjoon-hyun]

It looks good to me.

[cloud-fan]

nit: "Bucketed: true" :: Nil: _* -> "Bucketed: true"?

[c21]

yeah, updated for this and other places.

[cloud-fan]

ditto

[cloud-fan]

ditto

[cloud-fan]

ditto

[SparkQA]

Test build #142306 has finished for PR 33698 at commit b087cd3.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[SparkQA]

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46856/

[SparkQA]

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46856/

[SparkQA]

Test build #142348 has finished for PR 33698 at commit 2d42d37.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[dongjoon-hyun]

Merged to master for Apache Spark 3.3.0 according to the issue type, Improvement.

[dongjoon-hyun]

Thank you, @c21 and @cloud-fan .

[c21]

Thank you @dongjoon-hyun and @cloud-fan for review!