Spark 3.1: Port some PRs to Spark 3.1

[hililiwei]

Port some PRs to Spark 3.1:

• Spark: Support metadata columns in 3.2 #3373
• Spark: Validate table columns don't conflict with metadata columns #3456
• Add overwrite-mode to SparkWriteOptions as a constant #3491
• Support pos-delete in vectorized read. #3287
• Spark: Move more read configs to SparkReadConf #3505
• Spark: Move WAP conf to SparkWriteConf #3721
• Spark: Support vectorized reads with equality deletes #3557
• Spark 3.2: Fix names of methods that read all content files in actions #4198
• Core: Make DeleteFilter's constructor parameters more specific #4381
• Core: Replace Set with Bitmap to make delete filtering simpler and faster #3535
• Spark/Flink: ORC support estimated length for unclosed file. #4419

[rdblue]

@hililiwei, can you open separate PRs to backport those? I think this is too much for one PR.