[SPARK-34046][SQL][TESTS] Use join hint for constructing joins in JoinSuite and WholeStageCodegenSuite

[gengliangwang]

What changes were proposed in this pull request?

There are some existing test cases that constructing various joins by tuning the SQL configuration AUTO_BROADCASTJOIN_THRESHOLD, PREFER_SORTMERGEJOIN,SHUFFLE_PARTITIONS, etc.

This can be tricky and not straight-forward. In the future development we might have to tweak the configurations again .
This PR is to construct specific joins by using join hint in test cases.

Why are the changes needed?

Make test cases for join simpler and more robust.

Does this PR introduce any user-facing change?

No

How was this patch tested?

Unit test

[dongjoon-hyun]

Thank you, @gengliangwang . The change looks clear and better, but the title looks a little too broad because this is a partial subset of those instances. Could you revise the PR title more specific? You may want to mention two test suite (which is touched in this PR) explicitly in the PR title.

For example, BroadcastJoinSuite has more instances like the following.

withSQLConf(SQLConf.AUTO_BROADCASTJOIN_THRESHOLD.key -> "-1") {

[SparkQA]

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/38411/

[SparkQA]

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/38411/

[gengliangwang]

@dongjoon-hyun Thanks. I have updated the title

[cloud-fan]

LGTM, we can slowly fix other test suites one by one later.

[cloud-fan]

thanks, merging to master!

[SparkQA]

Test build #133822 has finished for PR 31087 at commit 8a6b76f.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[dongjoon-hyun]

Thank you!