[WIP][SQL][SPARK-3839] Reimplement Left/Right outer join

[Ishiihara]

This is a working in progress PR. This PR reimplement Left/Right outer join using only one hash table.

[Ishiihara]

This depends on #2719

[AmplabJenkins]

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/21499/Test FAILed.

[AmplabJenkins]

Can one of the admins verify this patch?

[Ishiihara]

test this please

[marmbrus]

ok to test

[SparkQA]

QA tests have started for PR 2723 at commit 6aea59c.

• This patch does not merge cleanly.

[SparkQA]

QA tests have finished for PR 2723 at commit 6aea59c.

• This patch fails Spark unit tests.
• This patch does not merge cleanly.
• This patch adds no public classes.

[AmplabJenkins]

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/22381/
Test FAILed.

[SparkQA]

Test build #22408 has started for PR 2723 at commit 91b182f.

• This patch merges cleanly.

[AmplabJenkins]

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/22407/
Test FAILed.

[Ishiihara]

test this please

[SparkQA]

Test build #22408 has finished for PR 2723 at commit 91b182f.

• This patch fails Spark unit tests.
• This patch merges cleanly.
• This patch adds no public classes.

[AmplabJenkins]

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/22408/
Test FAILed.

[SparkQA]

Test build #22411 has started for PR 2723 at commit 91b182f.

• This patch merges cleanly.

[SparkQA]

Test build #22411 has finished for PR 2723 at commit 91b182f.

• This patch fails Spark unit tests.
• This patch merges cleanly.
• This patch adds no public classes.

[AmplabJenkins]

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/22411/
Test FAILed.

[Ishiihara]

@marmbrus All test failures have the same pattern

select * from a right outer join b on condition1 join c on condition2

With the extra join operation, somehow the iterator of a join b does not output all the values of the join result. However,

select * from a right outer join b on a.key = b.key

returns the correct result. I am currently investigating the cause of the failures, please let me know if you have any ideas. Thanks!

[marmbrus]

Thanks for working on this, but we are trying to clean up the PR queue (in order to make it easier for us to review). Thus, I think we should close this issue for now and reopen when its ready for review.