[HUDI-xxx] Support hudi on hadoop3

[zhiqiang-dev]

Change Logs

Hadoop, Hbase dependencies
Use HFIle code

Impact

No public API or user-facing feature change.

Risk level (write none, low medium or high below)

high

Documentation Update

Update compile command

Contributor's checklist

• Read through contributor's guide
• Change Logs and Impact were stated clearly
• Adequate tests were added if applicable
• CI passed

[zhiqiang-dev]

• I would recommend that hadoop2 hadoop3 be maintained separately, otherwise the Hbase Module would need to be separated into different versions of Hadoop.

• If I need to maintain both, I'll need to add the Profile configuration later and then separate Hbase into different Modules.

[hudi-bot]

CI report:

• 07bc67e UNKNOWN
• 6a14f95 Azure: FAILURE

Bot commands

@hudi-bot supports the following commands:

• @hudi-bot run azure re-run the last Azure build

[yihua]

We're going to upgrade Hadoop dependency to Hadoop 3 in #11572 and deprecate HBase dependency soon (in fact, #10241 is merged to add a HFile reader independent of HBase). So IMO we should close this PR and prioritize those PRs.

[yihua]

Feel free to reopen the PR if the changes are still necessary based on the latest master.