[HUDI-7218] Integrate new HFile reader with file reader factory

[yihua]

Change Logs

This PR integrates the new native HFile reader with file reader factory.

Major changes are:

• Moves common logic of reading Avro records from HFile from HoodieAvroHFileReader to BaseHoodieAvroHFileReader (abstract class). HoodieAvroHFileReader now contains the new implementation based on the Hudi-native HFile reader. HoodieAvroHBaseHFileReader (code moved from previous HoodieAvroHFileReader class) is the implementation based on the HBase HFile reader.
• Adds a new implementation of BootstrapIndex.IndexReader in HFileBootstrapIndex using the Hudi-native HFile reader.
• A new config hoodie.hfile.use.built.in.reader (HoodieReaderConfig. USE_BUILT_IN_HFILE_READER) to control whether the built-in HFile reader is used to read HFiles. By default, it's set to true.
• HoodieFileReaderFactory and subclasses are refactored to allow instantiating the Avro HFile reader through either native-based or HBase-based HFile reader, by checking the Hudi config.
• Fixes packaging and shading by adding com.google.protobuf:protobuf-java and the corresponding shading rule.
• Refactors production code to use HoodieFileReaderFactory to get the reader for reading HFile, instead of directly instantiating HoodieAvroHFileReader.
• Adds utils and bloom filter constructors around byte buffer, to be easily used by HoodieAvroHFileReader with the Hudi-native HFile reader.
• Removes direct usage of implementation classes of HFile readers and uses the file reader factory instead to get the HFile reader (BaseHoodieAvroHFileReader)
• TestInLineFileSystemHFileInLining tests are refactored to run on both native-based and HBase-based HFile readers.
• TestHoodieHFileReaderWriter tests are refactored to run on both native-based and HBase-based HFile readers.

Impact

Uses new HFile reader.

Risk level

medium

Documentation Update

N/A

Contributor's checklist

• Read through contributor's guide
• Change Logs and Impact were stated clearly
• Adequate tests were added if applicable
• CI passed

[yihua]

This PR is still WIP. Sending the PR to Azure CI to run tests.

[yihua]

@hudi-bot run azure

[yihua]

@hudi-bot run azure

[vinothchandar]

Took a skim. No major red flags. Land and proceed if this is blocking you

[nsivabalan]

half way through my review

[hudi-bot]

CI report:

• 49e5fa7 Azure: SUCCESS

Bot commands

@hudi-bot supports the following commands:

• @hudi-bot run azure re-run the last Azure build