[HUDI-53] Adding a record level index based on the Metadata Table v2#3508

Closed

prashantwason wants to merge 15 commits intoapache:masterfrom

prashantwason:pw_record_level_index_oss

Commits on Aug 7, 2021

[HUDI-848] Synchronous commits before completion of instants.
prashantwason
committed
[HUDI-852] Reader side logic with unit test.
prashantwason
committed
[HUDI-XXX] Remove option for runtime validation of metadata table against file listing.
prashantwason
committed
[HUDI-859] Fixed compactions on the Metadata Table.
prashantwason
committed
[HUDI-878] Support for shards in metadata table partitions.
prashantwason
committed
[HUDI-850] Do not archive instants on the dataset if they are newer than latest compaction on metadata table.
prashantwason
committed
[HUDI-854, HUDI-855] Handle Metadata Table upgrade/downgrade by deleting the table and re-bootstrapping.
prashantwason
committed
[HUDI-1064] Multi-writer support for metadata table.
prashantwason
committed
[HUDI-1191] Fixed all unit tests in TestHoodieBackedMetadata.
prashantwason
committed
Fixed checkstyle
prashantwason
committed

Commits on Aug 18, 2021

[HUDI-1194] Schema for record level index.
prashantwason
committed