[HUDI-2285] Metadata Table synchronous design#3426

Closed

prashantwason wants to merge 11 commits intoapache:masterfrom

prashantwason:pw_metadata_table_v2_oss

Commits on Aug 7, 2021

[HUDI-848] Synchronous commits before completion of instants.
prashantwason
committed
[HUDI-852] Reader side logic with unit test.
prashantwason
committed
[HUDI-XXX] Remove option for runtime validation of metadata table against file listing.
prashantwason
committed
[HUDI-859] Fixed compactions on the Metadata Table.
prashantwason
committed
[HUDI-878] Support for shards in metadata table partitions.
prashantwason
committed
[HUDI-850] Do not archive instants on the dataset if they are newer than latest compaction on metadata table.
prashantwason
committed
[HUDI-854, HUDI-855] Handle Metadata Table upgrade/downgrade by deleting the table and re-bootstrapping.
prashantwason
committed
[HUDI-1064] Multi-writer support for metadata table.
prashantwason
committed
[HUDI-1191] Fixed all unit tests in TestHoodieBackedMetadata.
prashantwason
committed
Fixed checkstyle
prashantwason
committed

Commits on Aug 24, 2021

Enabling metadata table by default.
prashantwason
committed