[HUDI-3322][HUDI-3343] Fixing Metadata Table Records Duplication Issues#4716

Merged

nsivabalan merged 18 commits intoapache:masterfrom

onehouseinc:ak/rb-pln-fix

Feb 2, 2022

Commits on Jan 31, 2022

Tidying up
Alexey Kudinkin
committed
Cleaned up Rollback request generation flow;
Alexey Kudinkin
committed
Cleaned up superfluous `writtenLogFilesSizeMap`
Alexey Kudinkin
committed
Fixed compilation
Alexey Kudinkin
committed
Only propagate latest log-file as the one that will bear ROLLBACK block
Alexey Kudinkin
committed
Fixing compilation
Alexey Kudinkin
committed
Fixed `RollbackUtils` to always leverage appropriate instant when fetching metadata
Alexey Kudinkin
committed
Streamlined
Alexey Kudinkin
committed
Fixing file-name extraction
Alexey Kudinkin
committed
Propagate `HoodieWriteStat` w/in `ListingBasedRollbackRequest`;
Alexey Kudinkin
committed
Fixed `RollbackPlan` generation to properly refeference files bearing blocks
Alexey Kudinkin
committed
Fixed superfluous `RollbackPlan` generation
Alexey Kudinkin
committed
Tidying up;
Alexey Kudinkin
committed
Removing duplicated records being ingested into MT
Alexey Kudinkin
committed
Fixing MT to be bootstapped _before_ carrying out any FS operations, to make sure it's not ingesting intermediate step upon bootstrapping
Alexey Kudinkin
committed
Tidying up
Alexey Kudinkin
committed
Fix `MarkerBasedRollbackStrategy` to only ref the latest log-file as the one blocks have been appended to
Alexey Kudinkin
committed
Fixing compilation
Alexey Kudinkin
committed