[HUDI-2579] Make deltastreamer checkpoint state merging more explicit#3820

Merged

nsivabalan merged 10 commits intoapache:masterfrom

haggy:checkpoint_rollover_fix

Nov 9, 2021

Commits on Nov 9, 2021

When merging checkpoint state we should be using the key set from the previous instant, not the current

davehagman
authored and
nsivabalan
committed
Move deltastreamer commit state merge operation into its own method

davehagman
authored and
nsivabalan
committed
Remove unused config: `hoodie.write.meta.key.prefixes`

davehagman
authored and
nsivabalan
committed
Fix checkstyle violations

davehagman
authored and
nsivabalan
committed
Validate that deltastreamer state merge config is not set if currently running the deltastreamer

davehagman
authored and
nsivabalan
committed
Align test with actual expectations (there should not be two deltastreamers running in parallel against the same table)

davehagman
authored and
nsivabalan
committed
Test checkpoint state merge operation

davehagman
authored and
nsivabalan
committed
Fix checkstyle violations

davehagman
authored and
nsivabalan
committed
Fix checkstyle violation

davehagman
authored and
nsivabalan
committed
Adding back old config as an alternative to new config
nsivabalan
committed