[HUDI-2872][HUDI-2646] Refactoring layout optimization (clustering) flow to support linear ordering#4606

Merged

nsivabalan merged 18 commits intoapache:masterfrom

onehouseinc:ak/clstr-ref-1

Jan 24, 2022

Commits on Jan 19, 2022

Cleaned up `RDDSpatialCurveSortPartitioner`
Alexey Kudinkin
committed
Leverage ordering-columns captured w/in clustering plan w/in spatial curve partitioner as well
Alexey Kudinkin
committed
Restoring missing deps on Parquet, Avro
Alexey Kudinkin
committed
Tidied up Layout Optimization config docs;
Alexey Kudinkin
committed
Cleaning up dead-code
Alexey Kudinkin
committed
Removed superfluous conditional guarding table's metadata index udpates
Alexey Kudinkin
committed
Tidying up
Alexey Kudinkin
committed
Cleaned up layout optimization flow to leverage configured optimization strategy
Alexey Kudinkin
committed
Tidying up
Alexey Kudinkin
committed
Added linear ordering optimization strategy to test set;
Alexey Kudinkin
committed
Expanded Laoyout Optimization test-matrix to include different curve composition methods
Alexey Kudinkin
committed
Tidying up
Alexey Kudinkin
committed
Fixing compilation
Alexey Kudinkin
committed
Fixing test;
Alexey Kudinkin
committed

Commits on Jan 20, 2022

Overwrite Column Stats Index table when re-running for failed Clustering operation
Alexey Kudinkin
committed
Switch default layout optimization strategy to "linear"
Alexey Kudinkin
committed

Commits on Jan 21, 2022

Added deprecation notice;
Alexey Kudinkin
committed

Commits on Jan 24, 2022

Fixing build failure in Hoodieclusteringconfig
nsivabalan
committed