[HUDI-3812] Fixing Data Skipping configuration to respect Metadata Table configs#5244

Merged

nsivabalan merged 11 commits intoapache:masterfrom

onehouseinc:ak/dskp-cfg-fix

Apr 10, 2022

Commits on Apr 9, 2022

Added checks validating whether Data Skipping is being configured properly (along w/ MT, and CSI);
Alexey Kudinkin
committed
Enable MT by default for Readers
Alexey Kudinkin
committed
Added one more sanity check to `HoodieFileIndex` to bypass DS flow in cases when no top-level column is actually referenced
Alexey Kudinkin
committed
Make sure `TestColumnStatsIndex` tests both full MT read, as well as key-prefix fetches;
Alexey Kudinkin
committed
Fixing compilation
Alexey Kudinkin
committed
Simplifying tests
Alexey Kudinkin
committed
Fixing tests
Alexey Kudinkin
committed
Removing CSI enabled flag from gating whether Data Skipping flow should proceed (since this flag is a write-path flag, which we would like to not urge users to specify on the Read path)
Alexey Kudinkin
committed
Reverting enabling MT for readers by default
Alexey Kudinkin
committed
Fixing MT config propagation when reading whole MT
Alexey Kudinkin
committed
Fixing tests
Alexey Kudinkin
committed