[HUDI-5646] Guard dropping columns by a config, do not allow by default#7787

Merged

codope merged 13 commits intoapache:masterfrom

codope:schema-validation

Feb 1, 2023

Commits on Jan 31, 2023

[HUDI-5646] Guard dropping columns by a config, do not allow by default

codope
authored and
Alexey Kudinkin
committed
Tidying up
Alexey Kudinkin
committed
Tidying up configs
Alexey Kudinkin
committed
Replaced superfluous `isSchemaCompatible` override by explicitly specifying whether column drop should be allowed;
Alexey Kudinkin
committed
Revisited `HoodieSparkSqlWriter` to avoid (unnecessary) schema handling for delete operations
Alexey Kudinkin
committed
Remove meta-fields from latest table schema during analysis
Alexey Kudinkin
committed
addressing comments

nsivabalan
authored and
Alexey Kudinkin
committed
Fixing test
Alexey Kudinkin
committed
Disable schema validation when partition columns are dropped
Alexey Kudinkin
committed
Fixed `ClassNotFoundException`s littering tests output in hudi-spark-client module
Alexey Kudinkin
committed
Fixing test
Alexey Kudinkin
committed
Fix column stats accounting for empty columns
Alexey Kudinkin
committed

Commits on Feb 1, 2023

Fixing more tests
Alexey Kudinkin
committed