[HUDI-6806] Support Spark 3.5.0#9717

Merged

yihua merged 54 commits intoapache:masterfrom

CTTY:ctty/hudi1x-spark35

Nov 16, 2023

Commits on Nov 15, 2023

Support Spark 3.5.0

CTTY
authored and
yihua
committed
Adjust pom version

CTTY
authored and
yihua
committed
see all test failures

CTTY
authored and
yihua
committed
Fix insert into statement related fix

CTTY
authored and
yihua
committed
add hive-storage-api as provided in hudi-spark

CTTY
authored and
yihua
committed
Minor compilation fix

CTTY
authored and
yihua
committed
minor

CTTY
authored and
yihua
committed
Fix case sensitive test for Spark35

CTTY
authored and
yihua
committed
Spark backward compatibility

CTTY
authored and
yihua
committed
minor fix

CTTY
authored and
yihua
committed
minor

CTTY
authored and
yihua
committed
More tests fix

CTTY
authored and
yihua
committed
Fix all UTs for Spark 3.5.0

CTTY
authored and
yihua
committed
checkstyle fix

CTTY
authored and
yihua
committed
InsertIntoStatement backward compatibility

CTTY
authored and
yihua
committed
Split DataSourceUtils for 3.2-3.5

CTTY
authored and
yihua
committed
more fix for backward compatibility

CTTY
authored and
yihua
committed
minor fix

CTTY
authored and
yihua
committed
minor fix

CTTY
authored and
yihua
committed
use getEncoder

CTTY
authored and
yihua
committed
fix import

CTTY
authored and
yihua
committed
minor

CTTY
authored and
yihua
committed
minor

CTTY
authored and
yihua
committed
Fix TestReflectUtil arg numbers

CTTY
authored and
yihua
committed
minor

CTTY
authored and
yihua
committed
UT passed for all Spark versions, re-enable flink tests and fixing bundle validation

CTTY
authored and
yihua
committed
Fixed all Spark35 UT, need to fix classpath for older Spark

CTTY
authored and
yihua
committed
make hive-storage-api a 3.5 profile dependency

CTTY
authored and
yihua
committed
trigger CI

CTTY
authored and
yihua
committed
Revert "trigger CI"

CTTY
authored and
yihua
committed
Skipping Spark 3.4 CI due to GHCI SSL issue

CTTY
authored and
yihua
committed
remove hive-storage-api from hudi-spark pom

CTTY
authored and
yihua
committed
Fixed all GHCI UT, fixing Azure CI

CTTY
authored and
yihua
committed
Split test classes and move classes to each Spark submodule to avoid ClassNotFound issue when invoking SparkAdapter

CTTY
authored and
yihua
committed
Add exclusions for spark-core back, add parquet-avro as test dep for hudi-spark3.2-

CTTY
authored and
yihua
committed
Add teardown for TestHoodieFileGroupReaderOnSpark

CTTY
authored and
yihua
committed
Port changes from HUDI-6963 to Spark 3.5 and rebase

CTTY
authored and
yihua
committed
Fix SqlBase for Spark 3.5

CTTY
authored and
yihua
committed
Fix error msg for TestHoodieRowCreateHandle#testGlobalFailure

CTTY
authored and
yihua
committed
Add script to build Spark 35 docker image, not sure why GHCI was canceled

CTTY
authored and
yihua
committed
minor, fixing docker image

CTTY
authored and
yihua
committed
Use personal image and skip bundle validation for non-spark35 temporarily

CTTY
authored and
yihua
committed
Include protobuf in utilities bundle to resolve class not found issue

CTTY
authored and
yihua
committed
Include protobuf in utilities and utilities-slim bundle and relocate it

CTTY
authored and
yihua
committed
Update comment

CTTY
authored and
yihua
committed
Fix build after rebasing master
yihua
committed
Fix bundle validation for Spark 3.5 and GH CI script
yihua
committed
Move util methods from SparkAdapter to corresponding util classes
yihua
committed
Address nits and add docs
yihua
committed
Fix pom
yihua
committed
Fix build
yihua
committed

Commits on Nov 16, 2023