[WIP] Upgrade to Hadoop 3.x Hive 3.x (Needs Rebase)#5292

Closed

rahil-c wants to merge 64 commits intoapache:masterfrom

rahil-c:rchertar/hdp-3-spark-3

Commits on Mar 14, 2022

Commits on Mar 16, 2022

Added dep on "hbase-hadoop2-compat" bearing implementation for interfaces in "hbase-hadoop-compat"
Alexey Kudinkin
committed
Package "hbase-metrics-api" into the bundles
Alexey Kudinkin
committed
Package "hbase-metrics" into the bundles
Alexey Kudinkin
committed
Bumped dep versions in Docker images
Alexey Kudinkin
committed
Fixed missing deps
Alexey Kudinkin
committed
Adjust demo setup log4j properties
Alexey Kudinkin
committed
Missing `scala-library` dep
Alexey Kudinkin
committed
Unified Java source/target configs
Alexey Kudinkin
committed
Bumped Maven's Java/Scala compiler plugins;
Alexey Kudinkin
committed
Bumped Maven jar/dependency plugins
Alexey Kudinkin
committed
XXX
Alexey Kudinkin
committed
Reverting accidental change
Alexey Kudinkin
committed
Bumped Hive version to 3.1.2 (to be compatible w/ Hadoop 3.x)
Alexey Kudinkin
committed
Upgraded
Alexey Kudinkin
committed
Upgraded Hadoop/Hive in Docker images
Alexey Kudinkin
committed
Excluded Jetty from being transitively pulled in from Hive, Hadoop, HBase
Alexey Kudinkin
committed
Added `NoOpMetastoreUriResolverHook` to bypass issue of Hive 3.x trying to get canonical host-name, which breaks our Docker IT setup (adding network name as the suffix, malforming the URL: the orig…
Alexey Kudinkin
committed
Fixed HDFS default `namenode` port changed from 50070 to 9870
Alexey Kudinkin
committed
Fixed Hive Metastore's Postgresql image version to fetch correct version of Hive 3.x
Alexey Kudinkin
committed
Setup Tez (required for Hive 3.x, MR support is removed) w/in `hive_base` images
Alexey Kudinkin
committed
Tidying up
Alexey Kudinkin
committed
XXX
Alexey Kudinkin
committed
Fixed compilation
Alexey Kudinkin
committed

Commits on Mar 25, 2022

Get Docker Setup Working
Rahil Chertara
committed
Change Maven Dep plugin to 3.3.0
Rahil Chertara
committed

Commits on Mar 31, 2022

Remove Tez and set hive vector execution to false
Rahil Chertara
committed

Commits on Apr 1, 2022

Setup to use Spark 3.2.1
Rahil Chertara
committed

Commits on Apr 5, 2022

Hive configurations to get past hive related issues, and parquet mr conflict fix
Rahil Chertara
committed

Commits on Apr 6, 2022

try trino with hadoop 3 and hive 3
Rahil Chertara
committed

Commits on Apr 8, 2022

Fix Docker IT issue with Hive defaulting to Tez
Rahil Chertara
committed
Fix Avro field not found issue introduced by Avro 1.10

Wenning Ding
authored and
Rahil Chertara
committed
Remove unused import, increase sleep time
Rahil Chertara
committed

Commits on Apr 9, 2022

Change Azure CI setup to run Spark 3.2.1
Rahil Chertara
committed

Commits on Apr 11, 2022

Remove Define Parquet version as 1.10.1 in Hudi Hadoop Mr
Rahil Chertara
committed
[HUDI-3817] shade parquet dependency for hudi-hadoop-mr-bundle (#5250)

RexXiong
authored and
Rahil Chertara
committed
Remove making Spark3 default profile
Rahil Chertara
committed
Add Spark3 profile in Azure CI setup
Rahil Chertara
committed

Commits on Apr 13, 2022

Exclude Jetty in timeline server
Rahil Chertara
committed