Skip to content

Conversation

@Madhukar525722
Copy link
Contributor

Why are the changes needed?

As initial step to bring hive 4 compatibility in Kyuubi, has addressed the following incompatible changes on ConfVars enum via HIVE-27925.
apache/hive#4919
apache/hive#5107
HiveConf.getConfVars or config names is more robust way to handle this incompatibility.

How was this patch tested?

Build locally and CI

Was this patch authored or co-authored using generative AI tooling?

No

@pan3793
Copy link
Member

pan3793 commented Nov 27, 2024

@Madhukar525722 Thank you for your effort in working on upgrading Hive 4, it seems you touched both the Spark engine/plugin modules and the Hive engine module, I would say it's IMPOSSIBLE to upgrade the Spark's built-in Hive to 4 at the current stage, all Kyuubi supported Spark versions(Spark 3.2 to 3.5 and 4.0 as of today) use Hive 2.3. So I think you are focusing on upgrading the Hive engine to Hive 4, right?

@Madhukar525722
Copy link
Contributor Author

Thanks @pan3793 for the review. Now, I understood what I missed, I forgot about spark dependency of hive on 2.3.10 and 2.3.9. Yes, I was focusing on hive engine upgrade, I will upgrade hive jdbc.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants