Add support and tests for OpenX JSON SerDe in Hive connector

[anusudarsan]

Description

Is this change a fix, improvement, new feature, refactoring, or other?

Is this a change to the core query engine, a connector, client library, or the SPI interfaces? (be specific)

How would you describe this change to a non-technical end user or system administrator?

Related issues, pull requests, and links

Documentation

( ) No documentation is needed.
(X) Sufficient documentation is included in this PR.
( ) Documentation PR is available with #prnumber.
( ) Documentation issue #issuenumber is filed, and can be handled later.

Release notes

( ) No release notes entries required.
(X) Release notes entries required with the following suggested text:

# Section
* Add support for OpenX Json serde format for Hive connector

[martint]

There shouldn't be any references to other repositories than maven central. Otherwise, it can be hard or problematic to build the project in environments that sit behind firewalls.

[MiguelWeezardo]

I'm not sure if we can get rid of this dependency. The serde has shims for HDP 3 and CDH 7 (default), both of which have their own repos. I'm not sure if it will be possible to generalize it to only dependencies found on Maven Central.

[MiguelWeezardo]

Turns out this isn't too difficult: starburstdata/hive-json-serde#6

[findepi]

cc @electrum

[anusudarsan]

This PR fails when we remove the cloudera maven repo, and enforcer plugin has issues with a "provided" dependency.

The build error message is due to a bug (missing feature) in maven-enforcer-plugin version 3.0.0 (which is the version we set in airbase). A warning in enforcer-plugin 3.0.0-M3 has been upgraded to an error in 3.0.0 and is not a configurable flag yet https://issues.apache.org/jira/browse/MENFORCER-413

... the problem here for maven enforcer plugin is that it is too strict. I think we can just ignore the optional and provided dependencies while checking, or at least provide an option to let users ignore them.

[electrum]

I don’t know why we’re adding all these dependencies, but something is wrong. Is this depending on a non-shaded version of Hadoop?

[anusudarsan]

@electrum yes its not using the shaded version of hadoop. The lib uses these versions of hive/hadoop (https://github.com/starburstdata/hive-json-serde/blob/develop/pom.xml#L41). @MiguelWeezardo have we tried using the shaded version of hadoop for this?

[MiguelWeezardo]

I haven't tried shading hadoop yet.

[MiguelWeezardo]

starburstdata/hive-json-serde#8 - first attempt at shading, unfortunately it fails to load in Trino.

[findepi]

Is this superseded by @dain's #16073 ?

[colebow]

👋 @anusudarsan - this PR is inactive and doesn't seem to be under development. If you'd like to continue work on this at any point in the future, feel free to re-open.