Skip to content

Upgrade Hudi version to 0.15.0.#25055

Draft
sumi-mathew wants to merge 1 commit intoprestodb:masterfrom
sumi-mathew:hudi_upgarde
Draft

Upgrade Hudi version to 0.15.0.#25055
sumi-mathew wants to merge 1 commit intoprestodb:masterfrom
sumi-mathew:hudi_upgarde

Conversation

@sumi-mathew
Copy link
Copy Markdown
Contributor

@sumi-mathew sumi-mathew commented May 6, 2025

Description

Upgrade Hudi version to 0.15.0.

Motivation and Context

Upgrade Hudi version to 0.15.0 for avoiding the cve issues

Impact

Test Plan

Contributor checklist

  • Please make sure your submission complies with our contributing guide, in particular code style and commit standards.
  • PR description addresses the issue accurately and concisely. If the change is non-trivial, a GitHub Issue is referenced.
  • Documented new properties (with its default value), SQL syntax, functions, or other functionality.
  • If release notes are required, they follow the release notes guidelines.
  • Adequate tests were added if applicable.
  • CI passed.

Release Notes

Please follow release notes guidelines and fill in the release notes below.

== RELEASE NOTES ==

General Changes
* Upgrade Hudi version to 0.15.0.

@prestodb-ci prestodb-ci added the from:IBM PR from IBM label May 6, 2025
@sumi-mathew sumi-mathew marked this pull request as ready for review May 7, 2025 03:23
@prestodb-ci prestodb-ci requested a review from a team May 7, 2025 03:23
@sumi-mathew sumi-mathew requested a review from jaystarshot May 7, 2025 03:23
@prestodb-ci prestodb-ci requested review from anandamideShakyan and sh-shamsan and removed request for a team May 7, 2025 03:23
Copy link
Copy Markdown

@xushiyan xushiyan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

<ignoredClassPattern>shaded.parquet.it.unimi.dsi.fastutil.*</ignoredClassPattern>
<ignoredClassPattern>module-info</ignoredClassPattern>
<ignoredClassPattern>META-INF.versions.9.module-info</ignoredClassPattern>
<ignoredClassPattern>io.airlift.compress.*</ignoredClassPattern>
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There are a lots of changes of this kind. Does the airlift.compress originate from the new version of 'hudi-presto-bundle'? If so, is it feasible to exclude that from the bundle?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Since io.airlift.compress is packaged inside hudi-presto-bundle.jar, we are unable to exclude it.
Screenshot 2025-05-14 at 2 16 50 PM

Copy link
Copy Markdown
Contributor

@ZacBlanco ZacBlanco May 14, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should try to work with the Hudi community to either not shade this, or move the shaded package to a different package name so that classes don't clash

<dep.druid.version>30.0.1</dep.druid.version>
<dep.jaxb.version>2.3.1</dep.jaxb.version>
<dep.hudi.version>0.14.0</dep.hudi.version>
<dep.hudi.version>0.15.0</dep.hudi.version>
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think even if this is upgraded to 1.0.2, we would still not be addressing the high and critical CVEs arising from parquet-avro

@sumi-mathew sumi-mathew marked this pull request as draft December 11, 2025 06:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

from:IBM PR from IBM

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants