-
Notifications
You must be signed in to change notification settings - Fork 29k
[SPARK-39948][BUILD] Exclude hive-vector-code-gen dependency #38978
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
cc @sunchao FYI |
|
@zhouyifan279 Title should be |
Thanks, corrected. |
dongjoon-hyun
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
+1, LGTM. (Pending CIs)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
BTW, @zhouyifan279 . The GitHub Action is not triggerred at your repository still.

@dongjoon-hyun thanks for your reminding. Several workflows were triggered by previous commits. I have cancelled them. |
|
Can one of the admins verify this patch? |
|
If we can exclude this code, then, the CVE doesn't affect Spark to begin with right? |
sunchao
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
| "org.apache.curator:*", | ||
| "org.pentaho:pentaho-aggdesigner-algorithm")) | ||
| "org.pentaho:pentaho-aggdesigner-algorithm", | ||
| "org.apache.hive:hive-vector-code-gen")) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
do other Hive versions like v2_2 have the same issue?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@zhouyifan279 Could you answer @sunchao 's question?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thank you for confirming, @zhouyifan279 .
|
Yes, right, @srowen . Apache Spark is not affected. |
|
I revised the PR title and description by removing CVE info, @srowen . |
|
Merged to master branch for Apache Spark 3.4.0. |
|
What is your JIRA ID, @zhouyifan279 ? |
|
I found your JIRA ID, Also, from the commit log, I found the following three JIRAs and assigned them to you. Thank you for your contribution, @zhouyifan279 . |
I reused this issue: https://issues.apache.org/jira/browse/SPARK-39948 |
Thanks. It's my pleasure to do something for the Spark community. |
### What changes were proposed in this pull request? Remove hive-vector-code-gen and its dependent jars from spark distribution ### Why are the changes needed? hive-vector-code-gen is not used in spark Remove it to avoid vulnerability scanners's alert. ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? Passed current test cases Closes apache#38978 from zhouyifan279/SPARK-39948. Authored-by: zhouyifan279 <[email protected]> Signed-off-by: Dongjoon Hyun <[email protected]>
What changes were proposed in this pull request?
Remove hive-vector-code-gen and its dependent jars from spark distribution
Why are the changes needed?
hive-vector-code-gen is not used in spark
Remove it to avoid vulnerability scanners's alert.
Does this PR introduce any user-facing change?
No
How was this patch tested?
Passed current test cases