Skip to content

Update to Hadoop 3.3.4#14674

Closed
oneonestar wants to merge 1 commit intotrinodb:masterfrom
oneonestar:oss_hadoop_3.3.4
Closed

Update to Hadoop 3.3.4#14674
oneonestar wants to merge 1 commit intotrinodb:masterfrom
oneonestar:oss_hadoop_3.3.4

Conversation

@oneonestar
Copy link
Copy Markdown
Member

@oneonestar oneonestar commented Oct 18, 2022

Description

Update to Hadoop 3.3.4.
Depends on trinodb/trino-hadoop-apache#44

Non-technical explanation

Update to Hadoop 3.3.4.
org.xerial.snappy:snappy-java is required for some tests. (Caused by HADOOP-17125)

Release notes

( ) This is not user-visible or docs only and no release notes are required.
( ) Release notes are required, please propose a release note for me.
( x ) Release notes are required, with the following suggested text:

# Section
* Update Hadoop library to 3.3.4

TODO:

  • Verify is snappy-java dependency needed for trino-orc

ORC Reader doesn't need snappy-java:

import io.airlift.compress.snappy.SnappyCompressor;

https://github.com/trinodb/trino/blob/cea58426e0a8f4cfe330bc805f88d12ab2d3fc4e/lib/trino-orc/src/main/java/io/trino/orc/OrcSnappyDecompressor.java

Copy link
Copy Markdown
Member

@ebyhr ebyhr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The PR title doesn't match the changed files.

@oneonestar
Copy link
Copy Markdown
Member Author

Superseded by #17869

@oneonestar oneonestar closed this Jun 15, 2023
@oneonestar oneonestar deleted the oss_hadoop_3.3.4 branch February 6, 2024 14:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Development

Successfully merging this pull request may close these issues.

2 participants