Skip to content

ODP-2462: HDFS-3246|HDFS-14564|HDFS-14304|HDFS-14033|HDFS-14267|HDFS-15977 Making Hadoop 3.2.3.3.2.3.3-2 compatible with Impala 4.4.0#46

Merged
shubhluck merged 9 commits intorel/ODP-3.2.3.3-2from
ODP-2462_II
Nov 27, 2024
Merged

ODP-2462: HDFS-3246|HDFS-14564|HDFS-14304|HDFS-14033|HDFS-14267|HDFS-15977 Making Hadoop 3.2.3.3.2.3.3-2 compatible with Impala 4.4.0#46
shubhluck merged 9 commits intorel/ODP-3.2.3.3-2from
ODP-2462_II

Conversation

@deepakdamri
Copy link
Copy Markdown

Manual change to comment @OverRide for readfully method in hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/CryptoInputStream.java

Open Source commits:

  1. HDFS-3246: pRead equivalent for direct read path (HDFS-3246: pRead equivalent for direct read path apache/hadoop#597)
  2. HDFS-14564: Add libhdfs APIs for readFully; add readFully to ByteBufferPositionedReadable (HDFS-14564: Add libhdfs APIs for readFully; add readFully to ByteBufferPositionedReadable apache/hadoop#963) Contributed by Sahil Takiar
  3. HDFS-14304: High lock contention on hdfsHashMutex in libhdfs
  4. HDFS-14033. [libhdfs++] Disable libhdfs++ build on systems that do not support thread_local. Contributed by Anatoli Shein.
  5. HDFS-14267. Add test_libhdfs_ops to libhdfs tests, mark libhdfs_read/write.c as examples. Contributed by Sahil Takiar. Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
  6. HDFS-15977. Call explicit_bzero only if it is available. (HDFS-15977. Call explicit_bzero only if it is available. apache/hadoop#2914)

sahilTakiar and others added 8 commits November 20, 2024 17:59
…erPositionedReadable (apache#963) Contributed by Sahil Takiar.

Reviewed-by: Siyao Meng <smeng@cloudera.com>

asd
HDFS-3246: pRead equivalent for direct read path

Contributed by Sahil Takiar
This closes apache#595

Signed-off-by: Todd Lipcon <todd@apache.org>
Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
Reviewed-by: Inigo Goiri <inigoiri@apache.org>
(cherry picked from commit f0241ec)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfspp/lib/x-platform/syscall_linux.cc
…write.c as examples. Contributed by Sahil Takiar.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
…t support thread_local. Contributed by Anatoli Shein.
…write.c as examples. Contributed by Sahil Takiar.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
@shubhluck shubhluck changed the title ODP-2462: Making Hadoop 3.2.3.3.2.3.3-2 compatible with Impala 4.4.0 ODP-2462: HDFS-3246|HDFS-14564|HDFS-14304|HDFS-14033|HDFS-14267|HDFS-15977 Making Hadoop 3.2.3.3.2.3.3-2 compatible with Impala 4.4.0 Nov 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants