Skip to content

Conversation

@whbing
Copy link
Owner

@whbing whbing commented May 10, 2021

NOTICE

Please create an issue in ASF JIRA before opening a pull request,
and you need to set the title of the pull request which starts with
the corresponding JIRA issue number. (e.g. HADOOP-XXXXX. Fix a typo in YYY.)
For more details, please see https://cwiki.apache.org/confluence/display/HADOOP/How+To+Contribute

aajisaka and others added 30 commits April 23, 2021 19:52
… removed when the container is actually reserved, not assigned in FairScheduler. Contributed by Siddharth Ahuja.
…ll. (#2861). Contributed by Ayush Saxena.

Signed-off-by: Vinayakumar B <[email protected]>
Followup to HADOOP-13327, which changed S3A output stream hsync/hflush calls
to raise an exception.

Adds a new option fs.s3a.downgrade.syncable.exceptions

When true, calls to Syncable hsync/hflush on S3A output streams will
log once at warn (for entire process life, not just the stream), then
increment IOStats with the relevant operation counter

With the downgrade option false (default)
* IOStats are incremented
* The UnsupportedOperationException current raised includes a link to the
  JIRA.

Contributed by Steve Loughran.
…. Contributed by Siddharth Ahuja

This is required to highlight that an implementation at framework level is needed for the stop/start functionality to work.
… killed because exceeding container log size limit. Contributed by Qi Zhu.
nodemanager port, broken by YARN-10647. Contributed by D M Murali Krishna Reddy
…#2377)"

This reverts commit 394b9f7.

Ref: HDFS-15995.
Had to revert this commit, so we can commit HDFS-15566 (a critical bug preventing rolling upgrade to Hadoop 3.3)
Will re-work this fix again later.
… 3.3.0. Contributed by Brahma Reddy Battula.

Signed-off-by: Wei-Chiu Chuang <[email protected]>
Signed-off-by: Akira Ajisaka <[email protected]>

Change-Id: I7de255cb9a167e3a5e25ae339b050e82cb4b7c30
…n is enabled while having snapshottable directories (#2881)
…very to take too much time. Contributed by Qi Zhu.
Signed-off-by: Akira Ajisaka <[email protected]>

Change-Id: Ib2a4bf775a5804641a91c6f9a486772c9d87c17e
…#2955)

1. puts NVDIMM to the end of storage type enum to make sure compatibility.
2. adds check to make sure the software layout version is satisfied

Co-authored-by: su xu <[email protected]>
Co-authored-by: huangtianhua <[email protected]>
Co-authored-by: YaYun-Wang <[email protected]>

Signed-off-by: Mingliang Liu <[email protected]>
Signed-off-by: Ayush Saxena <[email protected]>
Signed-off-by: Vinayakumar B <[email protected]>

Change-Id: I3c58beef50730827a09b3c968e9ad637baa57d44
ericbadger and others added 18 commits April 29, 2021 17:42
…te Node GPU Utilization to use. Contributed by Qi Zhu
… fall back to flush, if hflush is not supported (#2949)


Co-authored-by: Kishen Das <[email protected]>
Reviewed-by: Steve Loughran <[email protected]>
Contributed by Tor Arvid Lund.

Change-Id: Iadfe9b2f355cf373031075bfbe681705a2c65bdc
…erval between batch configurable. Contributed by Qi Zhu. (#2833)

Signed-off-by: Ayush Saxena <[email protected]>
…uava 15+ (#2973)

Reviewed-by: Wei-Chiu Chuang <[email protected]>
Signed-off-by: Akira Ajisaka <[email protected]>
)

Reviewed-by: Viraj Jasani <[email protected]>
Reviewed-by: Bilwa S T <[email protected]>
Signed-off-by: Takanobu Asanuma <[email protected]>
…e value of FSEditLogOpCodes. (#2980)

Reviewed-by: Xiaoqiao He <[email protected]>
…rs (#2819). Contributed by zhuobin zheng.

Reviewed-by: Jinglun <[email protected]>
Reviewed-by: Inigo Goiri <[email protected]>
@whbing whbing merged commit 97aab8c into whbing:trunk May 10, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.