Skip to content

Conversation

@adoroszlai
Copy link
Contributor

What changes were proposed in this pull request?

ozone-om-ha uses a temporary Docker image based on top of the regular ozone-runner images.

HDDS-6293 added support for custom ozone-runner image, but the change had a bug: OZONE_RUNNER_IMAGE variable was not passed to the Docker build context in ozone-om-ha. This was not noticed as this test is disabled due to flakiness.

Compare to ozonescripts environment, which also uses its own derived image.

https://issues.apache.org/jira/browse/HDDS-7714

How was this patch tested?

$ cd hadoop-ozone/dist/target/ozone-1.3.0-SNAPSHOT/compose/ozone-om-ha
$ docker-compose up -d
Building datanode
Sending build context to Docker daemon  29.18kB
Step 1/23 : ARG OZONE_RUNNER_IMAGE
Step 2/23 : ARG OZONE_RUNNER_VERSION
Step 3/23 : FROM ${OZONE_RUNNER_IMAGE}:${OZONE_RUNNER_VERSION}
 ---> 2f81b649e1b7
Step 4/23 : RUN sudo yum install -y openssh-clients openssh-server
 ---> Running in 61a7cb57a64c
...
Successfully built 9667608351f9
Successfully tagged ozone-runner-om-ha:20220623-1
WARNING: Image for service datanode was built because it did not already exist. To rebuild this image you must use `docker-compose build` or `docker-compose up --build`.
Creating ozone-om-ha_om2_1      ... done
Creating ozone-om-ha_scm_1      ... done
Creating ozone-om-ha_om3_1      ... done
Creating ozone-om-ha_om1_1      ... done
Creating ozone-om-ha_datanode_1 ... done

@adoroszlai adoroszlai self-assigned this Jan 2, 2023
@adoroszlai adoroszlai added bug Something isn't working test labels Jan 2, 2023
@adoroszlai adoroszlai merged commit 2171732 into apache:master Jan 3, 2023
@adoroszlai adoroszlai deleted the HDDS-7714 branch January 3, 2023 20:03
errose28 added a commit to errose28/ozone that referenced this pull request Jan 9, 2023
* master: (176 commits)
  HDDS-7726. EC: Enhance datanode reconstruction log message (apache#4155)
  HDDS-7739. EC: Increase the information in the RM sending command log message (apache#4153)
  HDDS-7652. Volume Quota not enforced during write when bucket quota is not set (apache#4124)
  HDDS-7628. Intermittent failure in TestOzoneContainerWithTLS (apache#4142)
  HDDS-7695. EC metrics related to replication commands don't add up (apache#4152)
  HDDS-7729. EC: ECContainerReplicaCount should handle pending delete of unhealthy replicas (apache#4146)
  HDDS-7738. SCM terminates when adding container to a closed pipeline (apache#4154)
  HDDS-7243. Remove RequestFeatureValidator from echoRPC method which supports only ValidationCondition.OLDER_CLIENT_REQUESTS (apache#4051)
  HDDS-7708. No check for certificate duration config scenarios. (apache#4149)
  HDDS-7727. EC: SCM unregistered event handler for DatanodeCommandCountUpdated (apache#4147)
  HDDS-7606. Add SCM HA support in intellij run (apache#4058)
  HDDS-7666. EC: Unrecoverable EC containers with some remaining replicas may block decommissioning (apache#4118)
  HDDS-7339. Implement Certificate renewal task for services (apache#3982)
  HDDS-7696. MisReplicationHandler does not consider QUASI_CLOSED replicas as sources (apache#4144)
  HDDS-7714. Docker cluster ozone-om-ha fails during docker-compose up (apache#4137)
  HDDS-7716. Log read requests rejected with permission denied in OM audit (apache#4136)
  HDDS-7588. Intermittent failure in TestObjectStoreWithLegacyFS#testFlatKeyStructureWithOBS (apache#4040)
  HDDS-7633. Compile error with Java 11: package com.sun.jmx.mbeanserver is not visible (apache#4077)
  HDDS-7648. Add a servername tag in UGI metrics. (apache#4094)
  HDDS-7564. Update Ozone version after 1.3.0 release (apache#4115)
  ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working test

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants