Skip to content

Conversation

@adoroszlai
Copy link
Contributor

What changes were proposed in this pull request?

Switch ozone-runner to the latest image, based on Rocky Linux 8.9, from CentOS 7, which has reached end-of-life.

  • Package manager is dnf, not yum.

  • dns_search: . is needed in GitHub CI to prevent the following type of error when using curl with SPNEGO:

    * gss_init_sec_context() failed: Server krbtgt/[email protected] not found in Kerberos database. 
    
  • ssh login (used in ozonescripts env.) is disabled until admin deletes some nologin marker files.

  • Now test in ozonescripts environment can be enabled again. This uncovered the problem that variables from docker-config are not present in the environment when logging in via ssh. So Ozone in ozonescripts uses /opt/hadoop/logs as log dir:

    48fe5c710cdf: WARNING: /opt/hadoop/logs does not exist. Creating.
    

    which is no longer works in CI after HDDS-11103:

    12f83b75a27a: WARNING: /opt/hadoop/logs does not exist. Creating.
    12f83b75a27a: mkdir: cannot create directory '/opt/hadoop/logs': Permission denied
    12f83b75a27a: ERROR: Unable to create /opt/hadoop/logs. Aborting.
    

    This is fixed by setting OZONE_CONF_DIR and OZONE_LOG_DIR in SSH environment, too.

https://issues.apache.org/jira/browse/HDDS-11166

How was this patch tested?

CI:
https://github.com/adoroszlai/ozone/actions/runs/9919391847

@adoroszlai adoroszlai self-assigned this Jul 13, 2024
@adoroszlai adoroszlai requested a review from smengcl July 13, 2024 19:07
@adoroszlai adoroszlai changed the title HDDS-11166. Bump ozone-runner to Rocky Linux-based HDDS-11166. Switch to Rocky Linux-based ozone-runner Jul 15, 2024
Copy link
Contributor

@dombizita dombizita left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for working on this and the detailed description @adoroszlai, the changes are making sense to me.

@adoroszlai adoroszlai merged commit 6fa74bb into apache:master Jul 17, 2024
@adoroszlai adoroszlai deleted the HDDS-11166 branch July 17, 2024 06:43
@adoroszlai
Copy link
Contributor Author

Thanks @dombizita for the review.

errose28 added a commit to errose28/ozone that referenced this pull request Jul 30, 2024
…-delete

* HDDS-10239-container-reconciliation: (184 commits)
  HDDS-10373. Implement framework for capturing Merkle Tree Metrics. (apache#6864)
  HDDS-11188. Initial setup for new UI layout and enable users to switch to new UI (apache#6953)
  HDDS-11120. Rich rebalancing status info (apache#6911)
  HDDS-11187. Fix Event Handling in Recon OMDBUpdatesHandler to Prevent ClassCastException. (apache#6950)
  HDDS-11213. Bump commons-daemon to 1.4.0 (apache#6971)
  HDDS-11212. Bump commons-net to 3.11.1 (apache#6973)
  HDDS-11211. Bump assertj-core to 3.26.3 (apache#6972)
  HDDS-11210. Bump log4j2 to 2.23.1 (apache#6970)
  HDDS-11150. Recon Overview page crashes due to failed API Calls (apache#6944)
  HDDS-11183. Keys from DeletedTable and DeletedDirTable of AOS should be deleted on batch operation while creating a snapshot (apache#6946)
  HDDS-11198. Fix Typescript configs for Recon (apache#6961)
  HDDS-11180. Simplify HttpServer2#inferMimeType return statement (apache#6963)
  HDDS-11194. OM missing audit log for upgrade (apache#6958)
  HDDS-10389. Implement a search feature for users to locate open keys within the Open Keys Insights section. (apache#6231)
  HDDS-10561. Dashboard for delete key metrics (apache#6948)
  HDDS-11192. Increase SPNEGO URL test coverage (apache#6956)
  HDDS-11179. DBConfigFromFile#readFromFile result of toIOException not thrown (apache#6957)
  HDDS-11186. First container log missing from bundle (apache#6952)
  HDDS-10844. Clarify snapshot create error message. (apache#6955)
  HDDS-11166. Switch to Rocky Linux-based ozone-runner (apache#6942)
  ...
adoroszlai added a commit to adoroszlai/ozone that referenced this pull request Jan 28, 2025
adoroszlai added a commit to adoroszlai/ozone that referenced this pull request Jan 28, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants