Skip to content

Conversation

@elek
Copy link
Member

@elek elek commented Jan 28, 2021

What changes were proposed in this pull request?

I executed a simple ozone command ("ozone admin pipeline list") on my latest deploy and got a warning:

ozone admin pipeline list
WARNING: OZONE_CONF_DIR not defined and cannot be found, setting in OZONE_HOME: /opt/ozone/etc/hadoop.

Same with bash debug log (set -x):

++ local conf_dir=etc/hadoop
++ [[ -n '' ]]
++ [[ -n /opt/ozone ]]
++ ozone_verify_confdir /opt/ozone/etc/hadoop
++ [[ -f /log4j.properties ]]
++ [[ -n /opt/ozone/libexec ]]
++ ozone_verify_confdir /opt/ozone/libexec/../etc/hadoop
++ [[ -f /log4j.properties ]]
++ OZONE_CONF_DIR=/opt/ozone/etc/hadoop
++ ozone_error 'WARNING: OZONE_CONF_DIR not defined and cannot be found, setting in OZONE_HOME: /opt/ozone/etc/hadoop.'
++ echo 'WARNING: OZONE_CONF_DIR not defined and cannot be found, setting in OZONE_HOME: /opt/ozone/etc/hadoop.'
WARNING: OZONE_CONF_DIR not defined and cannot be found, setting in OZONE_HOME: /opt/ozone/etc/hadoop.

This error supposed to be hidden as conf dir is under the default location (/opt/ozone/etc/hadoop).

What is the link to the Apache JIRA

https://issues.apache.org/jira/browse/HDDS-4757

How was this patch tested?

Executed "ozone version" with and without the patch in your host os (without docker) whete HADOOP/OZONE_CONF_DIR is not set.

Copy link
Contributor

@adoroszlai adoroszlai left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @elek for finding and fixing this bug.

$ bin/ozone version
                  //////////////
               ////////////////////
            ////////     ////////////////
           //////      ////////////////
          /////      ////////////////  /
         /////            ////////   ///
         ////           ////////    /////
        /////         ////////////////
        /////       ////////////////   //
         ////     ///////////////   /////
         /////  ///////////////     ////
          /////       //////      /////
           //////   //////       /////
             ///////////     ////////
               //////  ////////////
               ///   //////////
              /    1.1.0-SNAPSHOT(Denali)

@adoroszlai
Copy link
Contributor

@elek I have added an assertion to make sure this is covered by CI, hope you don't mind.

@elek
Copy link
Member Author

elek commented Jan 29, 2021

@elek I have added an assertion to make sure this is covered by CI, hope you don't mind.

Absolutely, thank you very much.

OFF: I also noticed a few (false positive?) ERROR logs in the console. It's a different story, but similar: I am thinking to check all WARNINGS and ERRORS in the console output and the log and fail if any. (During normal run they shouldn't be there).

@adoroszlai adoroszlai merged commit 59bfb6a into apache:master Jan 29, 2021
errose28 added a commit to errose28/ozone that referenced this pull request Feb 1, 2021
* master: (176 commits)
  HDDS-4760. Intermittent failure in ozone-ha acceptance test (apache#1853)
  HDDS-4770. Upgrade Ratis Thirdparty to 0.6.0 (apache#1868)
  HDDS-4765. Update close-pending workflow for new repo (apache#1856)
  HDDS-4737. Add ModifierOrder to checkstyle rules (apache#1839)
  HDDS-4704. Add permission check in OMDBCheckpointServlet (apache#1801)
  HDDS-4757. Unnecessary WARNING to set OZONE_CONF_DIR (apache#1849)
  HDDS-4751. TestOzoneFileSystem#testTrash failed when enabledFileSystemPaths and omRatisDisabled (apache#1851)
  HDDS-4736. Intermittent failure in testExpiredCertificate (apache#1838)
  HDDS-4758. Adjust classpath of ozone version to include log4j (apache#1850)
  HDDS-4518. Add metrics around Trash Operations. (apache#1832)
  HDDS-4708. Optimization: update RetryCount less frequently (update once per ~100) (apache#1805)
  HDDS-4748. sonarqube issue fix - "static" members should be accessed statically (apache#1748)
  HDDS-2402. Adapt hadolint check to improved CI framework (apache#1778)
  HDDS-4698. Upgrade Java for Sonar check (apache#1800)
  HDDS-4739. Upgrade Ratis to 1.1.0-eb66796d-SNAPSHOT (apache#1842)
  HDDS-4735. Fix typo in hdds.proto (apache#1837)
  HDDS-4430. OM failover timeout is too short (apache#1807)
  HDDS-4477. Delete txnId in SCMMetadataStoreImpl may drop to 0 after SCM restart. (apache#1828)
  HDDS-4688. Update Hadoop version to 3.2.2 (apache#1795)
  HDDS-4725. Change metrics unit from nanosecond to millisecond (apache#1823)
  ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants