Skip to content

Conversation

@smengcl
Copy link
Contributor

@smengcl smengcl commented Aug 28, 2020

What changes were proposed in this pull request?

Set fs.defaultFS in docker compose cluster config to OFS by default.

This shouldn't impact any existing tests. This makes life easier when developer manually logs into the cluster and use hadoop fs commands. e.g. ozone fs -ls / can easily list all volumes in the test cluster with OFS.

Previous discussion at #1352 (comment)

What is the link to the Apache JIRA

https://issues.apache.org/jira/browse/HDDS-4161

How was this patch tested?

This change should only affect the robot test infra.
All existing tests (including robot tests) should pass as-is.

(cherry picked from commit ba080fc9e6ef4391864417ac1daf0d2953712aae)
(cherry picked from commit 4593e8a)
@smengcl smengcl added the test label Aug 28, 2020
@smengcl smengcl requested a review from adoroszlai August 28, 2020 16:19
@smengcl smengcl self-assigned this Aug 28, 2020
Change-Id: I06f1568e821b2d8b902a3c4d20d3c92372e4976d
Copy link
Contributor

@adoroszlai adoroszlai left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @smengcl for extracting this change to a separate PR. LGTM.

FYI, there are two cases where O3FS is still the default:

hadoop-ozone/dist/src/main/compose/ozone-mr/common-config
33:CORE-SITE.xml_fs.defaultFS=o3fs://bucket1.volume1/

hadoop-ozone/dist/src/main/compose/ozone-ha/docker-config
17:CORE-SITE.XML_fs.defaultFS=o3fs://bucket1.volume1.omservice

The first one is used by tests, the second one is disabled currently.

@smengcl
Copy link
Contributor Author

smengcl commented Sep 5, 2020

Thanks @smengcl for extracting this change to a separate PR. LGTM.

FYI, there are two cases where O3FS is still the default:

hadoop-ozone/dist/src/main/compose/ozone-mr/common-config
33:CORE-SITE.xml_fs.defaultFS=o3fs://bucket1.volume1/

hadoop-ozone/dist/src/main/compose/ozone-ha/docker-config
17:CORE-SITE.XML_fs.defaultFS=o3fs://bucket1.volume1.omservice

The first one is used by tests, the second one is disabled currently.

Good catch @adoroszlai . I have updated the PR.

@smengcl smengcl merged commit b12f6b6 into apache:master Sep 6, 2020
llemec pushed a commit to llemec/hadoop-ozone that referenced this pull request Sep 15, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants