Skip to content

Conversation

@ashishkumar50
Copy link
Contributor

What changes were proposed in this pull request?

Enable topology aware replication and read by default.

What is the link to the Apache JIRA

https://issues.apache.org/jira/browse/HDDS-8300

How was this patch tested?

Test using TestSCMContainerPlacementRackAware integration test.

@adoroszlai adoroszlai marked this pull request as draft March 29, 2023 12:24
@adoroszlai
Copy link
Contributor

Topology-aware read breaks EC file checksums (HDDS-8276). I have converted this to draft, because we need to fix that first.

@adoroszlai
Copy link
Contributor

@ashishkumar50 After fixing HDDS-8276, the following problems are left:

Can you please check?

@ashishkumar50
Copy link
Contributor Author

@adoroszlai , TestXceiverClientGrpc test issue is fixed, we need to disable topology read for shuffle read from DN which is used in testRandomFirstNodeIsCommandTarget case.
Another test case testFirstNodeIsCorrectWithTopologyForCommandTarget which is meant for sortedDN always.

@adoroszlai
Copy link
Contributor

Filed HDDS-8364 for the bug in read-replicas, being fixed in #4522.

@kerneltime kerneltime requested a review from ChenSammi April 3, 2023 16:17
@adoroszlai adoroszlai marked this pull request as ready for review April 4, 2023 06:37
Comment on lines 165 to 173
@Test
public void testDefaultPolicy() throws IOException {
public void testRackAwareContainerPolicy() throws IOException {
conf.set(ScmConfigKeys.OZONE_SCM_CONTAINER_PLACEMENT_IMPL_KEY,
SCMContainerPlacementRackAware.class.getName());
PlacementPolicy policy = ContainerPlacementPolicyFactory
.getPolicy(conf, null, null, true, null);
Assertions.assertSame(SCMContainerPlacementRandom.class, policy.getClass());
Assertions.assertSame(SCMContainerPlacementRackAware.class,
policy.getClass());
}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would have preferred keeping the intention of this test: testing default setting. Sorry for not noticing this earlier.

Copy link
Contributor

@adoroszlai adoroszlai left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sorry @ashishkumar50 for the late notice, but after checking results of TestDecommissionAndMaintenance, it seems testContainerIsReplicatedWhenAllNodesGotoMaintenance is consistently failing (timing out).

@adoroszlai
Copy link
Contributor

Created HDDS-8383 for the bug revealed by TestDecommissionAndMaintenance#testContainerIsReplicatedWhenAllNodesGotoMaintenance, being fixed in #4539.

@adoroszlai adoroszlai marked this pull request as draft April 11, 2023 12:47
@adoroszlai adoroszlai marked this pull request as ready for review April 11, 2023 18:24
@adoroszlai adoroszlai merged commit eaf7f9a into apache:master Apr 12, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants