Skip to content

Fix for tracing context in sub-sequential and parallel operations#95

Merged
anujmodi2021 merged 11 commits intoABFS_3.3.2_devfrom
listTracingContextFix
Aug 17, 2023
Merged

Fix for tracing context in sub-sequential and parallel operations#95
anujmodi2021 merged 11 commits intoABFS_3.3.2_devfrom
listTracingContextFix

Conversation

@anujmodi2021
Copy link
Copy Markdown
Collaborator

No description provided.

Copy link
Copy Markdown
Collaborator

@saxenapranav saxenapranav left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good with code. Have suggestions around test. Thanks!

Comment on lines +42 to +41
import static org.apache.hadoop.fs.azurebfs.services.AbfsClientTestUtil.addMockBehaviourToAbfsClient;
import static org.apache.hadoop.fs.azurebfs.services.AbfsClientTestUtil.addMockBehaviourToRestOpAndHttpOp;
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

seems no new code is added here. we can remove the imports.

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These methods were moved to a utils file from where they can be used by other tests as well...

@anujmodi2021 anujmodi2021 force-pushed the listTracingContextFix branch from 2adab61 to 6c2781b Compare August 16, 2023 15:19
@anujmodi2021 anujmodi2021 changed the title Fix for list status tracing context Fix for tracing context in sub-sequential and parallel operations Aug 16, 2023
@saxenapranav saxenapranav self-requested a review August 17, 2023 04:54
Copy link
Copy Markdown
Collaborator

@snvijaya snvijaya left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@saxenapranav saxenapranav dismissed their stale review August 17, 2023 05:06

Suggestion has been taken and resolved.

list.setNextMarker("nextMarker");
}

public static void hookOnRestOpsForTracingContextSingularity(AbfsClient client) {
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we also validate that for sub ops the primary request id is same only the object is changing ? Just a minor suggestion

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Though apart from this, in any test in which tracingHeaderValidator is created, this shall be checked.
How?

the tc created by fs -> puts primaryRequestId in tracingHeaderValidator.
And the new TracingContext() doesnt change the state of tracingHeaderValidator field values (though clones it).
So any newTracingContext done will have the tracingHeaderValidator having values populated by original tc.

op.setResult(result);
}

public static void assertTracingContextInstantiationCount(final AbfsClient client, final int numberOfInstantiation) {
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This method is not used anywhere ?

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes,
It is not used anywhere...
Removing it.

@saxenapranav saxenapranav dismissed their stale review August 17, 2023 06:13

Atomicity comment taken.

@anujmodi2021 anujmodi2021 merged commit 294b483 into ABFS_3.3.2_dev Aug 17, 2023
@anujmodi2021 anujmodi2021 deleted the listTracingContextFix branch July 8, 2024 09:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants