-
Notifications
You must be signed in to change notification settings - Fork 588
HDDS-10218. Speed up TestSstFilteringService #6196
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
adoroszlai
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks @raju-balpande for the patch.
...op-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/TestSstFilteringService.java
Outdated
Show resolved
Hide resolved
...op-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/TestSstFilteringService.java
Outdated
Show resolved
Hide resolved
adoroszlai
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks @raju-balpande for updating the patch, LGTM.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I would avoid tests ordering.
Instead of counting snapshots across these tests, I think it will be better to get the initial snapshot number in the beginning of each test:
long initialSnapshotsNum = sstFilteringService.getSnapshotFilteredCount().get();
...
waitForSnapshotsAtLeast(filteringService, initialSnapshotsNum + 1);
This will keep these tests independent.
+1 if it is possible. Otherwise patch looks good to me. |
|
The methods are independent of ordering flow when snapshots are concerned. Independent method run also works fine. but the ordering was required because checks on key operations are dependent. Clearing all the data again will consume time and there will be hardly any improvement in time. but I am trying to see if I can fix it for keys. |
|
Thanks @raju-balpande for the patch, @hemantk-12, @myskov for the review. Let's work on improving independence of test methods separately (HDDS-10346). |
(cherry picked from commit cd00691)
(cherry picked from commit cd00691)
What changes were proposed in this pull request?
Changes are done to improve the test run speed to 33.23 s as compare to 59.43 s earlier.
What is the link to the Apache JIRA
https://issues.apache.org/jira/browse/HDDS-10218
How was this patch tested?
Tested on local system and in CI-CD integration.