Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix IndependentDisk, SubscribedCatalog and NsxtDynamicSecurityGroup flaky tests #1014

Merged
merged 7 commits into from
Mar 10, 2023

Conversation

adezxc
Copy link

@adezxc adezxc commented Mar 8, 2023

This PR fixes these flaky tests:

  • TestAccVcdIndependentDiskBasic was sometimes failing while updating the independent disk, but it seems that this is VCD's fault. The update steps were removed, and another version of this test was created, TestAccVcdIndependentDiskBasicWithUpdates that is automatically skipped on all the current versions of VCD and will be run in the new one to see if the issue is gone.
  • TestAccVcdNsxtDynamicSecurityGroupVdcGroupCriteriaWithVms was sometimes failing as it was trying to retrieve the count of member VMs, while the VMs weren't fully created, so the time.Sleep() function length was increased to accomodate for the time when VMs are still being created.
  • TestAccVcdVsphereSubscriber and TestAccVcdSubscribedCatalog were failing due to a bug in VCD versions prior to v10.4.0, so they are skipped if ran on versions that don't match that requirement.

Adam Jasinski added 3 commits March 3, 2023 17:26
Signed-off-by: Adam Jasinski <[email protected]>
Signed-off-by: Adam Jasinski <[email protected]>
Signed-off-by: Adam Jasinski <[email protected]>
Copy link
Collaborator

@adambarreiro adambarreiro left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks a lot for the improvements!

vcd/resource_vcd_subscribed_catalog_test.go Outdated Show resolved Hide resolved
.changes/v3.9.0/1014-notes.md Outdated Show resolved Hide resolved
vcd/resource_vcd_independent_disk_test.go Outdated Show resolved Hide resolved
Signed-off-by: Adam Jasinski <[email protected]>
Signed-off-by: Adam Jasinski <[email protected]>
Copy link
Collaborator

@Didainius Didainius left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks

.changes/v3.9.0/1014-notes.md Outdated Show resolved Hide resolved
.changes/v3.9.0/1014-notes.md Outdated Show resolved Hide resolved
@adezxc adezxc changed the title Fix flaky tests Fix IndependentDisk, CatalogSubscriber and NsxtDynamicSecurityGroup flaky tests Mar 10, 2023
@adezxc adezxc changed the title Fix IndependentDisk, CatalogSubscriber and NsxtDynamicSecurityGroup flaky tests Fix IndependentDisk, SubscribedCatalog and NsxtDynamicSecurityGroup flaky tests Mar 10, 2023
Signed-off-by: Adam Jasinski <[email protected]>
@adezxc adezxc merged commit 1a19a2a into vmware:main Mar 10, 2023
@adezxc adezxc deleted the skip-catalog-publish-tests branch March 10, 2023 10:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants