Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Flag aws_ssm as unstable rather than disabled #295

Merged
merged 30 commits into from
Feb 15, 2021

Conversation

tremble
Copy link
Contributor

@tremble tremble commented Nov 13, 2020

SUMMARY

Flag aws_ssm as unstable rather than disabled

ISSUE TYPE
  • Bugfix Pull Request
COMPONENT NAME

aws_ssm

ADDITIONAL INFORMATION

If possible #278 should trigger integration tests...

@tremble
Copy link
Contributor Author

tremble commented Nov 13, 2020

Tests blocked by mattclay/aws-terminator#115

@tremble tremble changed the title [WIP] Flag aws_ssm as unstable rather than disabled [Pending CI Policy] Flag aws_ssm as unstable rather than disabled Nov 13, 2020
@ansibullbot ansibullbot added affects_2.10 bug This issue/PR relates to a bug integration tests/integration needs_revision This PR fails CI tests or a maintainer has requested a review/revision of the PR needs_triage tests tests labels Nov 16, 2020
@tremble tremble changed the title [Pending CI Policy] Flag aws_ssm as unstable rather than disabled Flag aws_ssm as unstable rather than disabled Nov 24, 2020
@tremble
Copy link
Contributor Author

tremble commented Nov 25, 2020

@jillr I've been tinkering with this and I'm still hitting a few things:

  1. If the connection is initiated too early then it doesn't connect properly, even with wait_for_connection. I suspect this is a bug.
  2. Windows takes a while to actually be ready. By the time it finishes 1 run we're close to the 10 minute window and aws-terminator does its thing.
  3. There is a bug in handling Unicode with Python 2.x - I wouldn't have caught this locally since I'm testing against devel /Python 3.6

The version I've just uploaded does work with Python 3.x when aws-terminator doesn't delete things. You mentioned on IRC about increasing the aws-terminator delays. Ultimately it's in our interest to have more comprehensive stable test suites, even if certain modules those tests are slow. I've opened mattclay/aws-terminator#117 to get the conversation going.

Since the vast bulk of our tests do clean-up, and the instances we use are pretty small the cost implications should be minimal.

@ansibullbot ansibullbot added connection connection plugin plugins plugin (any type) labels Jan 13, 2021
@tremble tremble changed the title Flag aws_ssm as unstable rather than disabled [WIP] Flag aws_ssm as unstable rather than disabled Jan 15, 2021
@ansibullbot ansibullbot added the WIP Work in progress label Feb 13, 2021
@tremble
Copy link
Contributor Author

tremble commented Feb 15, 2021

@jillr I've been tinkering with this for a while. Windows Instances take way too long to finish booting and get ready. I've disabled the Windows pieces so we're at least testing this on Linux. How do you feel about enabling these tests with Windows disabled?

@tremble tremble changed the title [WIP] Flag aws_ssm as unstable rather than disabled Flag aws_ssm as unstable rather than disabled Feb 15, 2021
@ansibullbot ansibullbot removed the WIP Work in progress label Feb 15, 2021
@jillr jillr merged commit fbd6fbc into ansible-collections:main Feb 15, 2021
ethemcemozkan pushed a commit to ethemcemozkan/community.aws that referenced this pull request Feb 18, 2021
* Flag aws_ssm as unstable rather than disabled

* Try tweaking the policy

* no security_token

* Use module_defaults rather than fact hack

* Fix session token env var

* Move bucket creation to avoid aws-terminator whacking it.

* Change the order of Instance creation, Windows takes longer to start.

* Add reset call to aws_ssm

* Add a wait_for_connection call at the start of the connection tests.
Reduce the delay waiting on the EC2 instances

* Explicitly call community.aws.aws_ssm - looks like 2.9 isn't redirecting properly

* Try running SSM connection tests in parallel.

* Delay a little more

* Turn file names into a variable, and make sure they're unique to the host.

* Try bumping up the instance size

* More delays...

* Remove unused imports

* Move botocore import into HAS_BOTO3 try block

* Make sure that path_unescaped initial string is unicode because out_path can be

* Don't wait for the Windows VM before starting the Linux one

* Add a note why the test is 'unstable'

* Use EBS optimized volumes to improve Windows boot speed.

* Try disabling the Windows connection test - Windows is very slow to start

* instances sometimes isn't there if the host took to long to start, use instance_ids

* changelog

* Remove duplicate wait

* Move to more modern instance type

* Don't try installing boto, it's already available in the images

* remove debugging

* Remove old (unused) inventory templates

* Add comment
@tremble tremble deleted the unstable/aws_ssm branch June 29, 2021 12:56
alinabuzachis pushed a commit to alinabuzachis/community.aws that referenced this pull request Jul 19, 2021
* Flag aws_ssm as unstable rather than disabled

* Try tweaking the policy

* no security_token

* Use module_defaults rather than fact hack

* Fix session token env var

* Move bucket creation to avoid aws-terminator whacking it.

* Change the order of Instance creation, Windows takes longer to start.

* Add reset call to aws_ssm

* Add a wait_for_connection call at the start of the connection tests.
Reduce the delay waiting on the EC2 instances

* Explicitly call community.aws.aws_ssm - looks like 2.9 isn't redirecting properly

* Try running SSM connection tests in parallel.

* Delay a little more

* Turn file names into a variable, and make sure they're unique to the host.

* Try bumping up the instance size

* More delays...

* Remove unused imports

* Move botocore import into HAS_BOTO3 try block

* Make sure that path_unescaped initial string is unicode because out_path can be

* Don't wait for the Windows VM before starting the Linux one

* Add a note why the test is 'unstable'

* Use EBS optimized volumes to improve Windows boot speed.

* Try disabling the Windows connection test - Windows is very slow to start

* instances sometimes isn't there if the host took to long to start, use instance_ids

* changelog

* Remove duplicate wait

* Move to more modern instance type

* Don't try installing boto, it's already available in the images

* remove debugging

* Remove old (unused) inventory templates

* Add comment
alinabuzachis pushed a commit to alinabuzachis/community.aws that referenced this pull request Jul 19, 2021
* Flag aws_ssm as unstable rather than disabled

* Try tweaking the policy

* no security_token

* Use module_defaults rather than fact hack

* Fix session token env var

* Move bucket creation to avoid aws-terminator whacking it.

* Change the order of Instance creation, Windows takes longer to start.

* Add reset call to aws_ssm

* Add a wait_for_connection call at the start of the connection tests.
Reduce the delay waiting on the EC2 instances

* Explicitly call community.aws.aws_ssm - looks like 2.9 isn't redirecting properly

* Try running SSM connection tests in parallel.

* Delay a little more

* Turn file names into a variable, and make sure they're unique to the host.

* Try bumping up the instance size

* More delays...

* Remove unused imports

* Move botocore import into HAS_BOTO3 try block

* Make sure that path_unescaped initial string is unicode because out_path can be

* Don't wait for the Windows VM before starting the Linux one

* Add a note why the test is 'unstable'

* Use EBS optimized volumes to improve Windows boot speed.

* Try disabling the Windows connection test - Windows is very slow to start

* instances sometimes isn't there if the host took to long to start, use instance_ids

* changelog

* Remove duplicate wait

* Move to more modern instance type

* Don't try installing boto, it's already available in the images

* remove debugging

* Remove old (unused) inventory templates

* Add comment
danielcotton pushed a commit to danielcotton/community.aws that referenced this pull request Nov 23, 2021
* Flag aws_ssm as unstable rather than disabled

* Try tweaking the policy

* no security_token

* Use module_defaults rather than fact hack

* Fix session token env var

* Move bucket creation to avoid aws-terminator whacking it.

* Change the order of Instance creation, Windows takes longer to start.

* Add reset call to aws_ssm

* Add a wait_for_connection call at the start of the connection tests.
Reduce the delay waiting on the EC2 instances

* Explicitly call community.aws.aws_ssm - looks like 2.9 isn't redirecting properly

* Try running SSM connection tests in parallel.

* Delay a little more

* Turn file names into a variable, and make sure they're unique to the host.

* Try bumping up the instance size

* More delays...

* Remove unused imports

* Move botocore import into HAS_BOTO3 try block

* Make sure that path_unescaped initial string is unicode because out_path can be

* Don't wait for the Windows VM before starting the Linux one

* Add a note why the test is 'unstable'

* Use EBS optimized volumes to improve Windows boot speed.

* Try disabling the Windows connection test - Windows is very slow to start

* instances sometimes isn't there if the host took to long to start, use instance_ids

* changelog

* Remove duplicate wait

* Move to more modern instance type

* Don't try installing boto, it's already available in the images

* remove debugging

* Remove old (unused) inventory templates

* Add comment
alinabuzachis pushed a commit to alinabuzachis/community.aws that referenced this pull request May 25, 2022
…tions#295)

* Initial integration test for aws_account_attribute

* Add AWS retries to aws_account_attribute

* changelog
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
affects_2.10 bug This issue/PR relates to a bug connection connection plugin integration tests/integration needs_revision This PR fails CI tests or a maintainer has requested a review/revision of the PR needs_triage plugins plugin (any type) tests tests
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants