This repository was archived by the owner on Sep 17, 2024. It is now read-only.
-
Notifications
You must be signed in to change notification settings - Fork 41
Support running tests in full VM's #1740
Merged
Merged
Changes from 122 commits
Commits
Show all changes
130 commits
Select commit
Hold shift + click to select a range
d176f2d
Support running e2e in VM's
adam-stokes beae168
Merge branch 'master' into vm-tester-feat
adam-stokes d141a7f
Merge branch 'master' into vm-tester-feat
adam-stokes eba6d47
Merge branch 'master' into vm-tester-feat
adam-stokes 320fe92
bump log level to trace
adam-stokes ef41720
Update .ci/Jenkinsfile
adam-stokes 8d2e855
Update .ci/Jenkinsfile
adam-stokes 2775cf7
Update .ci/Jenkinsfile
adam-stokes 91b96b8
use provision-stack as tag instead
adam-stokes ab742ac
dont test ubi8
adam-stokes 08d7dba
cleanup steps
adam-stokes 3b09b21
Merge branch 'master' into vm-tester-feat
adam-stokes c34d2a9
Merge branch 'master' into vm-tester-feat
adam-stokes e5377df
Update steps to account for running inside vms
adam-stokes 07de556
fix reference
adam-stokes c8bab86
Merge branch 'master' into vm-tester-feat
adam-stokes e1f8f9b
Update endpoint querying for components
adam-stokes 56f4a99
install docker instack
adam-stokes ab921f9
Use go-sysinfo
adam-stokes c87b8cc
limit deploy for debugging
adam-stokes 7348239
use gopsutil
adam-stokes 2485c3c
fix go mod
adam-stokes d999740
add ci readme
adam-stokes 8e16567
fix teardown, update doc
adam-stokes 8ab5ad8
cleanup teardown
adam-stokes cf204df
emacs failed me
adam-stokes 73d403d
Fix background process matcher
adam-stokes 6e0543c
Update .ci/README.md
adam-stokes 2fd82d6
renable a few more tests
adam-stokes 44fac1d
update numagents
adam-stokes 3b4bd21
add support for installing process for running on beats in tar mode
adam-stokes 6f2ab4e
more ignores
adam-stokes 13b37c7
Update ansible to support all suites
adam-stokes 4eea736
Alter e2e-test.yaml and cleanup jenkinsfile
adam-stokes 061182f
Remove sleep between restarts and expand debug
adam-stokes cb18447
cleanup feature files based on manual testing
adam-stokes 13ebe79
cleanup inventory on destroy
adam-stokes b860cc1
debug why hosts file aren't existing
adam-stokes 2a0b8c1
attempt to fix rsync location when copying over
adam-stokes a859252
provide additional wait time for gather facts to work
adam-stokes d8aad01
typo of course
adam-stokes b0e9267
move checking of git modified up further in execution
adam-stokes 5d19010
typo
adam-stokes 898c9f9
off by 1
adam-stokes 734acee
debug null testrunner
adam-stokes c05086e
increase machine count
adam-stokes b9a061a
Merge branch 'master' into vm-tester-feat
adam-stokes b6a127b
fix go install/perms
adam-stokes a73dc32
fix paths
adam-stokes 5ed23d8
fix env for elastic-package testing
adam-stokes ec5c918
fix count
adam-stokes 5452a40
fix labels
adam-stokes b8f0153
fix provision numbers
adam-stokes 8077e3e
Merge branch 'master' into vm-tester-feat
adam-stokes e7a4901
fix count
adam-stokes 3181881
count
adam-stokes ad3b915
drive machine deploy count with e2e-tests.yaml
adam-stokes aee47b3
Merge branch 'master' into vm-tester-feat
adam-stokes 8249e2b
keep environments cleaned based on host groups
adam-stokes d5ef13e
expan openfile limit
adam-stokes 4c0eee7
expand sleep between agent restarts
adam-stokes d35ea99
bypass restart agent for now
adam-stokes 22219ae
dont attempt to delete enrollment key if CurrentTokenID is empty
adam-stokes 4a5ce2a
Upgrade ebs volume, increase serveraliveinterval in ssh connection
adam-stokes b4f8539
turn on ebs optimization
adam-stokes 5b639dc
increase timeout wait in restart of elastic-agent
adam-stokes ba82e8c
Merge branch 'master' into vm-tester-feat
adam-stokes 861d466
reduce logging to see if its a buffer issue
adam-stokes 0cbafc1
node provisioning individually
adam-stokes c19a6e6
fix reference
adam-stokes 181df2b
fix iterpolation
adam-stokes 83e2ef3
fix call to stack
adam-stokes b49b49a
fix reference to stackmachine
adam-stokes bb6ecb0
fix provider check
adam-stokes bb04003
fix property caller
adam-stokes 88d0981
use dir fix
adam-stokes bf261d0
use an updated stash after stack deployment
adam-stokes 8d13988
push stash outside of dir
adam-stokes 8714074
make sure ssh key exists on withNode
adam-stokes c97af1b
dont use dir
adam-stokes 71ffdc3
fix location access on nodes
adam-stokes f07a2b3
more workspace fixes
adam-stokes caaf073
debug
adam-stokes 0be6a8e
attempt to fix workspace location on withnode
adam-stokes bbbb88e
re-enable all tests, see what breaks
adam-stokes 69ff2cf
fix cleanup
adam-stokes 667048e
add ssh verbosity to determine connection closed
adam-stokes 498cfa0
also make sure keepalive is on
adam-stokes 6fe92c3
dont destroy vms
adam-stokes 8410e0d
fix tear down orchestration, switch to debian
adam-stokes cfea70d
make sure e2essh key exists for nodes
adam-stokes 08fe37e
fix property calling
adam-stokes 7c927ce
make sure caches are updated
adam-stokes d451e33
fix teardown
adam-stokes 01be200
Fix log capture, verify elastic-agent before restarting
adam-stokes 2f582c4
Merge branch 'master' into vm-tester-feat
adam-stokes d7a610d
focus on backend process
adam-stokes e2abe42
capture agent data from each node
adam-stokes c09c3b2
expand debug, capture earlier
adam-stokes b4fd69a
make policies unique for each scenario
adam-stokes 4fbdce9
fix scp
adam-stokes 4bc9d65
Merge branch 'master' into vm-tester-feat
adam-stokes afe1541
retry policy creation if failed
adam-stokes 224fd3a
Merge branch 'vm-tester-feat' of github.com:elastic/e2e-testing into …
adam-stokes e85094e
make sure a name is associated with policy
adam-stokes 1645e1a
better handle missing policy info
adam-stokes 2b8b59b
more guards around failed response from kibana on policy creation
adam-stokes eb59238
bail out if enrollment token fails to be created
adam-stokes 95098b6
fix reference
adam-stokes e9625b0
do not clear out policies on afterscenario
adam-stokes b4e6c49
more guards
adam-stokes 69418e3
400 server error doesnt actually respond with an error
adam-stokes 77173fc
return actual error when status is not 200
adam-stokes b96c7a6
get proper response parsed for debugging
adam-stokes 8b7b4a1
Merge branch 'master' into vm-tester-feat
adam-stokes fe1ffdd
fix policy creation
adam-stokes 54d3140
Merge branch 'vm-tester-feat' of github.com:elastic/e2e-testing into …
adam-stokes fd368ac
fix policy integration verification
adam-stokes 81dadf2
comment out broken tests
adam-stokes a9c6065
update ci doc and re-enable remaining stages
adam-stokes e8e9942
make note of failing test for checking arch
adam-stokes 2c027df
try newer ubuntu for precommit
adam-stokes b7aa118
use platforms keyword, fix git skip checks, readability updates
adam-stokes 27cbd73
move elasticcredentials into es endpoint struct
adam-stokes 9f7caeb
make notice
adam-stokes 58cc2cf
move force git check into e2e stage prior to checktestsuite
adam-stokes e91746c
utilize skip_tests in matching changed git files
adam-stokes cbfdf91
Merge branch 'master' into vm-tester-feat
adam-stokes 7994852
add force skip git checks on unit test stage
adam-stokes 6cd07fa
Merge branch 'vm-tester-feat' of github.com:elastic/e2e-testing into …
adam-stokes File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,44 +1,51 @@ | ||
| --- | ||
| MACHINES: | ||
| stack: | ||
| image: "ami-0d90bed76900e679a" | ||
| instance_type: "c5.4xlarge" | ||
| helm: | ||
| image: "ami-0d90bed76900e679a" | ||
| instance_type: "c5.2xlarge" | ||
| fleet_arm64: | ||
| image: "ami-06dac44ad759182bd" | ||
| instance_type: "a1.large" | ||
| fleet_amd64: | ||
| image: "ami-0d90bed76900e679a" | ||
| instance_type: "c5.4xlarge" | ||
| fleet_elastic_pkg: | ||
| image: "ami-0d90bed76900e679a" | ||
| instance_type: "c5.4xlarge" | ||
| kubernetes_autodiscover: | ||
| image: "ami-0d90bed76900e679a" | ||
| instance_type: "c5.4xlarge" | ||
|
|
||
| SUITES: | ||
| - suite: "fleet" | ||
| platforms: | ||
| - labels: "arm64" | ||
| - labels: "ubuntu-18.04" | ||
| provider: "elastic-package" | ||
| scenarios: | ||
| - name: "Fleet" | ||
| pullRequestFilter: " && ~debian" | ||
| tags: "fleet_mode_agent" | ||
| platforms: | ||
| - labels: "ubuntu-18.04" | ||
| provider: "elastic-package" | ||
| platforms: ["fleet_arm64", "fleet_amd64"] | ||
| - name: "Integrations" | ||
| pullRequestFilter: " && ~debian" | ||
| tags: "integrations" | ||
| platforms: ["fleet_arm64", "fleet_amd64"] | ||
| - name: "APM Integration" | ||
| pullRequestFilter: " && ~debian" | ||
| tags: "apm_server" | ||
| platforms: ["fleet_elastic_pkg"] | ||
| - name: "Linux Integration" | ||
| pullRequestFilter: " && ~debian" | ||
| tags: "linux_integration" | ||
| - name: "Permissions Output change" | ||
| pullRequestFilter: " && ~debian" | ||
| tags: "permission_change" | ||
| - name: "System Integration" | ||
| platforms: | ||
| - labels: "ubuntu-18.04" | ||
| provider: "elastic-package" | ||
| pullRequestFilter: " && ~debian" | ||
| tags: "system_integration" | ||
| - name: "Stand-alone" | ||
| platforms: | ||
| - labels: "ubuntu-18.04" | ||
| provider: "elastic-package" | ||
| pullRequestFilter: " && ~ubi8" | ||
| tags: "stand_alone_agent" | ||
| platforms: ["fleet_arm64", "fleet_amd64"] | ||
| # - name: "Permissions Output change" | ||
| # tags: "permission_change" | ||
| # platforms: ["fleet_arm64", "fleet_amd64"] | ||
| # - name: "System Integration" | ||
| # tags: "system_integration" | ||
| # platforms: ["fleet_arm64", "fleet_amd64"] | ||
| # - name: "Stand-alone" | ||
| # tags: "stand_alone_agent" | ||
| # platforms: ["fleet_elastic_pkg"] | ||
| - name: "Backend Processes" | ||
| pullRequestFilter: " && ~debian" | ||
| tags: "backend_processes" | ||
| platforms: ["fleet_arm64", "fleet_amd64"] | ||
| - name: "Beats Background Processes" | ||
| pullRequestFilter: " && ~debian" | ||
| tags: "running_on_beats" | ||
| platforms: ["fleet_arm64", "fleet_amd64"] | ||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,71 +1,76 @@ | ||
| --- | ||
| MACHINES: | ||
| stack: | ||
| image: "ami-0d90bed76900e679a" | ||
| instance_type: "c5.4xlarge" | ||
| helm: | ||
| image: "ami-0d90bed76900e679a" | ||
| instance_type: "c5.2xlarge" | ||
| fleet_arm64: | ||
| image: "ami-06dac44ad759182bd" | ||
| instance_type: "a1.large" | ||
| fleet_amd64: | ||
| image: "ami-0d90bed76900e679a" | ||
| instance_type: "c5.4xlarge" | ||
| fleet_elastic_pkg: | ||
| image: "ami-0d90bed76900e679a" | ||
| instance_type: "c5.4xlarge" | ||
| kubernetes_autodiscover: | ||
| image: "ami-0d90bed76900e679a" | ||
| instance_type: "c5.4xlarge" | ||
|
|
||
| SUITES: | ||
| - suite: "helm" | ||
| platforms: | ||
| - labels: "ubuntu-18.04" | ||
| scenarios: | ||
| - name: "APM Server" | ||
| tags: "apm-server" | ||
| platforms: ["helm"] | ||
| - name: "Filebeat" | ||
| tags: "filebeat" | ||
| platforms: ["helm"] | ||
| - name: "Metricbeat" | ||
| tags: "metricbeat" | ||
| platforms: ["helm"] | ||
| - suite: "fleet" | ||
| platforms: | ||
| - labels: "arm64" | ||
| - labels: "ubuntu-18.04" | ||
| provider: "elastic-package" | ||
| scenarios: | ||
| - name: "Fleet" | ||
| pullRequestFilter: " && ~debian" | ||
| tags: "fleet_mode_agent" | ||
| platforms: | ||
| - labels: "ubuntu-18.04" | ||
| provider: "elastic-package" | ||
| - labels: "windows-2019" | ||
| provider: "elastic-package" | ||
| platforms: ["fleet_arm64", "fleet_amd64"] | ||
| - name: "Integrations" | ||
| pullRequestFilter: " && ~debian" | ||
| tags: "integrations" | ||
| platforms: ["fleet_arm64", "fleet_amd64"] | ||
| - name: "APM Integration" | ||
| pullRequestFilter: " && ~debian" | ||
| tags: "apm_server" | ||
| platforms: ["fleet_elastic_pkg"] | ||
| - name: "Linux Integration" | ||
| pullRequestFilter: " && ~debian" | ||
| tags: "linux_integration" | ||
| - name: "Permissions Output change" | ||
| pullRequestFilter: " && ~debian" | ||
| tags: "permission_change" | ||
| - name: "Policies" | ||
| pullRequestFilter: " && ~debian" | ||
| tags: "policies" | ||
| - name: "System Integration" | ||
| platforms: | ||
| - labels: "ubuntu-18.04" | ||
| provider: "elastic-package" | ||
| pullRequestFilter: " && ~debian" | ||
| tags: "system_integration" | ||
| - name: "Stand-alone" | ||
| platforms: | ||
| - labels: "ubuntu-18.04" | ||
| provider: "elastic-package" | ||
| pullRequestFilter: " && ~ubi8" | ||
| tags: "stand_alone_agent" | ||
| platforms: ["fleet_arm64", "fleet_amd64"] | ||
| # - name: "Permissions Output change" | ||
| # tags: "permission_change" | ||
| # platforms: ["fleet_arm64", "fleet_amd64"] | ||
| # - name: "System Integration" | ||
| # tags: "system_integration" | ||
| # platforms: ["fleet_arm64", "fleet_amd64"] | ||
| # - name: "Stand-alone" | ||
| # tags: "stand_alone_agent" | ||
| # platforms: ["fleet_elastic_pkg"] | ||
| - name: "Backend Processes" | ||
| pullRequestFilter: " && ~debian" | ||
| tags: "backend_processes" | ||
| platforms: ["fleet_arm64", "fleet_amd64"] | ||
| - name: "Beats Background Processes" | ||
| pullRequestFilter: " && ~debian" | ||
| tags: "running_on_beats" | ||
| platforms: ["fleet_arm64", "fleet_amd64"] | ||
| - suite: "kubernetes-autodiscover" | ||
| platforms: | ||
| - labels: "ubuntu-18.04" | ||
| scenarios: | ||
| - name: "kubernetes autodiscover with elastic-agent" | ||
| tags: "kubernetes-autodiscover && elastic-agent" | ||
| tags: "elastic-agent" | ||
| platforms: ["kubernetes_autodiscover"] | ||
| - name: "kubernetes autodiscover with filebeat" | ||
| tags: "kubernetes-autodiscover && filebeat" | ||
| tags: "filebeat" | ||
| platforms: ["kubernetes_autodiscover"] | ||
| - name: "kubernetes autodiscover with heartbeat" | ||
| tags: "kubernetes-autodiscover && heartbeat" | ||
| tags: "heartbeat" | ||
| platforms: ["kubernetes_autodiscover"] | ||
| - name: "kubernetes autodiscover with metricbeat" | ||
| tags: "kubernetes-autodiscover && metricbeat" | ||
| tags: "metricbeat" | ||
| platforms: ["kubernetes_autodiscover"] |
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.