Skip to content
This repository was archived by the owner on Sep 17, 2024. It is now read-only.

Conversation

@mdelapenya
Copy link
Contributor

What does this PR do?

This PR adds the recently added "x-pack's MSSQL integration for metricbeat" to the Metricbeat test suite. We need to massage the configuration files a bit, that's why we are adding a new sanitizer for the incoming config files from Beats repo, whic basically means applying MSSQL Server's default credentials: (user: sa, password 1234_asdf).

Why is it important?

We found that the MSSQL Server integration was broken in Beats (see elastic/beats#26440) , and for that reason we want to add this test as part of the regression test suite.

Checklist

  • My code follows the style guidelines of this project
  • I have commented my code, particularly in hard-to-understand areas
  • I have made corresponding changes to the documentation
  • I have made corresponding change to the default configuration files
  • I have added tests that prove my fix is effective or that my feature works
  • I have run the Unit tests (make unit-test), and they are passing locally
  • I have run the End-2-End tests for the suite I'm working on, and they are passing locally
  • I have noticed new Go dependencies (run make notice in the proper directory)

Author's Checklist

  • [ ]

How to test this PR locally

To run the unit tests:

make unit-test

To run the E2E tests for the new integration:

TAGS="integrations && mssql" TIMEOUT_FACTOR=3 LOG_LEVEL=TRACE DEVELOPER_MODE=true make -C e2e/_suites/metricbeat functional-test

Related issues

@mdelapenya mdelapenya self-assigned this Jun 29, 2021
@mdelapenya mdelapenya requested review from a team and jsoriano June 29, 2021 07:22
Comment on lines +67 to +68
replacedContent := strings.ReplaceAll(content, `domain\username`, "sa")
replacedContent = strings.ReplaceAll(replacedContent, "verysecurepassword", "1234_asdf")
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Apply default credentials in metricbeat's configuration

@mdelapenya mdelapenya marked this pull request as ready for review June 29, 2021 07:25
@elasticmachine
Copy link
Contributor

💔 Tests Failed

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: Pull request #1304 opened

  • Start Time: 2021-06-29T07:22:51.119+0000

  • Duration: 37 min 20 sec

  • Commit: 576142e

Test stats 🧪

Test Results
Failed 4
Passed 214
Skipped 0
Total 218

Trends 🧪

Image of Build Times

Image of Tests

Test errors 4

Expand to view the tests failures

Initializing / End-To-End Tests / ubuntu-18.04_fleet_agent_endpoint_integration / Deploying an Endpoint makes policies to appear in the Security App – Agent Endpoint Integration
    Expand to view the error details

     Step the policy response will be shown in the Security App: The policy response is not listed as 'success' in the Administration view in the Security App yet 
    

  • no stacktrace
Initializing / End-To-End Tests / ubuntu-18.04_fleet_agent_endpoint_integration / Changing an Agent policy is reflected in the Security App – Agent Endpoint Integration
    Expand to view the error details

     Step the policy will reflect the change in the Security App: Error getting response from Elasticsearch. Status: 404 Not Found, ResponseError: map[error:map[index:logs-elastic_agent-default index_uuid:_na_ reason:no such index [logs-elastic_agent-default] resource.id:logs-elastic_agent-default resource.type:index_or_alias root_cause:[map[index:logs-elastic_agent-default index_uuid:_na_ reason:no such index [logs-elastic_agent-default] resource.id:logs-elastic_agent-default resource.type:index_or_alias type:index_not_found_exception]] type:index_not_found_exception] status:404] 
    

  • no stacktrace
Initializing / End-To-End Tests / ubuntu-18.04_fleet_fleet_mode_agent / Revoking the enrollment token for the centos agent – Fleet Mode Agent
    Expand to view the error details

     Step an attempt to enroll a new agent fails: The agent was enrolled although the token was previously revoked 
    

  • no stacktrace
Initializing / End-To-End Tests / arm64_fleet_fleet_mode_agent / Revoking the enrollment token for the centos agent – Fleet Mode Agent
    Expand to view the error details

     Step an attempt to enroll a new agent fails: The agent was enrolled although the token was previously revoked 
    

  • no stacktrace

Steps errors 3

Expand to view the steps failures

Run functional tests for fleet:fleet_mode_agent && ~@nightly && ~debian && ~@skip:arm64
  • Took 13 min 3 sec . View more details on here
  • Description: .ci/scripts/functional-test.sh "fleet" "fleet_mode_agent && ~@nightly && ~debian && ~@skip:arm64" "8.0.0-SNAPSHOT" "8.0.0-SNAPSHOT"
Run functional tests for fleet:fleet_mode_agent && ~@nightly && ~debian && ~@skip:amd64
  • Took 12 min 10 sec . View more details on here
  • Description: .ci/scripts/functional-test.sh "fleet" "fleet_mode_agent && ~@nightly && ~debian && ~@skip:amd64" "8.0.0-SNAPSHOT" "8.0.0-SNAPSHOT"
Run functional tests for fleet:agent_endpoint_integration && ~@nightly && ~debian && ~@skip:amd64
  • Took 25 min 53 sec . View more details on here
  • Description: .ci/scripts/functional-test.sh "fleet" "agent_endpoint_integration && ~@nightly && ~debian && ~@skip:amd64" "8.0.0-SNAPSHOT" "8.0.0-SNAPSHOT"

Log output

Expand to view the last 100 lines of log output

[2021-06-29T07:56:47.824Z] time="2021-06-29T07:56:47Z" level=error msg="Could not get agent events from Fleet" agentID=fa150e25-f09c-47e4-aba4-7e6d61fe5c79 application=endpoint-security error="Error getting response from Elasticsearch. Status: 404 Not Found, ResponseError: map[error:map[index:logs-elastic_agent-default index_uuid:_na_ reason:no such index [logs-elastic_agent-default] resource.id:logs-elastic_agent-default resource.type:index_or_alias root_cause:[map[index:logs-elastic_agent-default index_uuid:_na_ reason:no such index [logs-elastic_agent-default] resource.id:logs-elastic_agent-default resource.type:index_or_alias type:index_not_found_exception]] type:index_not_found_exception] status:404]" packagePolicyID=a93a004a-85e2-4e77-9706-8b801784694d result="map[]"
[2021-06-29T07:56:47.824Z] time="2021-06-29T07:56:47Z" level=warning msg="There are no events for the agent in Fleet" elapsedTime=9m15.047849504s err="Error getting response from Elasticsearch. Status: 404 Not Found, ResponseError: map[error:map[index:logs-elastic_agent-default index_uuid:_na_ reason:no such index [logs-elastic_agent-default] resource.id:logs-elastic_agent-default resource.type:index_or_alias root_cause:[map[index:logs-elastic_agent-default index_uuid:_na_ reason:no such index [logs-elastic_agent-default] resource.id:logs-elastic_agent-default resource.type:index_or_alias type:index_not_found_exception]] type:index_not_found_exception] status:404]" retries=119
[2021-06-29T07:56:51.116Z] {"level":"debug","time":"2021-06-29T07:56:50Z","message":"sent request with 0 transactions, 4 spans, 0 errors, 0 metricsets"}
[2021-06-29T07:56:53.652Z] time="2021-06-29T07:56:53Z" level=error msg="Could not get agent events from Fleet" agentID=fa150e25-f09c-47e4-aba4-7e6d61fe5c79 application=endpoint-security error="Error getting response from Elasticsearch. Status: 404 Not Found, ResponseError: map[error:map[index:logs-elastic_agent-default index_uuid:_na_ reason:no such index [logs-elastic_agent-default] resource.id:logs-elastic_agent-default resource.type:index_or_alias root_cause:[map[index:logs-elastic_agent-default index_uuid:_na_ reason:no such index [logs-elastic_agent-default] resource.id:logs-elastic_agent-default resource.type:index_or_alias type:index_not_found_exception]] type:index_not_found_exception] status:404]" packagePolicyID=a93a004a-85e2-4e77-9706-8b801784694d result="map[]"
[2021-06-29T07:56:53.653Z] time="2021-06-29T07:56:53Z" level=warning msg="There are no events for the agent in Fleet" elapsedTime=9m21.053010847s err="Error getting response from Elasticsearch. Status: 404 Not Found, ResponseError: map[error:map[index:logs-elastic_agent-default index_uuid:_na_ reason:no such index [logs-elastic_agent-default] resource.id:logs-elastic_agent-default resource.type:index_or_alias root_cause:[map[index:logs-elastic_agent-default index_uuid:_na_ reason:no such index [logs-elastic_agent-default] resource.id:logs-elastic_agent-default resource.type:index_or_alias type:index_not_found_exception]] type:index_not_found_exception] status:404]" retries=120
[2021-06-29T07:56:56.978Z] time="2021-06-29T07:56:56Z" level=error msg="Could not get agent events from Fleet" agentID=fa150e25-f09c-47e4-aba4-7e6d61fe5c79 application=endpoint-security error="Error getting response from Elasticsearch. Status: 404 Not Found, ResponseError: map[error:map[index:logs-elastic_agent-default index_uuid:_na_ reason:no such index [logs-elastic_agent-default] resource.id:logs-elastic_agent-default resource.type:index_or_alias root_cause:[map[index:logs-elastic_agent-default index_uuid:_na_ reason:no such index [logs-elastic_agent-default] resource.id:logs-elastic_agent-default resource.type:index_or_alias type:index_not_found_exception]] type:index_not_found_exception] status:404]" packagePolicyID=a93a004a-85e2-4e77-9706-8b801784694d result="map[]"
[2021-06-29T07:56:56.978Z] time="2021-06-29T07:56:56Z" level=warning msg="There are no events for the agent in Fleet" elapsedTime=9m23.845700952s err="Error getting response from Elasticsearch. Status: 404 Not Found, ResponseError: map[error:map[index:logs-elastic_agent-default index_uuid:_na_ reason:no such index [logs-elastic_agent-default] resource.id:logs-elastic_agent-default resource.type:index_or_alias root_cause:[map[index:logs-elastic_agent-default index_uuid:_na_ reason:no such index [logs-elastic_agent-default] resource.id:logs-elastic_agent-default resource.type:index_or_alias type:index_not_found_exception]] type:index_not_found_exception] status:404]" retries=121
[2021-06-29T07:57:05.110Z] {"level":"debug","time":"2021-06-29T07:57:03Z","message":"sent request with 0 transactions, 4 spans, 0 errors, 0 metricsets"}
[2021-06-29T07:57:05.110Z] time="2021-06-29T07:57:03Z" level=error msg="Could not get agent events from Fleet" agentID=fa150e25-f09c-47e4-aba4-7e6d61fe5c79 application=endpoint-security error="Error getting response from Elasticsearch. Status: 404 Not Found, ResponseError: map[error:map[index:logs-elastic_agent-default index_uuid:_na_ reason:no such index [logs-elastic_agent-default] resource.id:logs-elastic_agent-default resource.type:index_or_alias root_cause:[map[index:logs-elastic_agent-default index_uuid:_na_ reason:no such index [logs-elastic_agent-default] resource.id:logs-elastic_agent-default resource.type:index_or_alias type:index_not_found_exception]] type:index_not_found_exception] status:404]" packagePolicyID=a93a004a-85e2-4e77-9706-8b801784694d result="map[]"
[2021-06-29T07:57:05.110Z] time="2021-06-29T07:57:03Z" level=warning msg="There are no events for the agent in Fleet" elapsedTime=9m31.344456226s err="Error getting response from Elasticsearch. Status: 404 Not Found, ResponseError: map[error:map[index:logs-elastic_agent-default index_uuid:_na_ reason:no such index [logs-elastic_agent-default] resource.id:logs-elastic_agent-default resource.type:index_or_alias root_cause:[map[index:logs-elastic_agent-default index_uuid:_na_ reason:no such index [logs-elastic_agent-default] resource.id:logs-elastic_agent-default resource.type:index_or_alias type:index_not_found_exception]] type:index_not_found_exception] status:404]" retries=122
[2021-06-29T07:57:06.489Z] {"level":"debug","time":"2021-06-29T07:57:06Z","message":"gathering metrics"}
[2021-06-29T07:57:08.394Z] time="2021-06-29T07:57:08Z" level=error msg="Could not get agent events from Fleet" agentID=fa150e25-f09c-47e4-aba4-7e6d61fe5c79 application=endpoint-security error="Error getting response from Elasticsearch. Status: 404 Not Found, ResponseError: map[error:map[index:logs-elastic_agent-default index_uuid:_na_ reason:no such index [logs-elastic_agent-default] resource.id:logs-elastic_agent-default resource.type:index_or_alias root_cause:[map[index:logs-elastic_agent-default index_uuid:_na_ reason:no such index [logs-elastic_agent-default] resource.id:logs-elastic_agent-default resource.type:index_or_alias type:index_not_found_exception]] type:index_not_found_exception] status:404]" packagePolicyID=a93a004a-85e2-4e77-9706-8b801784694d result="map[]"
[2021-06-29T07:57:08.394Z] time="2021-06-29T07:57:08Z" level=warning msg="There are no events for the agent in Fleet" elapsedTime=9m35.905286304s err="Error getting response from Elasticsearch. Status: 404 Not Found, ResponseError: map[error:map[index:logs-elastic_agent-default index_uuid:_na_ reason:no such index [logs-elastic_agent-default] resource.id:logs-elastic_agent-default resource.type:index_or_alias root_cause:[map[index:logs-elastic_agent-default index_uuid:_na_ reason:no such index [logs-elastic_agent-default] resource.id:logs-elastic_agent-default resource.type:index_or_alias type:index_not_found_exception]] type:index_not_found_exception] status:404]" retries=123
[2021-06-29T07:57:11.684Z] time="2021-06-29T07:57:11Z" level=error msg="Could not get agent events from Fleet" agentID=fa150e25-f09c-47e4-aba4-7e6d61fe5c79 application=endpoint-security error="Error getting response from Elasticsearch. Status: 404 Not Found, ResponseError: map[error:map[index:logs-elastic_agent-default index_uuid:_na_ reason:no such index [logs-elastic_agent-default] resource.id:logs-elastic_agent-default resource.type:index_or_alias root_cause:[map[index:logs-elastic_agent-default index_uuid:_na_ reason:no such index [logs-elastic_agent-default] resource.id:logs-elastic_agent-default resource.type:index_or_alias type:index_not_found_exception]] type:index_not_found_exception] status:404]" packagePolicyID=a93a004a-85e2-4e77-9706-8b801784694d result="map[]"
[2021-06-29T07:57:11.684Z] time="2021-06-29T07:57:11Z" level=warning msg="There are no events for the agent in Fleet" elapsedTime=9m38.966770892s err="Error getting response from Elasticsearch. Status: 404 Not Found, ResponseError: map[error:map[index:logs-elastic_agent-default index_uuid:_na_ reason:no such index [logs-elastic_agent-default] resource.id:logs-elastic_agent-default resource.type:index_or_alias root_cause:[map[index:logs-elastic_agent-default index_uuid:_na_ reason:no such index [logs-elastic_agent-default] resource.id:logs-elastic_agent-default resource.type:index_or_alias type:index_not_found_exception]] type:index_not_found_exception] status:404]" retries=124
[2021-06-29T07:57:14.220Z] {"level":"debug","time":"2021-06-29T07:57:13Z","message":"sent request with 0 transactions, 6 spans, 0 errors, 1 metricset"}
[2021-06-29T07:57:18.416Z] time="2021-06-29T07:57:17Z" level=error msg="Could not get agent events from Fleet" agentID=fa150e25-f09c-47e4-aba4-7e6d61fe5c79 application=endpoint-security error="Error getting response from Elasticsearch. Status: 404 Not Found, ResponseError: map[error:map[index:logs-elastic_agent-default index_uuid:_na_ reason:no such index [logs-elastic_agent-default] resource.id:logs-elastic_agent-default resource.type:index_or_alias root_cause:[map[index:logs-elastic_agent-default index_uuid:_na_ reason:no such index [logs-elastic_agent-default] resource.id:logs-elastic_agent-default resource.type:index_or_alias type:index_not_found_exception]] type:index_not_found_exception] status:404]" packagePolicyID=a93a004a-85e2-4e77-9706-8b801784694d result="map[]"
[2021-06-29T07:57:18.417Z] time="2021-06-29T07:57:17Z" level=warning msg="There are no events for the agent in Fleet" elapsedTime=9m45.373484899s err="Error getting response from Elasticsearch. Status: 404 Not Found, ResponseError: map[error:map[index:logs-elastic_agent-default index_uuid:_na_ reason:no such index [logs-elastic_agent-default] resource.id:logs-elastic_agent-default resource.type:index_or_alias root_cause:[map[index:logs-elastic_agent-default index_uuid:_na_ reason:no such index [logs-elastic_agent-default] resource.id:logs-elastic_agent-default resource.type:index_or_alias type:index_not_found_exception]] type:index_not_found_exception] status:404]" retries=125
[2021-06-29T07:57:20.953Z] time="2021-06-29T07:57:20Z" level=error msg="Could not get agent events from Fleet" agentID=fa150e25-f09c-47e4-aba4-7e6d61fe5c79 application=endpoint-security error="Error getting response from Elasticsearch. Status: 404 Not Found, ResponseError: map[error:map[index:logs-elastic_agent-default index_uuid:_na_ reason:no such index [logs-elastic_agent-default] resource.id:logs-elastic_agent-default resource.type:index_or_alias root_cause:[map[index:logs-elastic_agent-default index_uuid:_na_ reason:no such index [logs-elastic_agent-default] resource.id:logs-elastic_agent-default resource.type:index_or_alias type:index_not_found_exception]] type:index_not_found_exception] status:404]" packagePolicyID=a93a004a-85e2-4e77-9706-8b801784694d result="map[]"
[2021-06-29T07:57:20.953Z] time="2021-06-29T07:57:20Z" level=warning msg="There are no events for the agent in Fleet" elapsedTime=9m48.337172622s err="Error getting response from Elasticsearch. Status: 404 Not Found, ResponseError: map[error:map[index:logs-elastic_agent-default index_uuid:_na_ reason:no such index [logs-elastic_agent-default] resource.id:logs-elastic_agent-default resource.type:index_or_alias root_cause:[map[index:logs-elastic_agent-default index_uuid:_na_ reason:no such index [logs-elastic_agent-default] resource.id:logs-elastic_agent-default resource.type:index_or_alias type:index_not_found_exception]] type:index_not_found_exception] status:404]" retries=126
[2021-06-29T07:57:24.246Z] time="2021-06-29T07:57:23Z" level=error msg="Could not get agent events from Fleet" agentID=fa150e25-f09c-47e4-aba4-7e6d61fe5c79 application=endpoint-security error="Error getting response from Elasticsearch. Status: 404 Not Found, ResponseError: map[error:map[index:logs-elastic_agent-default index_uuid:_na_ reason:no such index [logs-elastic_agent-default] resource.id:logs-elastic_agent-default resource.type:index_or_alias root_cause:[map[index:logs-elastic_agent-default index_uuid:_na_ reason:no such index [logs-elastic_agent-default] resource.id:logs-elastic_agent-default resource.type:index_or_alias type:index_not_found_exception]] type:index_not_found_exception] status:404]" packagePolicyID=a93a004a-85e2-4e77-9706-8b801784694d result="map[]"
[2021-06-29T07:57:24.246Z] time="2021-06-29T07:57:23Z" level=warning msg="There are no events for the agent in Fleet" elapsedTime=9m51.107683917s err="Error getting response from Elasticsearch. Status: 404 Not Found, ResponseError: map[error:map[index:logs-elastic_agent-default index_uuid:_na_ reason:no such index [logs-elastic_agent-default] resource.id:logs-elastic_agent-default resource.type:index_or_alias root_cause:[map[index:logs-elastic_agent-default index_uuid:_na_ reason:no such index [logs-elastic_agent-default] resource.id:logs-elastic_agent-default resource.type:index_or_alias type:index_not_found_exception]] type:index_not_found_exception] status:404]" retries=127
[2021-06-29T07:57:28.445Z] {"level":"debug","time":"2021-06-29T07:57:27Z","message":"sent request with 0 transactions, 6 spans, 0 errors, 0 metricsets"}
[2021-06-29T07:57:29.829Z] time="2021-06-29T07:57:29Z" level=error msg="Could not get agent events from Fleet" agentID=fa150e25-f09c-47e4-aba4-7e6d61fe5c79 application=endpoint-security error="Error getting response from Elasticsearch. Status: 404 Not Found, ResponseError: map[error:map[index:logs-elastic_agent-default index_uuid:_na_ reason:no such index [logs-elastic_agent-default] resource.id:logs-elastic_agent-default resource.type:index_or_alias root_cause:[map[index:logs-elastic_agent-default index_uuid:_na_ reason:no such index [logs-elastic_agent-default] resource.id:logs-elastic_agent-default resource.type:index_or_alias type:index_not_found_exception]] type:index_not_found_exception] status:404]" packagePolicyID=a93a004a-85e2-4e77-9706-8b801784694d result="map[]"
[2021-06-29T07:57:29.829Z] time="2021-06-29T07:57:29Z" level=warning msg="There are no events for the agent in Fleet" elapsedTime=9m57.183931595s err="Error getting response from Elasticsearch. Status: 404 Not Found, ResponseError: map[error:map[index:logs-elastic_agent-default index_uuid:_na_ reason:no such index [logs-elastic_agent-default] resource.id:logs-elastic_agent-default resource.type:index_or_alias root_cause:[map[index:logs-elastic_agent-default index_uuid:_na_ reason:no such index [logs-elastic_agent-default] resource.id:logs-elastic_agent-default resource.type:index_or_alias type:index_not_found_exception]] type:index_not_found_exception] status:404]" retries=128
[2021-06-29T07:57:36.400Z] {"level":"debug","time":"2021-06-29T07:57:36Z","message":"gathering metrics"}
[2021-06-29T07:57:40.593Z] {"level":"debug","time":"2021-06-29T07:57:39Z","message":"sent request with 0 transactions, 5 spans, 2 errors, 1 metricset"}
[2021-06-29T07:58:07.147Z] {"level":"debug","time":"2021-06-29T07:58:06Z","message":"gathering metrics"}
[2021-06-29T07:58:17.130Z] {"level":"debug","time":"2021-06-29T07:58:16Z","message":"sent request with 0 transactions, 0 spans, 0 errors, 1 metricset"}
[2021-06-29T07:58:39.067Z] {"level":"debug","time":"2021-06-29T07:58:36Z","message":"gathering metrics"}
[2021-06-29T07:58:47.189Z] {"level":"debug","time":"2021-06-29T07:58:46Z","message":"sent request with 0 transactions, 0 spans, 0 errors, 1 metricset"}
[2021-06-29T07:59:02.081Z] time="2021-06-29T07:59:00Z" level=debug msg="Un-enrolling agent in Fleet" hostname=710e7252dfbc
[2021-06-29T07:59:06.272Z] {"level":"debug","time":"2021-06-29T07:59:05Z","message":"sent request with 1 transaction, 21 spans, 0 errors, 0 metricsets"}
[2021-06-29T07:59:06.272Z] {"level":"debug","time":"2021-06-29T07:59:06Z","message":"gathering metrics"}
[2021-06-29T07:59:08.807Z] The centos_systemdContainerName variable is not set. Defaulting to a blank string.
[2021-06-29T07:59:08.808Z] fleet_elasticsearch_1 is up-to-date
[2021-06-29T07:59:08.808Z] Creating fleet_elastic-agent_1 ... 
[2021-06-29T07:59:08.808Z] fleet_kibana_1 is up-to-date
[2021-06-29T07:59:08.808Z] fleet_fleet-server_1 is up-to-date
[2021-06-29T07:59:09.376Z] 
Creating fleet_elastic-agent_1 ... done
time="2021-06-29T07:59:09Z" level=debug msg="Docker compose executed." cmd="[up -d]" composeFilePaths="[/var/lib/jenkins/workspace/PR-1304-1-51b10aba-fcf6-4328-8192-1982d952f543/.op/compose/profiles/fleet/docker-compose.yml /var/lib/jenkins/workspace/PR-1304-1-51b10aba-fcf6-4328-8192-1982d952f543/.op/compose/services/elastic-agent/centos/docker-compose.yml]" env="map[kibanaDockerNamespace:kibana kibanaVersion:8.0.0-SNAPSHOT stackPlatform:linux/amd64 stackVersion:8.0.0-SNAPSHOT]" profile=fleet
[2021-06-29T07:59:09.377Z] time="2021-06-29T07:59:09Z" level=debug msg="Golang's architecture is amd64 (amd64)"
[2021-06-29T07:59:09.636Z] time="2021-06-29T07:59:09Z" level=debug msg="The Elastic artifacts API is available" elapsedTime=66.43819ms retries=1 statusEndpoint="https://artifacts-api.elastic.co/v1/search/8.0.0-SNAPSHOT/elastic-agent?x-elastic-no-kpi=true"
[2021-06-29T07:59:09.636Z] time="2021-06-29T07:59:09Z" level=debug msg="Retrieving binary from local cache" URL="https://snapshots.elastic.co/8.0.0-e1177df4/downloads/beats/elastic-agent/elastic-agent-8.0.0-SNAPSHOT-linux-x86_64.tar.gz" path=/tmp/4ac1352f-88ee-44ec-b17e-ab4f996ec0d7/elastic-agent-8.0.0-SNAPSHOT-linux-x86_64.tar.gz
[2021-06-29T07:59:11.015Z] time="2021-06-29T07:59:10Z" level=debug msg="Fleet Server config created" elasticsearch=elasticsearch elasticsearchPort=9200 token="LTZuSFZub0JEVWRxOElYU1pFanQ6eFVzVnRwLWlUaXV4X3FqTnNpRmo0UQ=="
[2021-06-29T07:59:16.288Z] {"level":"debug","time":"2021-06-29T07:59:16Z","message":"sent request with 0 transactions, 18 spans, 0 errors, 21 metricsets"}
[2021-06-29T07:59:18.205Z] time="2021-06-29T07:59:17Z" level=debug msg="Un-enrolling agent in Fleet" hostname=8cd23a75c98f
[2021-06-29T07:59:19.141Z] time="2021-06-29T07:59:19Z" level=info msg="The Agent is not present in Fleet, as expected" elapsedTime=74.250628ms hostname=8cd23a75c98f retries=1 status=inactive
[2021-06-29T07:59:19.142Z] time="2021-06-29T07:59:19Z" level=info msg="The Agent is not listed in the Administration view in the Security App" elapsedTime=48.480963ms hostname=8cd23a75c98f retries=1
[2021-06-29T07:59:25.714Z] {"level":"debug","time":"2021-06-29T07:59:24Z","message":"sent request with 1 transaction, 41 spans, 0 errors, 0 metricsets"}
[2021-06-29T07:59:27.619Z] The centos_systemdContainerName variable is not set. Defaulting to a blank string.
[2021-06-29T07:59:27.619Z] fleet_elasticsearch_1 is up-to-date
[2021-06-29T07:59:27.619Z] Creating fleet_elastic-agent_1 ... 
[2021-06-29T07:59:27.619Z] fleet_kibana_1 is up-to-date
[2021-06-29T07:59:27.879Z] fleet_fleet-server_1 is up-to-date
[2021-06-29T07:59:28.449Z] 
Creating fleet_elastic-agent_1 ... done
time="2021-06-29T07:59:28Z" level=debug msg="Docker compose executed." cmd="[up -d]" composeFilePaths="[/var/lib/jenkins/workspace/PR-1304-1-51b10aba-fcf6-4328-8192-1982d952f543/.op/compose/profiles/fleet/docker-compose.yml /var/lib/jenkins/workspace/PR-1304-1-51b10aba-fcf6-4328-8192-1982d952f543/.op/compose/services/elastic-agent/centos/docker-compose.yml]" env="map[kibanaDockerNamespace:kibana kibanaVersion:8.0.0-SNAPSHOT stackPlatform:linux/amd64 stackVersion:8.0.0-SNAPSHOT]" profile=fleet
[2021-06-29T07:59:28.449Z] time="2021-06-29T07:59:28Z" level=debug msg="Golang's architecture is amd64 (amd64)"
[2021-06-29T07:59:28.449Z] time="2021-06-29T07:59:28Z" level=debug msg="The Elastic artifacts API is available" elapsedTime=7.155741ms retries=1 statusEndpoint="https://artifacts-api.elastic.co/v1/search/8.0.0-SNAPSHOT/elastic-agent?x-elastic-no-kpi=true"
[2021-06-29T07:59:28.449Z] time="2021-06-29T07:59:28Z" level=debug msg="Retrieving binary from local cache" URL="https://snapshots.elastic.co/8.0.0-e1177df4/downloads/beats/elastic-agent/elastic-agent-8.0.0-SNAPSHOT-linux-x86_64.tar.gz" path=/tmp/4ac1352f-88ee-44ec-b17e-ab4f996ec0d7/elastic-agent-8.0.0-SNAPSHOT-linux-x86_64.tar.gz
[2021-06-29T07:59:30.365Z] time="2021-06-29T07:59:29Z" level=debug msg="Fleet Server config created" elasticsearch=elasticsearch elasticsearchPort=9200 token="R3FuSFZub0JEVWRxOElYU3IwbEw6bVl0ZGtuSEZUbUs0cW1nSGdpWlVFdw=="
[2021-06-29T07:59:36.943Z] {"level":"debug","time":"2021-06-29T07:59:36Z","message":"gathering metrics"}
[2021-06-29T07:59:36.943Z] {"level":"debug","time":"2021-06-29T07:59:36Z","message":"sent request with 0 transactions, 27 spans, 0 errors, 20 metricsets"}
[2021-06-29T07:59:38.336Z] time="2021-06-29T07:59:37Z" level=warning msg="The Agent is not in the online status yet" agentID=d0455da6-52c5-4fad-81a9-4b1683056376 elapsedTime=81.649276ms hostname=0a0b0737e2d8 isAgentInStatus=false retry=1 status=online
[2021-06-29T07:59:38.906Z] time="2021-06-29T07:59:38Z" level=warning msg="The Agent is not in the online status yet" agentID=d0455da6-52c5-4fad-81a9-4b1683056376 elapsedTime=845.271208ms hostname=0a0b0737e2d8 isAgentInStatus=false retry=2 status=online
[2021-06-29T07:59:40.814Z] time="2021-06-29T07:59:40Z" level=info msg="The Agent is in the desired status" elapsedTime=2.404911672s hostname=0a0b0737e2d8 isAgentInStatus=true retries=3 status=online
[2021-06-29T07:59:40.814Z] time="2021-06-29T07:59:40Z" level=info msg="The Agent is not listed in the Administration view in the Security App" elapsedTime=35.257327ms hostname=0a0b0737e2d8 retries=1
[2021-06-29T07:59:45.008Z] time="2021-06-29T07:59:44Z" level=debug msg="Un-enrolling agent in Fleet" hostname=0a0b0737e2d8
[2021-06-29T07:59:48.300Z] {"level":"debug","time":"2021-06-29T07:59:47Z","message":"sent request with 1 transaction, 55 spans, 0 errors, 0 metricsets"}
[2021-06-29T07:59:48.300Z] time="2021-06-29T07:59:47Z" level=debug msg="Destroying Fleet runtime dependencies"
[2021-06-29T07:59:48.566Z] Stopping fleet_fleet-server_1  ... 
[2021-06-29T07:59:48.566Z] Stopping fleet_kibana_1        ... 
[2021-06-29T07:59:48.566Z] Stopping fleet_elasticsearch_1 ... 
[2021-06-29T08:00:03.312Z] 
Stopping fleet_fleet-server_1  ... done

Stopping fleet_kibana_1        ... done

Stopping fleet_elasticsearch_1 ... done
Removing fleet_fleet-server_1  ... 
[2021-06-29T08:00:03.313Z] Removing fleet_kibana_1        ... 
[2021-06-29T08:00:03.313Z] Removing fleet_elasticsearch_1 ... 
[2021-06-29T08:00:03.313Z] 
Removing fleet_kibana_1        ... done

Removing fleet_elasticsearch_1 ... done

Removing fleet_fleet-server_1  ... done
Removing network fleet_default
[2021-06-29T08:00:03.313Z] time="2021-06-29T08:00:02Z" level=debug msg="Docker compose executed." cmd="[down --remove-orphans]" composeFilePaths="[/var/lib/jenkins/workspace/PR-1304-1-51b10aba-fcf6-4328-8192-1982d952f543/.op/compose/profiles/fleet/docker-compose.yml]" env="map[kibanaDockerNamespace:kibana kibanaVersion:8.0.0-SNAPSHOT stackPlatform:linux/amd64 stackVersion:8.0.0-SNAPSHOT]" profile=fleet
[2021-06-29T08:00:03.313Z] {"level":"debug","time":"2021-06-29T08:00:02Z","message":"sent request with 1 transaction, 4 spans, 0 errors, 0 metricsets"}
[2021-06-29T08:00:03.313Z] ../../commons-test.mk:57: recipe for target 'functional-test' failed
[2021-06-29T08:00:03.313Z] make: *** [functional-test] Error 1
[2021-06-29T08:00:03.668Z] [INFO] Stopping Filebeat Docker container
[2021-06-29T08:00:03.964Z] + docker exec -t 9d2e00ec5eeec0b49d0333fe71135d9ac6f67e29f351d84afbdd4ea4850fe8f2 chmod -R ugo+rw /output
[2021-06-29T08:00:04.225Z] + docker stop --time 30 9d2e00ec5eeec0b49d0333fe71135d9ac6f67e29f351d84afbdd4ea4850fe8f2
[2021-06-29T08:00:04.800Z] 9d2e00ec5eeec0b49d0333fe71135d9ac6f67e29f351d84afbdd4ea4850fe8f2
[2021-06-29T08:00:04.843Z] Archiving artifacts
[2021-06-29T08:00:05.597Z] Recording test results
[2021-06-29T08:00:06.089Z] [Checks API] No suitable checks publisher found.
[2021-06-29T08:00:06.124Z] Archiving artifacts
[2021-06-29T08:00:06.223Z] Running in /var/lib/jenkins/workspace/PR-1304-1-51b10aba-fcf6-4328-8192-1982d952f543/src/github.com/elastic/e2e-testing
[2021-06-29T08:00:06.608Z] + go clean -modcache
[2021-06-29T08:00:07.480Z] Failed in branch ubuntu-18.04_fleet_agent_endpoint_integration
[2021-06-29T08:00:07.504Z] Terminated
[2021-06-29T08:00:09.647Z] Stage "Release" skipped due to earlier failure(s)
[2021-06-29T08:00:10.133Z] Running on Jenkins in /var/lib/jenkins/workspace/2e-tests_e2e-testing-mbp_PR-1304
[2021-06-29T08:00:10.232Z] [INFO] getVaultSecret: Getting secrets
[2021-06-29T08:00:10.280Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2021-06-29T08:00:11.272Z] + chmod 755 generate-build-data.sh
[2021-06-29T08:00:11.272Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-1304/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-1304/runs/1 FAILURE 2239878
[2021-06-29T08:00:11.272Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-1304/runs/1/steps/?limit=10000 -o steps-info.json
[2021-06-29T08:00:12.615Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-1304/runs/1/tests/?status=FAILED -o tests-errors.json
[2021-06-29T08:00:12.615Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/e2e-tests/e2e-testing-mbp/PR-1304/runs/1/log/ -o pipeline-log.txt

🐛 Flaky test report

❕ There are test failures but not known flaky tests.

Expand to view the summary

Test stats 🧪

Test Results
Failed 4
Passed 214
Skipped 0
Total 218

Genuine test errors 4

💔 There are test failures but not known flaky tests, most likely a genuine test failure.

  • Name: Initializing / End-To-End Tests / ubuntu-18.04_fleet_agent_endpoint_integration / Deploying an Endpoint makes policies to appear in the Security App – Agent Endpoint Integration
  • Name: Initializing / End-To-End Tests / ubuntu-18.04_fleet_agent_endpoint_integration / Changing an Agent policy is reflected in the Security App – Agent Endpoint Integration
  • Name: Initializing / End-To-End Tests / ubuntu-18.04_fleet_fleet_mode_agent / Revoking the enrollment token for the centos agent – Fleet Mode Agent
  • Name: Initializing / End-To-End Tests / arm64_fleet_fleet_mode_agent / Revoking the enrollment token for the centos agent – Fleet Mode Agent

@jsoriano
Copy link
Member

We found that the MSSQL Server integration was broken in Beats (see elastic/beats#26440) , and for that reason we want to add this test as part of the regression test suite.

Just a note, in principle the integration was not broken, but its tests, that were not being executed in the usual developer workflows (elastic/beats#26526).

@mdelapenya
Copy link
Contributor Author

We found that the MSSQL Server integration was broken in Beats (see elastic/beats#26440) , and for that reason we want to add this test as part of the regression test suite.

Just a note, in principle the integration was not broken, but its tests, that were not being executed in the usual developer workflows (elastic/beats#26526).

Good point, I meant that the docker image used in tests for the integration was broken. Thanks for clarifying

@mdelapenya mdelapenya merged commit 3188742 into elastic:master Jun 29, 2021
mergify bot pushed a commit that referenced this pull request Jun 29, 2021
mergify bot pushed a commit that referenced this pull request Jun 29, 2021
mergify bot pushed a commit that referenced this pull request Jun 29, 2021
mdelapenya added a commit that referenced this pull request Jun 29, 2021
(cherry picked from commit 3188742)

Co-authored-by: Manuel de la Peña <[email protected]>
mdelapenya added a commit that referenced this pull request Jun 29, 2021
(cherry picked from commit 3188742)

Co-authored-by: Manuel de la Peña <[email protected]>
mdelapenya added a commit that referenced this pull request Jun 29, 2021
(cherry picked from commit 3188742)

Co-authored-by: Manuel de la Peña <[email protected]>
@mdelapenya mdelapenya deleted the mssql-server-tests branch June 30, 2021 07:07
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants