[FTR][CI] Use default distribution for all tests by tylersmalley · Pull Request #94968 · elastic/kibana

tylersmalley · 2021-03-18T18:33:50Z

No longer builds oss distribution and runs tests against it. All tests run against the default distribution.

Fixes #87711
Fixes #76168
Fixes #91242
Fixes #92302

tylersmalley · 2021-03-22T21:47:56Z

tylersmalley · 2021-03-25T04:58:49Z

@legrego @jportner, thanks for your help. The failures I am currently looking into are in test/api_integration/apis/saved_objects/find.ts. A reproduction outside the functional test runner:

node scripts/functional_tests_server.js --config test/api_integration/config.js
node scripts/es_archiver.js load saved_objects/basic --config test/api_integration/config.js
curl "http://elastic:changeme@localhost:5620/api/saved_objects/_find?type=visualization&namespaces=foo"

Error:

   │ proc [kibana] {
   │ proc [kibana]   "name": "ResponseError",
   │ proc [kibana]   "meta": {
   │ proc [kibana]     "body": {
   │ proc [kibana]       "error": {
   │ proc [kibana]         "root_cause": [
   │ proc [kibana]           {
   │ proc [kibana]             "type": "illegal_argument_exception",
   │ proc [kibana]             "reason": "application privileges must refer to at least one resource"
   │ proc [kibana]           }
   │ proc [kibana]         ],
   │ proc [kibana]         "type": "illegal_argument_exception",
   │ proc [kibana]         "reason": "application privileges must refer to at least one resource"
   │ proc [kibana]       },
   │ proc [kibana]       "status": 400
   │ proc [kibana]     },
   │ proc [kibana]     "statusCode": 400,
   │ proc [kibana]     "headers": {
   │ proc [kibana]       "x-opaque-id": "079017f4-5814-474a-93b3-4fe868f941a6",
   │ proc [kibana]       "content-type": "application/json;charset=utf-8",
   │ proc [kibana]       "content-length": "253"
   │ proc [kibana]     },
   │ proc [kibana]     "meta": {
   │ proc [kibana]       "context": null,
   │ proc [kibana]       "request": {
   │ proc [kibana]         "params": {
   │ proc [kibana]           "method": "POST",
   │ proc [kibana]           "path": "/_security/user/_has_privileges",
   │ proc [kibana]           "body": "{\"index\":[],\"applications\":[{\"application\":\"kibana-.kibana\",\"resources\":[],\"privileges\":[\"version:8.0.0\",\"login:\",\"saved_object:8.0.0:config/find\"]}]}",
   │ proc [kibana]           "querystring": "",
   │ proc [kibana]           "headers": {
   │ proc [kibana]             "user-agent": "elasticsearch-js/8.0.0-canary.3 (linux 5.8.0-45-generic-x64; Node.js v14.16.0)",
   │ proc [kibana]             "x-elastic-product-origin": "kibana",
   │ proc [kibana]             "x-opaque-id": "079017f4-5814-474a-93b3-4fe868f941a6",
   │ proc [kibana]             "authorization": "Basic ZWxhc3RpYzpjaGFuZ2VtZQ==",
   │ proc [kibana]             "x-elastic-client-meta": "es=8.0.0p,js=14.16.0,t=8.0.0p,hc=14.16.0",
   │ proc [kibana]             "content-type": "application/json",
   │ proc [kibana]             "content-length": "150"
   │ proc [kibana]           },
   │ proc [kibana]           "timeout": 30000
   │ proc [kibana]         },
   │ proc [kibana]         "options": {},
   │ proc [kibana]         "id": 1
   │ proc [kibana]       },
   │ proc [kibana]       "name": "elasticsearch-js",
   │ proc [kibana]       "connection": {
   │ proc [kibana]         "url": "http://localhost:9220/",
   │ proc [kibana]         "id": "http://localhost:9220/",
   │ proc [kibana]         "headers": {},
   │ proc [kibana]         "deadCount": 0,
   │ proc [kibana]         "resurrectTimeout": 0,
   │ proc [kibana]         "_openRequests": 0,
   │ proc [kibana]         "status": "alive",
   │ proc [kibana]         "roles": {
   │ proc [kibana]           "master": true,
   │ proc [kibana]           "data": true,
   │ proc [kibana]           "ingest": true,
   │ proc [kibana]           "ml": false
   │ proc [kibana]         }
   │ proc [kibana]       },
   │ proc [kibana]       "attempts": 0,
   │ proc [kibana]       "aborted": false
   │ proc [kibana]     }
   │ proc [kibana]   }
   │ proc [kibana] }

tylersmalley · 2021-04-28T19:13:18Z

@elastic/kibana-alerting-services

I am running into an issue where I could use your assistance with.

This pull request removes the oss build from the functional tests, meaning that all functional tests will be running against our single, default distribution.

The status page functional tests are currently failing due to the alerting plugin being red with Alerting framework is unavailable. When syncing with @mikecote, we determined this is most likely due to the health task being removed when the esArchive is either loaded or unloaded. When the task is unable to be found, it results in the status being updated.

A way I have been able to reproduce this is by running the functional test server with:

node scripts/functional_tests_server.js --config test/functional/config.js

Then, run node scripts/functional_test_runner --config test/functional/config.js --grep "context app" followed by node scripts/functional_test_runner --config test/functional/config.js --grep "status page".

Looking for help in how to proceed. Thanks :elasticheart:

kibanamachine · 2021-05-12T19:27:15Z