Skip to content

[Security Solutions] Fixes exception lists to be able to filter on os type#106494

Merged
FrankHassanabad merged 4 commits intoelastic:masterfrom
FrankHassanabad:fix-ostype-filtering
Jul 22, 2021
Merged

[Security Solutions] Fixes exception lists to be able to filter on os type#106494
FrankHassanabad merged 4 commits intoelastic:masterfrom
FrankHassanabad:fix-ostype-filtering

Conversation

@FrankHassanabad
Copy link
Contributor

@FrankHassanabad FrankHassanabad commented Jul 22, 2021

Summary

Fixes #102613, and targets 7.14.0 as a blocker/critical

Previously we never fully finished the plumbing for using the os_types (operating system type) in the exception lists to be able to filter out values based on this type. With the endpoint exceptions now having specific selections for os_type we have to filter it with exceptions and basically make it work.

Some caveats is that the endpoints utilize host.os.name.casless for filtering against os_type, while agents such as auditbeat, winlogbeat, etc... use host.os.type. Really host.os.type is the correct ECS field to use, but to retain compatibility with the current version of endpoint agents I support both in one query to where if either of these two matches, then that will trigger the exceptions.

  • Adds e2e tests
  • Enhances the e2e tooling to do endpoint exception testing with os_types.
  • Adds the logic to handle os_type
  • Updates the unit tests

Checklist

Delete any items that are not applicable to this PR.

@FrankHassanabad FrankHassanabad changed the title Fix ostype filtering [Security Solutions] Fixes exception lists to be able to filter on os type Jul 22, 2021
@FrankHassanabad FrankHassanabad self-assigned this Jul 22, 2021
@FrankHassanabad FrankHassanabad added v8.0.0 v7.15.0 v7.14.0 impact:critical This issue should be addressed immediately due to a critical level of impact on the product. bug Fixes for quality problems that affect the customer experience release_note:fix Team:Detections and Resp Security Detection Response Team Feature:Rule Exceptions Security Solution Detection Rule Exceptions area labels Jul 22, 2021
@FrankHassanabad FrankHassanabad marked this pull request as ready for review July 22, 2021 05:30
@FrankHassanabad FrankHassanabad requested review from a team as code owners July 22, 2021 05:30
@elasticmachine
Copy link
Contributor

Pinging @elastic/security-detections-response (Team:Detections and Resp)

@kibanamachine
Copy link
Contributor

💛 Build succeeded, but was flaky


Test Failures

Kibana Pipeline / general / Chrome X-Pack UI Functional Tests.x-pack/test/functional/apps/transform/deleting·ts.transform deleting batch transform with latest configuration delete transform

Link to Jenkins

Standard Out

Failed Tests Reporter:
  - Test has not failed recently on tracked branches

[00:00:00]       │
[00:22:31]         └-: transform
[00:22:31]           └-> "before all" hook in "transform"
[00:22:31]           └-> "before all" hook in "transform"
[00:22:31]             │ debg creating role transform_source
[00:22:31]             │ info [o.e.x.s.a.r.TransportPutRoleAction] [node-01] added role [transform_source]
[00:22:31]             │ debg creating role transform_dest
[00:22:31]             │ info [o.e.x.s.a.r.TransportPutRoleAction] [node-01] added role [transform_dest]
[00:22:31]             │ debg creating role transform_dest_readonly
[00:22:31]             │ info [o.e.x.s.a.r.TransportPutRoleAction] [node-01] added role [transform_dest_readonly]
[00:22:31]             │ debg creating role transform_ui_extras
[00:22:31]             │ info [o.e.x.s.a.r.TransportPutRoleAction] [node-01] added role [transform_ui_extras]
[00:22:31]             │ debg creating user transform_poweruser
[00:22:31]             │ info [o.e.x.s.a.u.TransportPutUserAction] [node-01] added user [transform_poweruser]
[00:22:31]             │ debg created user transform_poweruser
[00:22:31]             │ debg creating user transform_viewer
[00:22:31]             │ info [o.e.x.s.a.u.TransportPutUserAction] [node-01] added user [transform_viewer]
[00:22:31]             │ debg created user transform_viewer
[00:30:53]           └-: deleting
[00:30:53]             └-> "before all" hook in "deleting"
[00:30:53]             └-> "before all" hook in "deleting"
[00:30:53]               │ info [x-pack/test/functional/es_archives/ml/ecommerce] Loading "mappings.json"
[00:30:53]               │ info [x-pack/test/functional/es_archives/ml/ecommerce] Loading "data.json.gz"
[00:30:53]               │ info [x-pack/test/functional/es_archives/ml/ecommerce] Skipped restore for existing index "ft_ecommerce"
[00:30:53]               │ debg Searching for 'index-pattern' with title 'ft_ecommerce'...
[00:30:53]               │ debg  > Not found
[00:30:53]               │ debg Creating index pattern with title 'ft_ecommerce' and time field 'order_date'
[00:30:53]               │ info [o.e.c.m.MetadataMappingService] [node-01] [.kibana_8.0.0_001/t0P0icCDThGPky-nbzTlrA] update_mapping [_doc]
[00:30:54]               │ debg Waiting up to 5000ms for index-pattern with title 'ft_ecommerce' to exist...
[00:30:54]               │ debg Searching for 'index-pattern' with title 'ft_ecommerce'...
[00:30:54]               │ debg  > Found 'e656df80-eb0c-11eb-8f04-c37f39e5d93c'
[00:30:54]               │ debg  > Created with id 'e656df80-eb0c-11eb-8f04-c37f39e5d93c'
[00:30:54]               │ debg Creating transform with id 'ec_deleting_pivot_1626970765404_batch'...
[00:30:54]               │ debg Waiting up to 5000ms for 'ec_deleting_pivot_1626970765404_batch' to exist...
[00:30:54]               │ info [o.e.c.m.MetadataCreateIndexService] [node-01] [.transform-notifications-000002] creating index, cause [auto(bulk api)], templates [.transform-notifications-000002], shards [1]/[1]
[00:30:54]               │ info [o.e.c.r.a.AllocationService] [node-01] updating number_of_replicas to [0] for indices [.transform-notifications-000002]
[00:30:54]               │ debg Starting transform 'ec_deleting_pivot_1626970765404_batch' ...
[00:30:54]               │ info [o.e.c.m.MetadataCreateIndexService] [node-01] [user-ec_2_1626970765404] creating index, cause [api], templates [], shards [1]/[1]
[00:30:54]               │ info [o.e.c.r.a.AllocationService] [node-01] updating number_of_replicas to [0] for indices [user-ec_2_1626970765404]
[00:30:54]               │ info [o.e.x.t.t.TransformTask] [node-01] [ec_deleting_pivot_1626970765404_batch] updating state for transform to [{"task_state":"started","indexer_state":"stopped","checkpoint":0,"should_stop_at_checkpoint":false}].
[00:30:54]               │ info [o.e.x.t.t.TransformPersistentTasksExecutor] [node-01] [ec_deleting_pivot_1626970765404_batch] successfully completed and scheduled task in node operation
[00:30:54]               │ debg Waiting up to 120000ms for batch transform to complete...
[00:30:54]               │ debg Fetching transform stats for transform ec_deleting_pivot_1626970765404_batch
[00:30:54]               │ debg --- retry.waitForWithTimeout error: expected batch transform to be stopped with last checkpoint = 1 (got status: 'indexing', checkpoint: '0')
[00:30:54]               │ info [o.e.x.t.t.ClientTransformIndexer] [node-01] [ec_deleting_pivot_1626970765404_batch] transform finished indexing all data, initiating stop.
[00:30:54]               │ debg Fetching transform stats for transform ec_deleting_pivot_1626970765404_batch
[00:30:54]               │ debg Creating transform with id 'ec_deleting_pivot_1626970765404_cont'...
[00:30:54]               │ debg Waiting up to 5000ms for 'ec_deleting_pivot_1626970765404_cont' to exist...
[00:30:54]               │ debg Starting transform 'ec_deleting_pivot_1626970765404_cont' ...
[00:30:55]               │ info [o.e.x.t.t.TransformTask] [node-01] [ec_deleting_pivot_1626970765404_cont] updating state for transform to [{"task_state":"started","indexer_state":"stopped","checkpoint":0,"should_stop_at_checkpoint":false}].
[00:30:55]               │ info [o.e.x.t.t.TransformPersistentTasksExecutor] [node-01] [ec_deleting_pivot_1626970765404_cont] successfully completed and scheduled task in node operation
[00:30:55]               │ debg Waiting up to 120000ms for transform state not to be stopped...
[00:30:55]               │ debg Fetching transform stats for transform ec_deleting_pivot_1626970765404_cont
[00:30:55]               │ debg Creating transform with id 'ec_deleting_latest_1626970765404_batch'...
[00:30:55]               │ debg Waiting up to 5000ms for 'ec_deleting_latest_1626970765404_batch' to exist...
[00:30:55]               │ debg Starting transform 'ec_deleting_latest_1626970765404_batch' ...
[00:30:55]               │ info [o.e.c.m.MetadataCreateIndexService] [node-01] [user-ec_3_1626970765404] creating index, cause [api], templates [], shards [1]/[1]
[00:30:55]               │ info [o.e.c.r.a.AllocationService] [node-01] updating number_of_replicas to [0] for indices [user-ec_3_1626970765404]
[00:30:55]               │ info [o.e.x.t.t.TransformTask] [node-01] [ec_deleting_latest_1626970765404_batch] updating state for transform to [{"task_state":"started","indexer_state":"stopped","checkpoint":0,"should_stop_at_checkpoint":false}].
[00:30:55]               │ info [o.e.x.t.t.TransformPersistentTasksExecutor] [node-01] [ec_deleting_latest_1626970765404_batch] successfully completed and scheduled task in node operation
[00:30:55]               │ debg Waiting up to 120000ms for batch transform to complete...
[00:30:55]               │ debg Fetching transform stats for transform ec_deleting_latest_1626970765404_batch
[00:30:55]               │ debg --- retry.waitForWithTimeout error: expected batch transform to be stopped with last checkpoint = 1 (got status: 'indexing', checkpoint: '0')
[00:30:55]               │ info [o.e.c.m.MetadataMappingService] [node-01] [user-ec_3_1626970765404/AROfp0NnRduHKHLcV32xXQ] update_mapping [_doc]
[00:30:55]               │ info [o.e.x.t.t.ClientTransformIndexer] [node-01] [ec_deleting_latest_1626970765404_batch] transform finished indexing all data, initiating stop.
[00:30:55]               │ debg Fetching transform stats for transform ec_deleting_latest_1626970765404_batch
[00:30:55]               │ debg applying update to kibana config: {"dateFormat:tz":"UTC"}
[00:30:57]               │ debg SecurityPage.forceLogout
[00:30:57]               │ debg Find.existsByDisplayedByCssSelector('.login-form') with timeout=100
[00:30:57]               │ debg --- retry.tryForTime error: .login-form is not displayed
[00:30:57]               │ debg Redirecting to /logout to force the logout
[00:30:58]               │ debg Waiting on the login form to appear
[00:30:58]               │ debg Waiting for Login Page to appear.
[00:30:58]               │ debg Waiting up to 100000ms for login page...
[00:30:58]               │ debg browser[INFO] http://localhost:61221/logout?_t=1626972624190 281 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:30:58]               │
[00:30:58]               │ debg browser[INFO] http://localhost:61221/bootstrap.js 41:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:30:58]               │ debg Find.existsByDisplayedByCssSelector('.login-form') with timeout=2500
[00:31:00]               │ERROR browser[SEVERE] http://localhost:61221/api/alerts/list_alert_types - Failed to load resource: the server responded with a status of 401 (Unauthorized)
[00:31:00]               │ debg browser[INFO] http://localhost:61221/44697/bundles/core/core.entry.js 12:156264 "Detected an unhandled Promise rejection.
[00:31:00]               │      Error: Unauthorized"
[00:31:00]               │ERROR browser[SEVERE] http://localhost:61221/44697/bundles/core/core.entry.js 5:2474 
[00:31:00]               │ debg browser[INFO] http://localhost:61221/login?msg=LOGGED_OUT 281 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:31:00]               │
[00:31:00]               │ debg browser[INFO] http://localhost:61221/bootstrap.js 41:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:31:00]               │ERROR browser[SEVERE] http://localhost:61221/api/licensing/info - Failed to load resource: the server responded with a status of 401 (Unauthorized)
[00:31:00]               │ debg --- retry.tryForTime error: .login-form is not displayed
[00:31:01]               │ debg Find.existsByDisplayedByCssSelector('.login-form') with timeout=2500
[00:31:01]               │ debg TestSubjects.exists(loginForm)
[00:31:01]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="loginForm"]') with timeout=2500
[00:31:01]               │ debg Waiting for Login Form to appear.
[00:31:01]               │ debg Waiting up to 100000ms for login form...
[00:31:01]               │ debg TestSubjects.exists(loginForm)
[00:31:01]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="loginForm"]') with timeout=2500
[00:31:01]               │ debg TestSubjects.setValue(loginUsername, transform_poweruser)
[00:31:01]               │ debg TestSubjects.click(loginUsername)
[00:31:01]               │ debg Find.clickByCssSelector('[data-test-subj="loginUsername"]') with timeout=10000
[00:31:01]               │ debg Find.findByCssSelector('[data-test-subj="loginUsername"]') with timeout=10000
[00:31:02]               │ debg TestSubjects.setValue(loginPassword, tfp001)
[00:31:02]               │ debg TestSubjects.click(loginPassword)
[00:31:02]               │ debg Find.clickByCssSelector('[data-test-subj="loginPassword"]') with timeout=10000
[00:31:02]               │ debg Find.findByCssSelector('[data-test-subj="loginPassword"]') with timeout=10000
[00:31:02]               │ debg TestSubjects.click(loginSubmit)
[00:31:02]               │ debg Find.clickByCssSelector('[data-test-subj="loginSubmit"]') with timeout=10000
[00:31:02]               │ debg Find.findByCssSelector('[data-test-subj="loginSubmit"]') with timeout=10000
[00:31:02]               │ proc [kibana]   log   [16:50:28.737] [info][plugins][routes][security] Logging in with provider "basic" (basic)
[00:31:02]               │ debg Waiting for login result, expected: chrome.
[00:31:02]               │ debg Find.findByCssSelector('[data-test-subj="userMenuButton"]') with timeout=20000
[00:31:04]               │ debg browser[INFO] http://localhost:61221/app/home 281 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:31:04]               │
[00:31:04]               │ debg browser[INFO] http://localhost:61221/bootstrap.js 41:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:31:04]               │ debg Finished login process currentUrl = http://localhost:61221/app/home#/
[00:31:04]               │ debg Waiting up to 20000ms for logout button visible...
[00:31:04]               │ debg TestSubjects.exists(userMenuButton)
[00:31:04]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="userMenuButton"]') with timeout=2500
[00:31:04]               │ debg TestSubjects.exists(userMenu)
[00:31:04]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="userMenu"]') with timeout=2500
[00:31:07]               │ debg --- retry.tryForTime error: [data-test-subj="userMenu"] is not displayed
[00:31:07]               │ debg TestSubjects.click(userMenuButton)
[00:31:07]               │ debg Find.clickByCssSelector('[data-test-subj="userMenuButton"]') with timeout=10000
[00:31:07]               │ debg Find.findByCssSelector('[data-test-subj="userMenuButton"]') with timeout=10000
[00:31:07]               │ debg TestSubjects.exists(userMenu)
[00:31:07]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="userMenu"]') with timeout=120000
[00:31:08]               │ debg TestSubjects.exists(userMenu > logoutLink)
[00:31:08]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="userMenu"] [data-test-subj="logoutLink"]') with timeout=2500
[00:31:45]             └-: batch transform with latest configuration
[00:31:45]               └-> "before all" hook for "delete transform"
[00:31:45]               └-> delete transform
[00:31:45]                 └-> "before each" hook: global before each for "delete transform"
[00:31:45]                 │ debg === TEST STEP === should load the home page
[00:31:45]                 │ debg navigating to transform url: http://localhost:61221/app/management/data/transform
[00:31:45]                 │ debg navigate to: http://localhost:61221/app/management/data/transform
[00:31:54]                 │ proc [kibana]   log   [16:51:20.875] [error][savedobjects-service] Unable to retrieve version information from Elasticsearch nodes. connect ECONNREFUSED 127.0.0.1:62221
[00:31:54]                 │ proc [kibana]   log   [16:51:21.055] [warning][kibana-monitoring][monitoring][monitoring][plugins] ConnectionError: connect ECONNREFUSED 127.0.0.1:62221
[00:31:54]                 │ proc [kibana]     at ClientRequest.onError (/dev/shm/workspace/kibana-build-22/node_modules/@elastic/elasticsearch/lib/Connection.js:115:16)
[00:31:54]                 │ proc [kibana]     at ClientRequest.emit (events.js:375:28)
[00:31:54]                 │ proc [kibana]     at Socket.socketErrorListener (_http_client.js:475:9)
[00:31:54]                 │ proc [kibana]     at Socket.emit (events.js:375:28)
[00:31:54]                 │ proc [kibana]     at emitErrorNT (internal/streams/destroy.js:106:8)
[00:31:54]                 │ proc [kibana]     at emitErrorCloseNT (internal/streams/destroy.js:74:3)
[00:31:54]                 │ proc [kibana]     at processTicksAndRejections (internal/process/task_queues.js:82:21)
[00:31:54]                 │ proc [kibana]   log   [16:51:21.056] [warning][kibana-monitoring][monitoring][monitoring][plugins] Unable to bulk upload the stats payload to the local cluster
[00:31:54]                 │ proc [kibana]   log   [16:51:21.056] [error][index][plugins][security][session] Failed to retrieve session value: connect ECONNREFUSED 127.0.0.1:62221
[00:31:54]                 │ proc [kibana]   log   [16:51:21.057] [error][server][Kibana][http] ConnectionError: connect ECONNREFUSED 127.0.0.1:62221
[00:31:54]                 │ proc [kibana]     at ClientRequest.onError (/dev/shm/workspace/kibana-build-22/node_modules/@elastic/elasticsearch/lib/Connection.js:115:16)
[00:31:54]                 │ proc [kibana]     at ClientRequest.emit (events.js:375:28)
[00:31:54]                 │ proc [kibana]     at Socket.socketErrorListener (_http_client.js:475:9)
[00:31:54]                 │ proc [kibana]     at Socket.emit (events.js:375:28)
[00:31:54]                 │ proc [kibana]     at emitErrorNT (internal/streams/destroy.js:106:8)
[00:31:54]                 │ proc [kibana]     at emitErrorCloseNT (internal/streams/destroy.js:74:3)
[00:31:54]                 │ proc [kibana]     at processTicksAndRejections (internal/process/task_queues.js:82:21) {
[00:31:54]                 │ proc [kibana]   meta: {
[00:31:54]                 │ proc [kibana]     body: null,
[00:31:54]                 │ proc [kibana]     statusCode: null,
[00:31:54]                 │ proc [kibana]     headers: null,
[00:31:54]                 │ proc [kibana]     meta: {
[00:31:54]                 │ proc [kibana]       context: null,
[00:31:54]                 │ proc [kibana]       request: [Object],
[00:31:54]                 │ proc [kibana]       name: 'elasticsearch-js',
[00:31:54]                 │ proc [kibana]       connection: [Object],
[00:31:54]                 │ proc [kibana]       attempts: 3,
[00:31:54]                 │ proc [kibana]       aborted: false
[00:31:54]                 │ proc [kibana]     }
[00:31:54]                 │ proc [kibana]   }
[00:31:54]                 │ proc [kibana] }
[00:31:54]                 │ proc [kibana]   log   [16:51:21.118] [error][plugins][taskManager] [WorkloadAggregator]: ConnectionError: connect ECONNREFUSED 127.0.0.1:62221
[00:31:54]                 │ proc [kibana]   log   [16:51:21.119] [warning][licensing][plugins] License information could not be obtained from Elasticsearch due to ConnectionError: connect ECONNREFUSED 127.0.0.1:62221 error
[00:31:54]                 │ proc [kibana]   log   [16:51:21.122] [warning][monitoring][monitoring][plugins] X-Pack Monitoring Cluster Alerts will not be available: connect ECONNREFUSED 127.0.0.1:62221
[00:31:54]                 │ proc [kibana]   log   [16:51:21.161] [warning][licensing][plugins] License information could not be obtained from Elasticsearch due to ConnectionError: connect ECONNREFUSED 127.0.0.1:62221 error
[00:31:54]                 │ proc [kibana]   log   [16:51:21.164] [info][plugins][searchprofiler] You cannot use searchprofiler because license information is not available at this time.
[00:31:54]                 │ proc [kibana]   log   [16:51:21.164] [info][painlessLab][plugins] You cannot use painlessLab because license information is not available at this time.
[00:31:54]                 │ proc [kibana]   log   [16:51:21.168] [info][plugins][transform] You cannot use transform because license information is not available at this time.
[00:31:54]                 │ proc [kibana]   log   [16:51:21.168] [info][plugins][snapshotRestore] You cannot use snapshot_restore because license information is not available at this time.
[00:31:54]                 │ proc [kibana]   log   [16:51:21.168] [info][plugins][rollup] You cannot use rollup because license information is not available at this time.
[00:31:54]                 │ proc [kibana]   log   [16:51:21.169] [info][plugins][remoteClusters] You cannot use Remote Clusters because license information is not available at this time.
[00:31:54]                 │ proc [kibana]   log   [16:51:21.169] [info][indexLifecycleManagement][plugins] You cannot use index_lifecycle_management because license information is not available at this time.
[00:31:54]                 │ proc [kibana]   log   [16:51:21.180] [info][kibana-monitoring][monitoring][monitoring][plugins] Monitoring status upload endpoint is not enabled in Elasticsearch:Monitoring stats collection is stopped
[00:31:54]                 │ proc [kibana]  error  [16:51:11.778]  Error: Internal Server Error
[00:31:54]                 │ proc [kibana]     at HapiResponseAdapter.toInternalError (/dev/shm/workspace/kibana-build-22/src/core/server/http/router/response_adapter.js:61:19)
[00:31:54]                 │ proc [kibana]     at Object.interceptAuth [as authenticate] (/dev/shm/workspace/kibana-build-22/src/core/server/http/lifecycle/auth.js:130:34)
[00:31:54]                 │ proc [kibana]     at runMicrotasks (<anonymous>)
[00:31:54]                 │ proc [kibana]     at processTicksAndRejections (internal/process/task_queues.js:95:5)
[00:31:54]                 │ proc [kibana]     at exports.Manager.execute (/dev/shm/workspace/kibana-build-22/node_modules/@hapi/hapi/lib/toolkit.js:60:28)
[00:31:54]                 │ proc [kibana]     at module.exports.internals.Auth._authenticate (/dev/shm/workspace/kibana-build-22/node_modules/@hapi/hapi/lib/auth.js:258:30)
[00:31:54]                 │ proc [kibana]     at Request._lifecycle (/dev/shm/workspace/kibana-build-22/node_modules/@hapi/hapi/lib/request.js:370:32)
[00:31:54]                 │ proc [kibana]     at Request._execute (/dev/shm/workspace/kibana-build-22/node_modules/@hapi/hapi/lib/request.js:279:9)
[00:31:54]                 │ERROR browser[SEVERE] http://localhost:61221/app/management/data/transform?_t=1626972671772 - Failed to load resource: the server responded with a status of 500 (Internal Server Error)
[00:31:54]                 │ debg ... sleep(700) start
[00:31:55]                 │ proc [kibana]   log   [16:51:21.444] [warning][plugins][securitySolution] Unable to verify endpoint policies in line with license change: failed to fetch package policies: connect ECONNREFUSED 127.0.0.1:62221
[00:31:55]                 │ proc [kibana]   log   [16:51:21.835] [info][status] Kibana is now critical (was available)
[00:31:55]                 │ debg ... sleep(700) end
[00:31:55]                 │ debg returned from get, calling refresh
[00:31:55]                 │ proc [kibana]   log   [16:51:22.007] [error][authentication][plugins][security] License is not available, authentication is not possible.
[00:31:55]                 │ proc [kibana]   log   [16:51:22.013] [warning][licensing][plugins] License information could not be obtained from Elasticsearch due to ConnectionError: connect ECONNREFUSED 127.0.0.1:62221 error
[00:31:55]                 │ERROR browser[SEVERE] http://localhost:61221/app/management/data/transform?_t=1626972671772 - Failed to load resource: the server responded with a status of 503 (Service Unavailable)
[00:31:55]                 │ debg currentUrl = http://localhost:61221/app/management/data/transform
[00:31:55]                 │          appUrl = http://localhost:61221/app/management/data/transform
[00:31:55]                 │ debg TestSubjects.find(kibanaChrome)
[00:31:55]                 │ debg Find.findByCssSelector('[data-test-subj="kibanaChrome"]') with timeout=60000
[00:32:12]                 │ proc [kibana]   log   [16:51:38.487] [warning][licensing][plugins] License information could not be obtained from Elasticsearch due to ConnectionError: connect ECONNREFUSED 127.0.0.1:62221 error
[00:32:19]                 │ proc [kibana]   log   [16:51:45.709] [warning][licensing][plugins] License information could not be obtained from Elasticsearch due to ConnectionError: connect ECONNREFUSED 127.0.0.1:62221 error
[00:32:42]                 │ proc [kibana]   log   [16:52:08.486] [warning][licensing][plugins] License information could not be obtained from Elasticsearch due to ConnectionError: connect ECONNREFUSED 127.0.0.1:62221 error
[00:32:49]                 │ proc [kibana]   log   [16:52:15.710] [warning][licensing][plugins] License information could not be obtained from Elasticsearch due to ConnectionError: connect ECONNREFUSED 127.0.0.1:62221 error
[00:32:56]                 │ debg --- retry.try error: Waiting for element to be located By(css selector, [data-test-subj="kibanaChrome"])
[00:32:56]                 │      Wait timed out after 61182ms
[00:32:57]                 │ debg navigate to: http://localhost:61221/app/management/data/transform
[00:32:57]                 │ proc [kibana]   log   [16:52:23.741] [error][authentication][plugins][security] License is not available, authentication is not possible.
[00:32:57]                 │ proc [kibana]   log   [16:52:23.748] [warning][licensing][plugins] License information could not be obtained from Elasticsearch due to ConnectionError: connect ECONNREFUSED 127.0.0.1:62221 error
[00:32:57]                 │ERROR browser[SEVERE] http://localhost:61221/app/management/data/transform?_t=1626972743732 - Failed to load resource: the server responded with a status of 503 (Service Unavailable)
[00:32:57]                 │ debg ... sleep(700) start
[00:32:58]                 │ debg ... sleep(700) end
[00:32:58]                 │ debg returned from get, calling refresh
[00:32:58]                 │ proc [kibana]   log   [16:52:24.483] [error][authentication][plugins][security] License is not available, authentication is not possible.
[00:32:58]                 │ proc [kibana]   log   [16:52:24.492] [warning][licensing][plugins] License information could not be obtained from Elasticsearch due to ConnectionError: connect ECONNREFUSED 127.0.0.1:62221 error
[00:32:58]                 │ERROR browser[SEVERE] http://localhost:61221/app/management/data/transform?_t=1626972743732 - Failed to load resource: the server responded with a status of 503 (Service Unavailable)
[00:32:58]                 │ debg currentUrl = http://localhost:61221/app/management/data/transform
[00:32:58]                 │          appUrl = http://localhost:61221/app/management/data/transform
[00:32:58]                 │ debg TestSubjects.find(kibanaChrome)
[00:32:58]                 │ debg Find.findByCssSelector('[data-test-subj="kibanaChrome"]') with timeout=60000
[00:33:12]                 │ proc [kibana]   log   [16:52:38.486] [warning][licensing][plugins] License information could not be obtained from Elasticsearch due to ConnectionError: connect ECONNREFUSED 127.0.0.1:62221 error
[00:33:19]                 │ proc [kibana]   log   [16:52:45.712] [warning][licensing][plugins] License information could not be obtained from Elasticsearch due to ConnectionError: connect ECONNREFUSED 127.0.0.1:62221 error
[00:33:42]                 │ proc [kibana]   log   [16:53:08.486] [warning][licensing][plugins] License information could not be obtained from Elasticsearch due to ConnectionError: connect ECONNREFUSED 127.0.0.1:62221 error
[00:33:49]                 │ proc [kibana]   log   [16:53:15.713] [warning][licensing][plugins] License information could not be obtained from Elasticsearch due to ConnectionError: connect ECONNREFUSED 127.0.0.1:62221 error
[00:33:59]                 │ debg --- retry.try error: Waiting for element to be located By(css selector, [data-test-subj="kibanaChrome"])
[00:33:59]                 │      Wait timed out after 61198ms
[00:33:59]                 │ debg --- retry.tryForTime error: retry.try timeout: TimeoutError: Waiting for element to be located By(css selector, [data-test-subj="kibanaChrome"])
[00:33:59]                 │      Wait timed out after 61198ms
[00:33:59]                 │          at /dev/shm/workspace/parallel/22/kibana/node_modules/selenium-webdriver/lib/webdriver.js:842:17
[00:33:59]                 │          at runMicrotasks (<anonymous>)
[00:33:59]                 │          at processTicksAndRejections (internal/process/task_queues.js:95:5)
[00:34:00]                 │ debg navigate to: http://localhost:61221/app/management/data/transform
[00:34:00]                 │ proc [kibana]   log   [16:53:26.736] [error][authentication][plugins][security] License is not available, authentication is not possible.
[00:34:00]                 │ proc [kibana]   log   [16:53:26.749] [warning][licensing][plugins] License information could not be obtained from Elasticsearch due to ConnectionError: connect ECONNREFUSED 127.0.0.1:62221 error
[00:34:00]                 │ERROR browser[SEVERE] http://localhost:61221/app/management/data/transform?_t=1626972806727 - Failed to load resource: the server responded with a status of 503 (Service Unavailable)
[00:34:00]                 │ debg ... sleep(700) start
[00:34:01]                 │ debg ... sleep(700) end
[00:34:01]                 │ debg returned from get, calling refresh
[00:34:01]                 │ proc [kibana]   log   [16:53:27.488] [error][authentication][plugins][security] License is not available, authentication is not possible.
[00:34:01]                 │ proc [kibana]   log   [16:53:27.500] [warning][licensing][plugins] License information could not be obtained from Elasticsearch due to ConnectionError: connect ECONNREFUSED 127.0.0.1:62221 error
[00:34:01]                 │ERROR browser[SEVERE] http://localhost:61221/app/management/data/transform?_t=1626972806727 - Failed to load resource: the server responded with a status of 503 (Service Unavailable)
[00:34:01]                 │ debg currentUrl = http://localhost:61221/app/management/data/transform
[00:34:01]                 │          appUrl = http://localhost:61221/app/management/data/transform
[00:34:01]                 │ debg TestSubjects.find(kibanaChrome)
[00:34:01]                 │ debg Find.findByCssSelector('[data-test-subj="kibanaChrome"]') with timeout=60000
[00:34:12]                 │ proc [kibana]   log   [16:53:38.487] [warning][licensing][plugins] License information could not be obtained from Elasticsearch due to ConnectionError: connect ECONNREFUSED 127.0.0.1:62221 error
[00:34:19]                 │ proc [kibana]   log   [16:53:45.713] [warning][licensing][plugins] License information could not be obtained from Elasticsearch due to ConnectionError: connect ECONNREFUSED 127.0.0.1:62221 error
[00:34:42]                 │ proc [kibana]   log   [16:54:08.490] [warning][licensing][plugins] License information could not be obtained from Elasticsearch due to ConnectionError: connect ECONNREFUSED 127.0.0.1:62221 error
[00:34:49]                 │ proc [kibana]   log   [16:54:15.710] [warning][licensing][plugins] License information could not be obtained from Elasticsearch due to ConnectionError: connect ECONNREFUSED 127.0.0.1:62221 error
[00:35:00]                 │ proc [kibana]   log   [16:54:26.839] [warning][alerting][plugins] Alerting framework is unavailable due to the error: ConnectionError: connect ECONNREFUSED 127.0.0.1:62221
[00:35:02]                 │ debg --- retry.try error: Waiting for element to be located By(css selector, [data-test-subj="kibanaChrome"])
[00:35:02]                 │      Wait timed out after 61178ms
[00:35:02]                 │ debg navigate to: http://localhost:61221/app/management/data/transform
[00:35:02]                 │ proc [kibana]   log   [16:54:29.223] [error][authentication][plugins][security] License is not available, authentication is not possible.
[00:35:02]                 │ proc [kibana]   log   [16:54:29.229] [warning][licensing][plugins] License information could not be obtained from Elasticsearch due to ConnectionError: connect ECONNREFUSED 127.0.0.1:62221 error
[00:35:02]                 │ERROR browser[SEVERE] http://localhost:61221/app/management/data/transform?_t=1626972869214 - Failed to load resource: the server responded with a status of 503 (Service Unavailable)
[00:35:02]                 │ debg ... sleep(700) start
[00:35:03]                 │ debg ... sleep(700) end
[00:35:03]                 │ debg returned from get, calling refresh
[00:35:03]                 │ proc [kibana]   log   [16:54:29.965] [error][authentication][plugins][security] License is not available, authentication is not possible.
[00:35:03]                 │ proc [kibana]   log   [16:54:29.972] [warning][licensing][plugins] License information could not be obtained from Elasticsearch due to ConnectionError: connect ECONNREFUSED 127.0.0.1:62221 error
[00:35:03]                 │ERROR browser[SEVERE] http://localhost:61221/app/management/data/transform?_t=1626972869214 - Failed to load resource: the server responded with a status of 503 (Service Unavailable)
[00:35:03]                 │ debg currentUrl = http://localhost:61221/app/management/data/transform
[00:35:03]                 │          appUrl = http://localhost:61221/app/management/data/transform
[00:35:03]                 │ debg TestSubjects.find(kibanaChrome)
[00:35:03]                 │ debg Find.findByCssSelector('[data-test-subj="kibanaChrome"]') with timeout=60000
[00:35:12]                 │ proc [kibana]   log   [16:54:38.487] [warning][licensing][plugins] License information could not be obtained from Elasticsearch due to ConnectionError: connect ECONNREFUSED 127.0.0.1:62221 error
[00:35:19]                 │ proc [kibana]   log   [16:54:45.711] [warning][licensing][plugins] License information could not be obtained from Elasticsearch due to ConnectionError: connect ECONNREFUSED 127.0.0.1:62221 error
[00:35:42]                 │ proc [kibana]   log   [16:55:08.490] [warning][licensing][plugins] License information could not be obtained from Elasticsearch due to ConnectionError: connect ECONNREFUSED 127.0.0.1:62221 error
[00:35:49]                 │ proc [kibana]   log   [16:55:15.711] [warning][licensing][plugins] License information could not be obtained from Elasticsearch due to ConnectionError: connect ECONNREFUSED 127.0.0.1:62221 error
[00:36:04]                 │ debg --- retry.try error: Waiting for element to be located By(css selector, [data-test-subj="kibanaChrome"])
[00:36:04]                 │      Wait timed out after 61164ms
[00:36:05]                 │ debg --- retry.tryForTime error: retry.try timeout: TimeoutError: Waiting for element to be located By(css selector, [data-test-subj="kibanaChrome"])
[00:36:05]                 │      Wait timed out after 61164ms
[00:36:05]                 │          at /dev/shm/workspace/parallel/22/kibana/node_modules/selenium-webdriver/lib/webdriver.js:842:17
[00:36:05]                 │          at runMicrotasks (<anonymous>)
[00:36:05]                 │          at processTicksAndRejections (internal/process/task_queues.js:95:5)
[00:36:05]                 │ info Taking screenshot "/dev/shm/workspace/parallel/22/kibana/x-pack/test/functional/screenshots/failure/transform deleting batch transform with latest configuration delete transform.png"
[00:36:06]                 │ info Current URL is: http://localhost:61221/app/management/data/transform
[00:36:06]                 │ info Saving page source to: /dev/shm/workspace/parallel/22/kibana/x-pack/test/functional/failure_debug/html/transform deleting batch transform with latest configuration delete transform.html
[00:36:06]                 └- ✖ fail: transform deleting batch transform with latest configuration delete transform
[00:36:06]                 │      retry.tryForTime timeout: Error: retry.try timeout: TimeoutError: Waiting for element to be located By(css selector, [data-test-subj="kibanaChrome"])
[00:36:06]                 │ Wait timed out after 61164ms
[00:36:06]                 │     at /dev/shm/workspace/parallel/22/kibana/node_modules/selenium-webdriver/lib/webdriver.js:842:17
[00:36:06]                 │     at runMicrotasks (<anonymous>)
[00:36:06]                 │     at processTicksAndRejections (internal/process/task_queues.js:95:5)
[00:36:06]                 │     at onFailure (/dev/shm/workspace/parallel/22/kibana/test/common/services/retry/retry_for_success.ts:17:9)
[00:36:06]                 │     at retryForSuccess (/dev/shm/workspace/parallel/22/kibana/test/common/services/retry/retry_for_success.ts:57:13)
[00:36:06]                 │     at RetryService.try (/dev/shm/workspace/parallel/22/kibana/test/common/services/retry/retry.ts:31:12)
[00:36:06]                 │     at /dev/shm/workspace/parallel/22/kibana/test/functional/page_objects/common_page.ts:233:21
[00:36:06]                 │     at runAttempt (/dev/shm/workspace/parallel/22/kibana/test/common/services/retry/retry_for_success.ts:27:15)
[00:36:06]                 │     at retryForSuccess (/dev/shm/workspace/parallel/22/kibana/test/common/services/retry/retry_for_success.ts:66:21)
[00:36:06]                 │     at RetryService.tryForTime (/dev/shm/workspace/parallel/22/kibana/test/common/services/retry/retry.ts:22:12)
[00:36:06]                 │     at CommonPageObject.navigateToApp (/dev/shm/workspace/parallel/22/kibana/test/functional/page_objects/common_page.ts:232:5)
[00:36:06]                 │     at Object.navigateTo (/dev/shm/workspace/parallel/22/kibana/x-pack/test/functional/services/transform/navigation.ts:15:14)
[00:36:06]                 │     at Context.<anonymous> (/dev/shm/workspace/parallel/22/kibana/x-pack/test/functional/apps/transform/deleting.ts:87:11)
[00:36:06]                 │     at Object.apply (/dev/shm/workspace/parallel/22/kibana/node_modules/@kbn/test/target_node/functional_test_runner/lib/mocha/wrap_function.js:87:16)
[00:36:06]                 │   Error: retry.tryForTime timeout: Error: retry.try timeout: TimeoutError: Waiting for element to be located By(css selector, [data-test-subj="kibanaChrome"])
[00:36:06]                 │   Wait timed out after 61164ms
[00:36:06]                 │       at /dev/shm/workspace/parallel/22/kibana/node_modules/selenium-webdriver/lib/webdriver.js:842:17
[00:36:06]                 │       at runMicrotasks (<anonymous>)
[00:36:06]                 │       at processTicksAndRejections (internal/process/task_queues.js:95:5)
[00:36:06]                 │       at onFailure (/dev/shm/workspace/parallel/22/kibana/test/common/services/retry/retry_for_success.ts:17:9)
[00:36:06]                 │       at retryForSuccess (/dev/shm/workspace/parallel/22/kibana/test/common/services/retry/retry_for_success.ts:57:13)
[00:36:06]                 │       at RetryService.try (/dev/shm/workspace/parallel/22/kibana/test/common/services/retry/retry.ts:31:12)
[00:36:06]                 │       at /dev/shm/workspace/parallel/22/kibana/test/functional/page_objects/common_page.ts:233:21
[00:36:06]                 │       at runAttempt (/dev/shm/workspace/parallel/22/kibana/test/common/services/retry/retry_for_success.ts:27:15)
[00:36:06]                 │       at retryForSuccess (/dev/shm/workspace/parallel/22/kibana/test/common/services/retry/retry_for_success.ts:66:21)
[00:36:06]                 │       at RetryService.tryForTime (/dev/shm/workspace/parallel/22/kibana/test/common/services/retry/retry.ts:22:12)
[00:36:06]                 │       at CommonPageObject.navigateToApp (/dev/shm/workspace/parallel/22/kibana/test/functional/page_objects/common_page.ts:232:5)
[00:36:06]                 │       at Object.navigateTo (test/functional/services/transform/navigation.ts:15:14)
[00:36:06]                 │       at Context.<anonymous> (test/functional/apps/transform/deleting.ts:87:11)
[00:36:06]                 │       at Object.apply (/dev/shm/workspace/parallel/22/kibana/node_modules/@kbn/test/target_node/functional_test_runner/lib/mocha/wrap_function.js:87:16)
[00:36:06]                 │       at onFailure (/dev/shm/workspace/parallel/22/kibana/test/common/services/retry/retry_for_success.ts:17:9)
[00:36:06]                 │       at retryForSuccess (/dev/shm/workspace/parallel/22/kibana/test/common/services/retry/retry_for_success.ts:57:13)
[00:36:06]                 │       at RetryService.tryForTime (/dev/shm/workspace/parallel/22/kibana/test/common/services/retry/retry.ts:22:12)
[00:36:06]                 │       at CommonPageObject.navigateToApp (/dev/shm/workspace/parallel/22/kibana/test/functional/page_objects/common_page.ts:232:5)
[00:36:06]                 │       at Object.navigateTo (test/functional/services/transform/navigation.ts:15:14)
[00:36:06]                 │       at Context.<anonymous> (test/functional/apps/transform/deleting.ts:87:11)
[00:36:06]                 │       at Object.apply (/dev/shm/workspace/parallel/22/kibana/node_modules/@kbn/test/target_node/functional_test_runner/lib/mocha/wrap_function.js:87:16)
[00:36:06]                 │ 
[00:36:06]                 │ 

Stack Trace

Error: retry.tryForTime timeout: Error: retry.try timeout: TimeoutError: Waiting for element to be located By(css selector, [data-test-subj="kibanaChrome"])
Wait timed out after 61164ms
    at /dev/shm/workspace/parallel/22/kibana/node_modules/selenium-webdriver/lib/webdriver.js:842:17
    at runMicrotasks (<anonymous>)
    at processTicksAndRejections (internal/process/task_queues.js:95:5)
    at onFailure (/dev/shm/workspace/parallel/22/kibana/test/common/services/retry/retry_for_success.ts:17:9)
    at retryForSuccess (/dev/shm/workspace/parallel/22/kibana/test/common/services/retry/retry_for_success.ts:57:13)
    at RetryService.try (/dev/shm/workspace/parallel/22/kibana/test/common/services/retry/retry.ts:31:12)
    at /dev/shm/workspace/parallel/22/kibana/test/functional/page_objects/common_page.ts:233:21
    at runAttempt (/dev/shm/workspace/parallel/22/kibana/test/common/services/retry/retry_for_success.ts:27:15)
    at retryForSuccess (/dev/shm/workspace/parallel/22/kibana/test/common/services/retry/retry_for_success.ts:66:21)
    at RetryService.tryForTime (/dev/shm/workspace/parallel/22/kibana/test/common/services/retry/retry.ts:22:12)
    at CommonPageObject.navigateToApp (/dev/shm/workspace/parallel/22/kibana/test/functional/page_objects/common_page.ts:232:5)
    at Object.navigateTo (test/functional/services/transform/navigation.ts:15:14)
    at Context.<anonymous> (test/functional/apps/transform/deleting.ts:87:11)
    at Object.apply (/dev/shm/workspace/parallel/22/kibana/node_modules/@kbn/test/target_node/functional_test_runner/lib/mocha/wrap_function.js:87:16)
    at onFailure (/dev/shm/workspace/parallel/22/kibana/test/common/services/retry/retry_for_success.ts:17:9)
    at retryForSuccess (/dev/shm/workspace/parallel/22/kibana/test/common/services/retry/retry_for_success.ts:57:13)
    at RetryService.tryForTime (/dev/shm/workspace/parallel/22/kibana/test/common/services/retry/retry.ts:22:12)
    at CommonPageObject.navigateToApp (/dev/shm/workspace/parallel/22/kibana/test/functional/page_objects/common_page.ts:232:5)
    at Object.navigateTo (test/functional/services/transform/navigation.ts:15:14)
    at Context.<anonymous> (test/functional/apps/transform/deleting.ts:87:11)
    at Object.apply (/dev/shm/workspace/parallel/22/kibana/node_modules/@kbn/test/target_node/functional_test_runner/lib/mocha/wrap_function.js:87:16)

Kibana Pipeline / general / Chrome X-Pack UI Functional Tests.x-pack/test/functional/apps/transform/deleting·ts.transform deleting "after all" hook in "deleting"

Link to Jenkins

Standard Out

Failed Tests Reporter:
  - Test has not failed recently on tracked branches

[00:00:00]       │
[00:22:31]         └-: transform
[00:22:31]           └-> "before all" hook in "transform"
[00:22:31]           └-> "before all" hook in "transform"
[00:22:31]             │ debg creating role transform_source
[00:22:31]             │ info [o.e.x.s.a.r.TransportPutRoleAction] [node-01] added role [transform_source]
[00:22:31]             │ debg creating role transform_dest
[00:22:31]             │ info [o.e.x.s.a.r.TransportPutRoleAction] [node-01] added role [transform_dest]
[00:22:31]             │ debg creating role transform_dest_readonly
[00:22:31]             │ info [o.e.x.s.a.r.TransportPutRoleAction] [node-01] added role [transform_dest_readonly]
[00:22:31]             │ debg creating role transform_ui_extras
[00:22:31]             │ info [o.e.x.s.a.r.TransportPutRoleAction] [node-01] added role [transform_ui_extras]
[00:22:31]             │ debg creating user transform_poweruser
[00:22:31]             │ info [o.e.x.s.a.u.TransportPutUserAction] [node-01] added user [transform_poweruser]
[00:22:31]             │ debg created user transform_poweruser
[00:22:31]             │ debg creating user transform_viewer
[00:22:31]             │ info [o.e.x.s.a.u.TransportPutUserAction] [node-01] added user [transform_viewer]
[00:22:31]             │ debg created user transform_viewer
[00:30:53]           └-: deleting
[00:30:53]             └-> "before all" hook in "deleting"
[00:30:53]             └-> "before all" hook in "deleting"
[00:30:53]               │ info [x-pack/test/functional/es_archives/ml/ecommerce] Loading "mappings.json"
[00:30:53]               │ info [x-pack/test/functional/es_archives/ml/ecommerce] Loading "data.json.gz"
[00:30:53]               │ info [x-pack/test/functional/es_archives/ml/ecommerce] Skipped restore for existing index "ft_ecommerce"
[00:30:53]               │ debg Searching for 'index-pattern' with title 'ft_ecommerce'...
[00:30:53]               │ debg  > Not found
[00:30:53]               │ debg Creating index pattern with title 'ft_ecommerce' and time field 'order_date'
[00:30:53]               │ info [o.e.c.m.MetadataMappingService] [node-01] [.kibana_8.0.0_001/t0P0icCDThGPky-nbzTlrA] update_mapping [_doc]
[00:30:54]               │ debg Waiting up to 5000ms for index-pattern with title 'ft_ecommerce' to exist...
[00:30:54]               │ debg Searching for 'index-pattern' with title 'ft_ecommerce'...
[00:30:54]               │ debg  > Found 'e656df80-eb0c-11eb-8f04-c37f39e5d93c'
[00:30:54]               │ debg  > Created with id 'e656df80-eb0c-11eb-8f04-c37f39e5d93c'
[00:30:54]               │ debg Creating transform with id 'ec_deleting_pivot_1626970765404_batch'...
[00:30:54]               │ debg Waiting up to 5000ms for 'ec_deleting_pivot_1626970765404_batch' to exist...
[00:30:54]               │ info [o.e.c.m.MetadataCreateIndexService] [node-01] [.transform-notifications-000002] creating index, cause [auto(bulk api)], templates [.transform-notifications-000002], shards [1]/[1]
[00:30:54]               │ info [o.e.c.r.a.AllocationService] [node-01] updating number_of_replicas to [0] for indices [.transform-notifications-000002]
[00:30:54]               │ debg Starting transform 'ec_deleting_pivot_1626970765404_batch' ...
[00:30:54]               │ info [o.e.c.m.MetadataCreateIndexService] [node-01] [user-ec_2_1626970765404] creating index, cause [api], templates [], shards [1]/[1]
[00:30:54]               │ info [o.e.c.r.a.AllocationService] [node-01] updating number_of_replicas to [0] for indices [user-ec_2_1626970765404]
[00:30:54]               │ info [o.e.x.t.t.TransformTask] [node-01] [ec_deleting_pivot_1626970765404_batch] updating state for transform to [{"task_state":"started","indexer_state":"stopped","checkpoint":0,"should_stop_at_checkpoint":false}].
[00:30:54]               │ info [o.e.x.t.t.TransformPersistentTasksExecutor] [node-01] [ec_deleting_pivot_1626970765404_batch] successfully completed and scheduled task in node operation
[00:30:54]               │ debg Waiting up to 120000ms for batch transform to complete...
[00:30:54]               │ debg Fetching transform stats for transform ec_deleting_pivot_1626970765404_batch
[00:30:54]               │ debg --- retry.waitForWithTimeout error: expected batch transform to be stopped with last checkpoint = 1 (got status: 'indexing', checkpoint: '0')
[00:30:54]               │ info [o.e.x.t.t.ClientTransformIndexer] [node-01] [ec_deleting_pivot_1626970765404_batch] transform finished indexing all data, initiating stop.
[00:30:54]               │ debg Fetching transform stats for transform ec_deleting_pivot_1626970765404_batch
[00:30:54]               │ debg Creating transform with id 'ec_deleting_pivot_1626970765404_cont'...
[00:30:54]               │ debg Waiting up to 5000ms for 'ec_deleting_pivot_1626970765404_cont' to exist...
[00:30:54]               │ debg Starting transform 'ec_deleting_pivot_1626970765404_cont' ...
[00:30:55]               │ info [o.e.x.t.t.TransformTask] [node-01] [ec_deleting_pivot_1626970765404_cont] updating state for transform to [{"task_state":"started","indexer_state":"stopped","checkpoint":0,"should_stop_at_checkpoint":false}].
[00:30:55]               │ info [o.e.x.t.t.TransformPersistentTasksExecutor] [node-01] [ec_deleting_pivot_1626970765404_cont] successfully completed and scheduled task in node operation
[00:30:55]               │ debg Waiting up to 120000ms for transform state not to be stopped...
[00:30:55]               │ debg Fetching transform stats for transform ec_deleting_pivot_1626970765404_cont
[00:30:55]               │ debg Creating transform with id 'ec_deleting_latest_1626970765404_batch'...
[00:30:55]               │ debg Waiting up to 5000ms for 'ec_deleting_latest_1626970765404_batch' to exist...
[00:30:55]               │ debg Starting transform 'ec_deleting_latest_1626970765404_batch' ...
[00:30:55]               │ info [o.e.c.m.MetadataCreateIndexService] [node-01] [user-ec_3_1626970765404] creating index, cause [api], templates [], shards [1]/[1]
[00:30:55]               │ info [o.e.c.r.a.AllocationService] [node-01] updating number_of_replicas to [0] for indices [user-ec_3_1626970765404]
[00:30:55]               │ info [o.e.x.t.t.TransformTask] [node-01] [ec_deleting_latest_1626970765404_batch] updating state for transform to [{"task_state":"started","indexer_state":"stopped","checkpoint":0,"should_stop_at_checkpoint":false}].
[00:30:55]               │ info [o.e.x.t.t.TransformPersistentTasksExecutor] [node-01] [ec_deleting_latest_1626970765404_batch] successfully completed and scheduled task in node operation
[00:30:55]               │ debg Waiting up to 120000ms for batch transform to complete...
[00:30:55]               │ debg Fetching transform stats for transform ec_deleting_latest_1626970765404_batch
[00:30:55]               │ debg --- retry.waitForWithTimeout error: expected batch transform to be stopped with last checkpoint = 1 (got status: 'indexing', checkpoint: '0')
[00:30:55]               │ info [o.e.c.m.MetadataMappingService] [node-01] [user-ec_3_1626970765404/AROfp0NnRduHKHLcV32xXQ] update_mapping [_doc]
[00:30:55]               │ info [o.e.x.t.t.ClientTransformIndexer] [node-01] [ec_deleting_latest_1626970765404_batch] transform finished indexing all data, initiating stop.
[00:30:55]               │ debg Fetching transform stats for transform ec_deleting_latest_1626970765404_batch
[00:30:55]               │ debg applying update to kibana config: {"dateFormat:tz":"UTC"}
[00:30:57]               │ debg SecurityPage.forceLogout
[00:30:57]               │ debg Find.existsByDisplayedByCssSelector('.login-form') with timeout=100
[00:30:57]               │ debg --- retry.tryForTime error: .login-form is not displayed
[00:30:57]               │ debg Redirecting to /logout to force the logout
[00:30:58]               │ debg Waiting on the login form to appear
[00:30:58]               │ debg Waiting for Login Page to appear.
[00:30:58]               │ debg Waiting up to 100000ms for login page...
[00:30:58]               │ debg browser[INFO] http://localhost:61221/logout?_t=1626972624190 281 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:30:58]               │
[00:30:58]               │ debg browser[INFO] http://localhost:61221/bootstrap.js 41:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:30:58]               │ debg Find.existsByDisplayedByCssSelector('.login-form') with timeout=2500
[00:31:00]               │ERROR browser[SEVERE] http://localhost:61221/api/alerts/list_alert_types - Failed to load resource: the server responded with a status of 401 (Unauthorized)
[00:31:00]               │ debg browser[INFO] http://localhost:61221/44697/bundles/core/core.entry.js 12:156264 "Detected an unhandled Promise rejection.
[00:31:00]               │      Error: Unauthorized"
[00:31:00]               │ERROR browser[SEVERE] http://localhost:61221/44697/bundles/core/core.entry.js 5:2474 
[00:31:00]               │ debg browser[INFO] http://localhost:61221/login?msg=LOGGED_OUT 281 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:31:00]               │
[00:31:00]               │ debg browser[INFO] http://localhost:61221/bootstrap.js 41:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:31:00]               │ERROR browser[SEVERE] http://localhost:61221/api/licensing/info - Failed to load resource: the server responded with a status of 401 (Unauthorized)
[00:31:00]               │ debg --- retry.tryForTime error: .login-form is not displayed
[00:31:01]               │ debg Find.existsByDisplayedByCssSelector('.login-form') with timeout=2500
[00:31:01]               │ debg TestSubjects.exists(loginForm)
[00:31:01]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="loginForm"]') with timeout=2500
[00:31:01]               │ debg Waiting for Login Form to appear.
[00:31:01]               │ debg Waiting up to 100000ms for login form...
[00:31:01]               │ debg TestSubjects.exists(loginForm)
[00:31:01]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="loginForm"]') with timeout=2500
[00:31:01]               │ debg TestSubjects.setValue(loginUsername, transform_poweruser)
[00:31:01]               │ debg TestSubjects.click(loginUsername)
[00:31:01]               │ debg Find.clickByCssSelector('[data-test-subj="loginUsername"]') with timeout=10000
[00:31:01]               │ debg Find.findByCssSelector('[data-test-subj="loginUsername"]') with timeout=10000
[00:31:02]               │ debg TestSubjects.setValue(loginPassword, tfp001)
[00:31:02]               │ debg TestSubjects.click(loginPassword)
[00:31:02]               │ debg Find.clickByCssSelector('[data-test-subj="loginPassword"]') with timeout=10000
[00:31:02]               │ debg Find.findByCssSelector('[data-test-subj="loginPassword"]') with timeout=10000
[00:31:02]               │ debg TestSubjects.click(loginSubmit)
[00:31:02]               │ debg Find.clickByCssSelector('[data-test-subj="loginSubmit"]') with timeout=10000
[00:31:02]               │ debg Find.findByCssSelector('[data-test-subj="loginSubmit"]') with timeout=10000
[00:31:02]               │ proc [kibana]   log   [16:50:28.737] [info][plugins][routes][security] Logging in with provider "basic" (basic)
[00:31:02]               │ debg Waiting for login result, expected: chrome.
[00:31:02]               │ debg Find.findByCssSelector('[data-test-subj="userMenuButton"]') with timeout=20000
[00:31:04]               │ debg browser[INFO] http://localhost:61221/app/home 281 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:31:04]               │
[00:31:04]               │ debg browser[INFO] http://localhost:61221/bootstrap.js 41:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:31:04]               │ debg Finished login process currentUrl = http://localhost:61221/app/home#/
[00:31:04]               │ debg Waiting up to 20000ms for logout button visible...
[00:31:04]               │ debg TestSubjects.exists(userMenuButton)
[00:31:04]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="userMenuButton"]') with timeout=2500
[00:31:04]               │ debg TestSubjects.exists(userMenu)
[00:31:04]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="userMenu"]') with timeout=2500
[00:31:07]               │ debg --- retry.tryForTime error: [data-test-subj="userMenu"] is not displayed
[00:31:07]               │ debg TestSubjects.click(userMenuButton)
[00:31:07]               │ debg Find.clickByCssSelector('[data-test-subj="userMenuButton"]') with timeout=10000
[00:31:07]               │ debg Find.findByCssSelector('[data-test-subj="userMenuButton"]') with timeout=10000
[00:31:07]               │ debg TestSubjects.exists(userMenu)
[00:31:07]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="userMenu"]') with timeout=120000
[00:31:08]               │ debg TestSubjects.exists(userMenu > logoutLink)
[00:31:08]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="userMenu"] [data-test-subj="logoutLink"]') with timeout=2500
[00:36:06]             └-> "after all" hook in "deleting"
[00:36:06]               │ debg Deleting index pattern with title 'user-ec_2_1626970765404'...
[00:36:06]               │ debg Searching for 'index-pattern' with title 'user-ec_2_1626970765404'...
[00:36:06]               │ proc [kibana]   log   [16:55:32.510] [error][authentication][plugins][security] License is not available, authentication is not possible.
[00:36:06]               │ proc [kibana]   log   [16:55:32.517] [warning][licensing][plugins] License information could not be obtained from Elasticsearch due to ConnectionError: connect ECONNREFUSED 127.0.0.1:62221 error
[00:36:06]               │ info Taking screenshot "/dev/shm/workspace/parallel/22/kibana/x-pack/test/functional/screenshots/failure/transform deleting _after all_ hook in _deleting_.png"
[00:36:06]               │ info Current URL is: http://localhost:61221/app/management/data/transform
[00:36:06]               │ info Saving page source to: /dev/shm/workspace/parallel/22/kibana/x-pack/test/functional/failure_debug/html/transform deleting _after all_ hook in _deleting_.html
[00:36:06]               └- ✖ fail: transform deleting "after all" hook in "deleting"
[00:36:06]               │      Error: expected 200 "OK", got 503 "Service Unavailable"
[00:36:06]               │       at Test._assertStatus (/dev/shm/workspace/parallel/22/kibana/node_modules/supertest/lib/test.js:268:12)
[00:36:06]               │       at Test._assertFunction (/dev/shm/workspace/parallel/22/kibana/node_modules/supertest/lib/test.js:283:11)
[00:36:06]               │       at Test.assert (/dev/shm/workspace/parallel/22/kibana/node_modules/supertest/lib/test.js:173:18)
[00:36:06]               │       at assert (/dev/shm/workspace/parallel/22/kibana/node_modules/supertest/lib/test.js:131:12)
[00:36:06]               │       at /dev/shm/workspace/parallel/22/kibana/node_modules/supertest/lib/test.js:128:5
[00:36:06]               │       at Test.Request.callback (/dev/shm/workspace/parallel/22/kibana/node_modules/supertest/node_modules/superagent/lib/node/index.js:718:3)
[00:36:06]               │       at /dev/shm/workspace/parallel/22/kibana/node_modules/supertest/node_modules/superagent/lib/node/index.js:906:18
[00:36:06]               │       at IncomingMessage.<anonymous> (/dev/shm/workspace/parallel/22/kibana/node_modules/supertest/node_modules/superagent/lib/node/parsers/json.js:19:7)
[00:36:06]               │       at endReadableNT (internal/streams/readable.js:1317:12)
[00:36:06]               │       at processTicksAndRejections (internal/process/task_queues.js:82:21)
[00:36:06]               │ 
[00:36:06]               │ 

Stack Trace

Error: expected 200 "OK", got 503 "Service Unavailable"
    at Test._assertStatus (/dev/shm/workspace/parallel/22/kibana/node_modules/supertest/lib/test.js:268:12)
    at Test._assertFunction (/dev/shm/workspace/parallel/22/kibana/node_modules/supertest/lib/test.js:283:11)
    at Test.assert (/dev/shm/workspace/parallel/22/kibana/node_modules/supertest/lib/test.js:173:18)
    at assert (/dev/shm/workspace/parallel/22/kibana/node_modules/supertest/lib/test.js:131:12)
    at /dev/shm/workspace/parallel/22/kibana/node_modules/supertest/lib/test.js:128:5
    at Test.Request.callback (/dev/shm/workspace/parallel/22/kibana/node_modules/supertest/node_modules/superagent/lib/node/index.js:718:3)
    at /dev/shm/workspace/parallel/22/kibana/node_modules/supertest/node_modules/superagent/lib/node/index.js:906:18
    at IncomingMessage.<anonymous> (/dev/shm/workspace/parallel/22/kibana/node_modules/supertest/node_modules/superagent/lib/node/parsers/json.js:19:7)
    at endReadableNT (internal/streams/readable.js:1317:12)
    at processTicksAndRejections (internal/process/task_queues.js:82:21)

Kibana Pipeline / general / Chrome X-Pack UI Functional Tests.x-pack/test/functional/apps/transform.transform "after all" hook in "transform"

Link to Jenkins

Standard Out

Failed Tests Reporter:
  - Test has failed 5 times on tracked branches: https://github.com/elastic/kibana/issues/93890

[00:00:00]       │
[00:22:31]         └-: transform
[00:22:31]           └-> "before all" hook in "transform"
[00:22:31]           └-> "before all" hook in "transform"
[00:22:31]             │ debg creating role transform_source
[00:22:31]             │ info [o.e.x.s.a.r.TransportPutRoleAction] [node-01] added role [transform_source]
[00:22:31]             │ debg creating role transform_dest
[00:22:31]             │ info [o.e.x.s.a.r.TransportPutRoleAction] [node-01] added role [transform_dest]
[00:22:31]             │ debg creating role transform_dest_readonly
[00:22:31]             │ info [o.e.x.s.a.r.TransportPutRoleAction] [node-01] added role [transform_dest_readonly]
[00:22:31]             │ debg creating role transform_ui_extras
[00:22:31]             │ info [o.e.x.s.a.r.TransportPutRoleAction] [node-01] added role [transform_ui_extras]
[00:22:31]             │ debg creating user transform_poweruser
[00:22:31]             │ info [o.e.x.s.a.u.TransportPutUserAction] [node-01] added user [transform_poweruser]
[00:22:31]             │ debg created user transform_poweruser
[00:22:31]             │ debg creating user transform_viewer
[00:22:31]             │ info [o.e.x.s.a.u.TransportPutUserAction] [node-01] added user [transform_viewer]
[00:22:31]             │ debg created user transform_viewer
[00:36:06]             └-> "after all" hook in "transform"
[00:36:06]               │ debg deleting user transform_poweruser
[00:36:06]               │ proc [kibana]   log   [16:55:32.709] [error][authentication][plugins][security] License is not available, authentication is not possible.
[00:36:06]               │ proc [kibana]   log   [16:55:32.717] [warning][licensing][plugins] License information could not be obtained from Elasticsearch due to ConnectionError: connect ECONNREFUSED 127.0.0.1:62221 error
[00:36:06]               │ info Taking screenshot "/dev/shm/workspace/parallel/22/kibana/x-pack/test/functional/screenshots/failure/transform _after all_ hook in _transform_.png"
[00:36:06]               │ info Current URL is: http://localhost:61221/app/management/data/transform
[00:36:06]               │ info Saving page source to: /dev/shm/workspace/parallel/22/kibana/x-pack/test/functional/failure_debug/html/transform _after all_ hook in _transform_.html
[00:36:06]               └- ✖ fail: transform "after all" hook in "transform"
[00:36:06]               │      Error: Request failed with status code 503
[00:36:06]               │       at createError (/dev/shm/workspace/parallel/22/kibana/node_modules/axios/lib/core/createError.js:16:15)
[00:36:06]               │       at settle (/dev/shm/workspace/parallel/22/kibana/node_modules/axios/lib/core/settle.js:17:12)
[00:36:06]               │       at IncomingMessage.handleStreamEnd (/dev/shm/workspace/parallel/22/kibana/node_modules/axios/lib/adapters/http.js:260:11)
[00:36:06]               │       at endReadableNT (internal/streams/readable.js:1317:12)
[00:36:06]               │       at processTicksAndRejections (internal/process/task_queues.js:82:21)
[00:36:06]               │ 
[00:36:06]               │ 

Stack Trace

Error: Request failed with status code 503
    at createError (/dev/shm/workspace/parallel/22/kibana/node_modules/axios/lib/core/createError.js:16:15)
    at settle (/dev/shm/workspace/parallel/22/kibana/node_modules/axios/lib/core/settle.js:17:12)
    at IncomingMessage.handleStreamEnd (/dev/shm/workspace/parallel/22/kibana/node_modules/axios/lib/adapters/http.js:260:11)
    at endReadableNT (internal/streams/readable.js:1317:12)
    at processTicksAndRejections (internal/process/task_queues.js:82:21) {
  config: {
    url: 'http://elastic:changeme@localhost:61221/internal/security/users/transform_poweruser',
    method: 'delete',
    headers: {
      Accept: 'application/json, text/plain, */*',
      'kbn-xsrf': 'kbn-client',
      'User-Agent': 'axios/0.21.1'
    },
    transformRequest: [ [Function: transformRequest] ],
    transformResponse: [ [Function: transformResponse] ],
    paramsSerializer: [Function: paramsSerializer],
    timeout: 0,
    adapter: [Function: httpAdapter],
    xsrfCookieName: 'XSRF-TOKEN',
    xsrfHeaderName: 'X-XSRF-TOKEN',
    maxContentLength: 30000000,
    maxBodyLength: 30000000,
    httpsAgent: null,
    validateStatus: [Function: validateStatus],
    data: undefined
  },
  request: <ref *1> ClientRequest {
    _events: [Object: null prototype] {
      abort: [Function (anonymous)],
      aborted: [Function (anonymous)],
      connect: [Function (anonymous)],
      error: [Function (anonymous)],
      socket: [Function (anonymous)],
      timeout: [Function (anonymous)],
      prefinish: [Function: requestOnPrefinish]
    },
    _eventsCount: 7,
    _maxListeners: undefined,
    outputData: [],
    outputSize: 0,
    writable: true,
    destroyed: true,
    _last: true,
    chunkedEncoding: false,
    shouldKeepAlive: false,
    _defaultKeepAlive: true,
    useChunkedEncodingByDefault: false,
    sendDate: false,
    _removedConnection: false,
    _removedContLen: false,
    _removedTE: false,
    _contentLength: 0,
    _hasBody: true,
    _trailer: '',
    finished: true,
    _headerSent: true,
    socket: Socket {
      connecting: false,
      _hadError: false,
      _parent: null,
      _host: 'localhost',
      _readableState: [ReadableState],
      _events: [Object: null prototype],
      _eventsCount: 6,
      _maxListeners: undefined,
      _writableState: [WritableState],
      allowHalfOpen: false,
      _sockname: null,
      _pendingData: null,
      _pendingEncoding: '',
      server: null,
      _server: null,
      parser: null,
      _httpMessage: [Circular *1],
      write: [Function: writeAfterFIN],
      [Symbol(async_id_symbol)]: 403353,
      [Symbol(kHandle)]: null,
      [Symbol(kSetNoDelay)]: false,
      [Symbol(lastWriteQueueSize)]: 0,
      [Symbol(timeout)]: null,
      [Symbol(kBuffer)]: null,
      [Symbol(kBufferCb)]: null,
      [Symbol(kBufferGen)]: null,
      [Symbol(kCapture)]: false,
      [Symbol(kBytesRead)]: 552,
      [Symbol(kBytesWritten)]: 244,
      [Symbol(RequestTimeout)]: undefined
    },
    _header: 'DELETE /internal/security/users/transform_poweruser HTTP/1.1\r\n' +
      'Accept: application/json, text/plain, */*\r\n' +
      'kbn-xsrf: kbn-client\r\n' +
      'User-Agent: axios/0.21.1\r\n' +
      'Host: localhost:61221\r\n' +
      'Authorization: Basic ZWxhc3RpYzpjaGFuZ2VtZQ==\r\n' +
      'Connection: close\r\n' +
      '\r\n',
    _keepAliveTimeout: 0,
    _onPendingData: [Function: noopPendingOutput],
    agent: Agent {
      _events: [Object: null prototype],
      _eventsCount: 2,
      _maxListeners: undefined,
      defaultPort: 80,
      protocol: 'http:',
      options: [Object],
      requests: {},
      sockets: {},
      freeSockets: {},
      keepAliveMsecs: 1000,
      keepAlive: false,
      maxSockets: Infinity,
      maxFreeSockets: 256,
      scheduling: 'lifo',
      maxTotalSockets: Infinity,
      totalSocketCount: 0,
      [Symbol(kCapture)]: false
    },
    socketPath: undefined,
    method: 'DELETE',
    maxHeaderSize: undefined,
    insecureHTTPParser: undefined,
    path: '/internal/security/users/transform_poweruser',
    _ended: true,
    res: IncomingMessage {
      _readableState: [ReadableState],
      _events: [Object: null prototype],
      _eventsCount: 3,
      _maxListeners: undefined,
      socket: [Socket],
      httpVersionMajor: 1,
      httpVersionMinor: 1,
      httpVersion: '1.1',
      complete: true,
      headers: [Object],
      rawHeaders: [Array],
      trailers: {},
      rawTrailers: [],
      aborted: false,
      upgrade: false,
      url: '',
      method: null,
      statusCode: 503,
      statusMessage: 'Service Unavailable',
      client: [Socket],
      _consuming: false,
      _dumped: false,
      req: [Circular *1],
      responseUrl: 'http://elastic:changeme@localhost:61221/internal/security/users/transform_poweruser',
      redirects: [],
      [Symbol(kCapture)]: false,
      [Symbol(RequestTimeout)]: undefined
    },
    aborted: false,
    timeoutCb: null,
    upgradeOrConnect: false,
    parser: null,
    maxHeadersCount: null,
    reusedSocket: false,
    host: 'localhost',
    protocol: 'http:',
    _redirectable: Writable {
      _writableState: [WritableState],
      _events: [Object: null prototype],
      _eventsCount: 2,
      _maxListeners: undefined,
      _options: [Object],
      _ended: true,
      _ending: true,
      _redirectCount: 0,
      _redirects: [],
      _requestBodyLength: 0,
      _requestBodyBuffers: [],
      _onNativeResponse: [Function (anonymous)],
      _currentRequest: [Circular *1],
      _currentUrl: 'http://elastic:changeme@localhost:61221/internal/security/users/transform_poweruser',
      [Symbol(kCapture)]: false
    },
    [Symbol(kCapture)]: false,
    [Symbol(kNeedDrain)]: false,
    [Symbol(corked)]: 0,
    [Symbol(kOutHeaders)]: [Object: null prototype] {
      accept: [Array],
      'kbn-xsrf': [Array],
      'user-agent': [Array],
      host: [Array],
      authorization: [Array]
    }
  },
  response: {
    status: 503,
    statusText: 'Service Unavailable',
    headers: {
      'retry-after': '30',
      'x-content-type-options': 'nosniff',
      'referrer-policy': 'no-referrer-when-downgrade',
      'kbn-name': 'kibana-ci-immutable-centos-tests-xxl-1626968734346513285',
      'kbn-license-sig': '3f1f91ad12edaa30060d1194c2b0f43b7e73b21397500e4a1b4d8474ded656d6',
      'content-type': 'application/json; charset=utf-8',
      'cache-control': 'private, no-cache, no-store, must-revalidate',
      'content-length': '86',
      date: 'Thu, 22 Jul 2021 16:55:32 GMT',
      connection: 'close'
    },
    config: {
      url: 'http://elastic:changeme@localhost:61221/internal/security/users/transform_poweruser',
      method: 'delete',
      headers: [Object],
      transformRequest: [Array],
      transformResponse: [Array],
      paramsSerializer: [Function: paramsSerializer],
      timeout: 0,
      adapter: [Function: httpAdapter],
      xsrfCookieName: 'XSRF-TOKEN',
      xsrfHeaderName: 'X-XSRF-TOKEN',
      maxContentLength: 30000000,
      maxBodyLength: 30000000,
      httpsAgent: null,
      validateStatus: [Function: validateStatus],
      data: undefined
    },
    request: <ref *1> ClientRequest {
      _events: [Object: null prototype],
      _eventsCount: 7,
      _maxListeners: undefined,
      outputData: [],
      outputSize: 0,
      writable: true,
      destroyed: true,
      _last: true,
      chunkedEncoding: false,
      shouldKeepAlive: false,
      _defaultKeepAlive: true,
      useChunkedEncodingByDefault: false,
      sendDate: false,
      _removedConnection: false,
      _removedContLen: false,
      _removedTE: false,
      _contentLength: 0,
      _hasBody: true,
      _trailer: '',
      finished: true,
      _headerSent: true,
      socket: [Socket],
      _header: 'DELETE /internal/security/users/transform_poweruser HTTP/1.1\r\n' +
        'Accept: application/json, text/plain, */*\r\n' +
        'kbn-xsrf: kbn-client\r\n' +
        'User-Agent: axios/0.21.1\r\n' +
        'Host: localhost:61221\r\n' +
        'Authorization: Basic ZWxhc3RpYzpjaGFuZ2VtZQ==\r\n' +
        'Connection: close\r\n' +
        '\r\n',
      _keepAliveTimeout: 0,
      _onPendingData: [Function: noopPendingOutput],
      agent: [Agent],
      socketPath: undefined,
      method: 'DELETE',
      maxHeaderSize: undefined,
      insecureHTTPParser: undefined,
      path: '/internal/security/users/transform_poweruser',
      _ended: true,
      res: [IncomingMessage],
      aborted: false,
      timeoutCb: null,
      upgradeOrConnect: false,
      parser: null,
      maxHeadersCount: null,
      reusedSocket: false,
      host: 'localhost',
      protocol: 'http:',
      _redirectable: [Writable],
      [Symbol(kCapture)]: false,
      [Symbol(kNeedDrain)]: false,
      [Symbol(corked)]: 0,
      [Symbol(kOutHeaders)]: [Object: null prototype]
    },
    data: {
      statusCode: 503,
      error: 'Service Unavailable',
      message: 'License is not available.'
    }
  },
  isAxiosError: true,
  toJSON: [Function: toJSON]
}

Metrics [docs]

Public APIs missing comments

Total count of every public API that lacks a comment. Target amount is 0. Run node scripts/build_api_docs --plugin [yourplugin] --stats comments for more detailed information.

id before after diff
actions - 117 +117
advancedSettings - 22 +22
alerting - 234 +234
apm - 39 +39
apmOss - 4 +4
banners - 9 +9
bfetch - 62 +62
canvas - 5 +5
cases - 407 +407
charts - 159 +159
cloud - 21 +21
core - 1080 +1080
dashboard - 137 +137
dashboardEnhanced - 50 +50
dashboardMode - 11 +11
data - 3162 +3162
dataEnhanced - 16 +16
dataVisualizer - 104 +104
devTools - 8 +8
discover - 55 +55
discoverEnhanced - 37 +37
embeddable - 384 +384
embeddableEnhanced - 14 +14
encryptedSavedObjects - 28 +28
enterpriseSearch - 2 +2
esUiShared - 90 +90
eventLog - 70 +70
expressionError - 12 +12
expressionRevealImage - 4 +4
expressions - 1567 +1567
expressionShape - 90 +90
features - 97 +97
fileUpload - 128 +128
fleet - 1033 +1033
globalSearch - 14 +14
home - 70 +70
indexLifecycleManagement - 4 +4
indexManagement - 157 +157
indexPatternFieldEditor - 29 +29
infra - 22 +22
inspector - 78 +78
kibanaLegacy - 62 +62
kibanaReact - 230 +230
kibanaUtils - 359 +359
lens - 169 +169
licenseApiGuard - 8 +8
licenseManagement - 3 +3
licensing - 42 +42
lists - 143 +143
management - 40 +40
maps - 203 +203
mapsEms - 75 +75
metricsEntities - 6 +6
ml - 274 +274
monitoring - 10 +10
navigation - 31 +31
newsfeed - 17 +17
observability - 219 +219
osquery - 11 +11
presentationUtil - 136 +136
remoteClusters - 4 +4
reporting - 132 +132
rollup - 20 +20
ruleRegistry - 60 +60
runtimeFields - 19 +19
savedObjects - 199 +199
savedObjectsManagement - 85 +85
savedObjectsTagging - 50 +50
savedObjectsTaggingOss - 50 +50
screenshotMode - 17 +17
security - 51 +51
securityOss - 9 +9
securitySolution - 1130 +1130
share - 83 +83
snapshotRestore - 22 +22
spacesOss - 5 +5
stackAlerts - 4 +4
taskManager - 25 +25
telemetryCollectionManager - 29 +29
telemetryCollectionXpack - 1 +1
telemetryManagementSection - 13 +13
timelines - 763 +763
triggersActionsUi - 228 +228
uiActions - 88 +88
uiActionsEnhanced - 147 +147
urlForwarding - 15 +15
usageCollection - 16 +16
visTypeTimeseries - 10 +10
visualizations - 229 +229
total +15174

Any counts in public APIs

Total count of every any typed public API. Target amount is 0. Run node scripts/build_api_docs --plugin [yourplugin] --stats any for more detailed information.

id before after diff
bfetch - 1 +1
charts - 2 +2
core - 148 +148
dashboard - 1 +1
data - 98 +98
dataVisualizer - 3 +3
embeddable - 4 +4
esUiShared - 4 +4
expressions - 58 +58
fileUpload - 4 +4
fleet - 15 +15
indexManagement - 12 +12
indexPatternFieldEditor - 1 +1
inspector - 6 +6
kibanaLegacy - 3 +3
kibanaReact - 5 +5
kibanaUtils - 3 +3
maps - 2 +2
mapsEms - 1 +1
ml - 10 +10
presentationUtil - 3 +3
reporting - 1 +1
savedObjects - 3 +3
savedObjectsTaggingOss - 3 +3
securitySolution - 8 +8
share - 1 +1
snapshotRestore - 1 +1
timelines - 6 +6
triggersActionsUi - 1 +1
uiActionsEnhanced - 2 +2
visTypeTimeseries - 1 +1
visualizations - 13 +13
total +424

Async chunks

Total size of all lazy-loaded chunks that will be downloaded as the user navigates the app

id before after diff
lists 272.4KB 273.0KB +658.0B
securitySolution 6.3MB 6.3MB +658.0B
total +1.3KB

Public APIs missing exports

Total count of every type that is part of your API that should be exported but is not. This will cause broken links in the API documentation system. Target amount is 0. Run node scripts/build_api_docs --plugin [yourplugin] --stats exports for more detailed information.

id before after diff
actions - 7 +7
advancedSettings - 1 +1
alerting - 16 +16
apm - 30 +30
bfetch - 2 +2
canvas - 3 +3
cases - 14 +14
charts - 1 +1
core - 31 +31
dashboard - 9 +9
data - 64 +64
dataEnhanced - 2 +2
devTools - 2 +2
discover - 6 +6
discoverEnhanced - 2 +2
embeddable - 3 +3
encryptedSavedObjects - 3 +3
esUiShared - 1 +1
eventLog - 4 +4
expressionError - 2 +2
expressionRevealImage - 1 +1
expressions - 5 +5
features - 2 +2
fileUpload - 1 +1
fleet - 8 +8
globalSearch - 5 +5
home - 5 +5
indexManagement - 3 +3
indexPatternFieldEditor - 4 +4
infra - 3 +3
inspector - 4 +4
kibanaLegacy - 1 +1
kibanaReact - 4 +4
kibanaUtils - 8 +8
lens - 14 +14
licensing - 8 +8
lists - 38 +38
management - 5 +5
maps - 11 +11
metricsEntities - 1 +1
ml - 33 +33
monitoring - 2 +2
navigation - 2 +2
observability - 10 +10
presentationUtil - 5 +5
reporting - 14 +14
ruleRegistry - 9 +9
runtimeFields - 2 +2
savedObjects - 5 +5
screenshotMode - 1 +1
security - 6 +6
securityOss - 3 +3
securitySolution - 28 +28
share - 8 +8
snapshotRestore - 1 +1
taskManager - 8 +8
telemetryCollectionManager - 4 +4
timelines - 25 +25
triggersActionsUi - 19 +19
uiActions - 11 +11
uiActionsEnhanced - 10 +10
usageCollection - 2 +2
visTypeTimeseries - 3 +3
visualizations - 12 +12
total +557
Unknown metric groups

API count

id before after diff
actions - 117 +117
advancedSettings - 23 +23
alerting - 242 +242
apm - 39 +39
apmOss - 4 +4
banners - 9 +9
bfetch - 73 +73
canvas - 6 +6
cases - 445 +445
charts - 190 +190
cloud - 21 +21
core - 2359 +2359
dashboard - 160 +160
dashboardEnhanced - 51 +51
dashboardMode - 11 +11
data - 3716 +3716
dataEnhanced - 16 +16
dataVisualizer - 104 +104
devTools - 10 +10
discover - 81 +81
discoverEnhanced - 39 +39
embeddable - 456 +456
embeddableEnhanced - 14 +14
encryptedSavedObjects - 30 +30
enterpriseSearch - 2 +2
esUiShared - 92 +92
eventLog - 70 +70
expressionError - 12 +12
expressionRevealImage - 4 +4
expressions - 2003 +2003
expressionShape - 90 +90
features - 215 +215
fileUpload - 128 +128
fleet - 1128 +1128
globalSearch - 68 +68
home - 94 +94
indexLifecycleManagement - 4 +4
indexManagement - 162 +162
indexPatternFieldEditor - 31 +31
infra - 25 +25
inspector - 101 +101
kibanaLegacy - 66 +66
kibanaReact - 260 +260
kibanaUtils - 551 +551
lens - 185 +185
licenseApiGuard - 8 +8
licenseManagement - 3 +3
licensing - 117 +117
lists - 150 +150
management - 40 +40
maps - 204 +204
mapsEms - 75 +75
metricsEntities - 9 +9
ml - 278 +278
monitoring - 10 +10
navigation - 31 +31
newsfeed - 17 +17
observability - 219 +219
osquery - 11 +11
presentationUtil - 163 +163
remoteClusters - 4 +4
reporting - 133 +133
rollup - 20 +20
ruleRegistry - 60 +60
runtimeFields - 24 +24
savedObjects - 213 +213
savedObjectsManagement - 96 +96
savedObjectsTagging - 54 +54
savedObjectsTaggingOss - 89 +89
screenshotMode - 22 +22
security - 112 +112
securityOss - 12 +12
securitySolution - 1181 +1181
share - 123 +123
snapshotRestore - 23 +23
spaces - 106 +106
spacesOss - 72 +72
stackAlerts - 4 +4
taskManager - 52 +52
telemetry - 42 +42
telemetryCollectionManager - 29 +29
telemetryCollectionXpack - 1 +1
telemetryManagementSection - 14 +14
timelines - 882 +882
triggersActionsUi - 237 +237
uiActions - 127 +127
uiActionsEnhanced - 205 +205
urlForwarding - 15 +15
usageCollection - 57 +57
visTypeTimeseries - 10 +10
visualizations - 247 +247
total +19108

References to deprecated APIs

id before after diff
actions - 8 +8
alerting - 32 +32
apm - 7 +7
canvas - 55 +55
cases - 151 +151
crossClusterReplication - 2 +2
dashboard - 128 +128
dashboardEnhanced - 10 +10
dataEnhanced - 53 +53
dataVisualizer - 16 +16
discover - 102 +102
discoverEnhanced - 19 +19
embeddable - 2 +2
encryptedSavedObjects - 2 +2
fleet - 89 +89
globalSearch - 4 +4
graph - 2 +2
indexLifecycleManagement - 2 +2
indexManagement - 12 +12
infra - 292 +292
lens - 168 +168
lists - 242 +242
maps - 592 +592
ml - 140 +140
observability - 34 +34
presentationUtil - 2 +2
savedObjects - 6 +6
savedObjectsManagement - 18 +18
savedObjectsTaggingOss - 5 +5
security - 2 +2
securitySolution - 919 +919
stackAlerts - 104 +104
timelines - 76 +76
transform - 16 +16
uptime - 11 +11
urlDrilldown - 18 +18
visTypeTimeseries - 10 +10
visualizations - 32 +32
total +3383

History

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

cc @FrankHassanabad

Copy link
Contributor

@peluja1012 peluja1012 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Logic makes sense to me. Thanks for adding the backend plumbing to support Linux exceptions!

@FrankHassanabad FrankHassanabad merged commit 0a5c96b into elastic:master Jul 22, 2021
@FrankHassanabad FrankHassanabad added the auto-backport Deprecated - use backport:version if exact versions are needed label Jul 22, 2021
kibanamachine pushed a commit to kibanamachine/kibana that referenced this pull request Jul 22, 2021
… type (elastic#106494)

## Summary

Fixes elastic#102613, and targets `7.14.0` as a blocker/critical

Previously we never fully finished the plumbing for using the `os_types` (operating system type) in the exception lists to be able to filter out values based on this type. With the endpoint exceptions now having specific selections for os_type we have to filter it with exceptions and basically make it work.

Some caveats is that the endpoints utilize `host.os.name.casless` for filtering against os_type, while agents such as auditbeat, winlogbeat, etc... use `host.os.type`. Really `host.os.type` is the correct ECS field to use, but to retain compatibility with the current version of endpoint agents I support both in one query to where if either of these two matches, then that will trigger the exceptions.

* Adds e2e tests
* Enhances the e2e tooling to do endpoint exception testing with `os_types`.
* Adds the logic to handle os_type
* Updates the unit tests

### Checklist

Delete any items that are not applicable to this PR.

- [x] [Unit or functional tests](https://www.elastic.co/guide/en/kibana/master/development-tests.html) were updated or added to match the most common scenarios
kibanamachine pushed a commit to kibanamachine/kibana that referenced this pull request Jul 22, 2021
… type (elastic#106494)

## Summary

Fixes elastic#102613, and targets `7.14.0` as a blocker/critical

Previously we never fully finished the plumbing for using the `os_types` (operating system type) in the exception lists to be able to filter out values based on this type. With the endpoint exceptions now having specific selections for os_type we have to filter it with exceptions and basically make it work.

Some caveats is that the endpoints utilize `host.os.name.casless` for filtering against os_type, while agents such as auditbeat, winlogbeat, etc... use `host.os.type`. Really `host.os.type` is the correct ECS field to use, but to retain compatibility with the current version of endpoint agents I support both in one query to where if either of these two matches, then that will trigger the exceptions.

* Adds e2e tests
* Enhances the e2e tooling to do endpoint exception testing with `os_types`.
* Adds the logic to handle os_type
* Updates the unit tests

### Checklist

Delete any items that are not applicable to this PR.

- [x] [Unit or functional tests](https://www.elastic.co/guide/en/kibana/master/development-tests.html) were updated or added to match the most common scenarios
@kibanamachine
Copy link
Contributor

💚 Backport successful

Status Branch Result
7.14
7.x

The backport PRs will be merged automatically after passing CI.

kibanamachine added a commit that referenced this pull request Jul 22, 2021
… type (#106494) (#106596)

## Summary

Fixes #102613, and targets `7.14.0` as a blocker/critical

Previously we never fully finished the plumbing for using the `os_types` (operating system type) in the exception lists to be able to filter out values based on this type. With the endpoint exceptions now having specific selections for os_type we have to filter it with exceptions and basically make it work.

Some caveats is that the endpoints utilize `host.os.name.casless` for filtering against os_type, while agents such as auditbeat, winlogbeat, etc... use `host.os.type`. Really `host.os.type` is the correct ECS field to use, but to retain compatibility with the current version of endpoint agents I support both in one query to where if either of these two matches, then that will trigger the exceptions.

* Adds e2e tests
* Enhances the e2e tooling to do endpoint exception testing with `os_types`.
* Adds the logic to handle os_type
* Updates the unit tests

### Checklist

Delete any items that are not applicable to this PR.

- [x] [Unit or functional tests](https://www.elastic.co/guide/en/kibana/master/development-tests.html) were updated or added to match the most common scenarios

Co-authored-by: Frank Hassanabad <frank.hassanabad@elastic.co>
kibanamachine added a commit that referenced this pull request Jul 22, 2021
… type (#106494) (#106597)

## Summary

Fixes #102613, and targets `7.14.0` as a blocker/critical

Previously we never fully finished the plumbing for using the `os_types` (operating system type) in the exception lists to be able to filter out values based on this type. With the endpoint exceptions now having specific selections for os_type we have to filter it with exceptions and basically make it work.

Some caveats is that the endpoints utilize `host.os.name.casless` for filtering against os_type, while agents such as auditbeat, winlogbeat, etc... use `host.os.type`. Really `host.os.type` is the correct ECS field to use, but to retain compatibility with the current version of endpoint agents I support both in one query to where if either of these two matches, then that will trigger the exceptions.

* Adds e2e tests
* Enhances the e2e tooling to do endpoint exception testing with `os_types`.
* Adds the logic to handle os_type
* Updates the unit tests

### Checklist

Delete any items that are not applicable to this PR.

- [x] [Unit or functional tests](https://www.elastic.co/guide/en/kibana/master/development-tests.html) were updated or added to match the most common scenarios

Co-authored-by: Frank Hassanabad <frank.hassanabad@elastic.co>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

auto-backport Deprecated - use backport:version if exact versions are needed bug Fixes for quality problems that affect the customer experience Feature:Rule Exceptions Security Solution Detection Rule Exceptions area impact:critical This issue should be addressed immediately due to a critical level of impact on the product. release_note:fix Team:Detections and Resp Security Detection Response Team v7.14.0 v7.15.0 v8.0.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Security Solution] Alerts are not triggered for windows OS if user add the exception for MAC OS Only.

5 participants