Task manager/health with dynamic configs

[gmmorris]

Summary

merge of #75666 with #77868

Checklist

Delete any items that are not applicable to this PR.

• Any text added follows EUI's writing guidelines, uses sentence case text and includes i18n support
• Documentation was added for features that require explanation or tutorials
• Unit or functional tests were updated or added to match the most common scenarios
• Any UI touched in this PR is usable by keyboard only (learn more about keyboard accessibility)
• Any UI touched in this PR does not create any new axe failures (run axe in browser: FF, Chrome)
• This renders correctly on smaller devices using a responsive layout. (You can test this in your browser)
• This was checked for cross-browser compatibility

For maintainers

• This was checked for breaking API changes and was labeled appropriately

[kibanamachine]

💔 Build Failed

• continuous-integration/kibana-ci/pull-request
• Commit: 6ec6466
• Pipeline Steps (look for red circles / failed steps)
• Interpreting CI Failures

Failed CI Steps

• Check Types
• Execute xpack-kibana-ciGroup2
• Execute xpack-kibana-ciGroup2

---

Test Failures

Plugin Functional Tests.x-pack/test/plugin_api_integration/test_suites/task_manager/health_route·ts.task_manager health should return a breakdown of idleTasks in the task manager workload

Link to Jenkins

Standard Out

Failed Tests Reporter:
  - Test has failed 1 times on tracked branches: https://dryrun

[00:00:00]       │
[00:00:00]         └-: task_manager
[00:00:00]           └-> "before all" hook
[00:00:00]           └-: health
[00:00:00]             └-> "before all" hook
[00:00:00]             └-> should return basic configuration of task manager
[00:00:00]               └-> "before each" hook: global before each
[00:00:00]               └- ✓ pass  (13ms) "task_manager health should return basic configuration of task manager"
[00:00:00]             └-> should return the task manager workload
[00:00:00]               └-> "before each" hook: global before each
[00:00:03]               │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1602514953838832103] [.kibana_task_manager_test_result] creating index, cause [auto(bulk api)], templates [], shards [1]/[1]
[00:00:03]               │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1602514953838832103] [.kibana_task_manager_test_result/WW7IVT4JSA2vAghiCS7uwA] create_mapping
[00:00:05]               └- ✓ pass  (5.1s) "task_manager health should return the task manager workload"
[00:00:05]             └-> should return a breakdown of idleTasks in the task manager workload
[00:00:05]               └-> "before each" hook: global before each
[00:00:05]               └- ✖ fail: task_manager health should return a breakdown of idleTasks in the task manager workload
[00:00:05]               │       Error: expected 21 to sort of equal 20
[00:00:05]               │       + expected - actual
[00:00:05]               │ 
[00:00:05]               │       -21
[00:00:05]               │       +20
[00:00:05]               │       
[00:00:05]               │       at Assertion.assert (/dev/shm/workspace/parallel/5/kibana/packages/kbn-expect/expect.js:100:11)
[00:00:05]               │       at Assertion.eql (/dev/shm/workspace/parallel/5/kibana/packages/kbn-expect/expect.js:244:8)
[00:00:05]               │       at Context.it (test/plugin_api_integration/test_suites/task_manager/health_route.ts:155:50)
[00:00:05]               │ 
[00:00:05]               │ 

Stack Trace

{ Error: expected 21 to sort of equal 20
    at Assertion.assert (/dev/shm/workspace/parallel/5/kibana/packages/kbn-expect/expect.js:100:11)
    at Assertion.eql (/dev/shm/workspace/parallel/5/kibana/packages/kbn-expect/expect.js:244:8)
    at Context.it (test/plugin_api_integration/test_suites/task_manager/health_route.ts:155:50) actual: '21', expected: '20', showDiff: true }

---

Plugin Functional Tests.x-pack/test/plugin_api_integration/test_suites/task_manager/health_route·ts.task_manager health should return a breakdown of idleTasks in the task manager workload

Link to Jenkins

Standard Out

Failed Tests Reporter:
  - Test has not failed recently on tracked branches

[00:00:00]       │
[00:00:00]         └-: task_manager
[00:00:00]           └-> "before all" hook
[00:00:00]           └-: health
[00:00:00]             └-> "before all" hook
[00:00:00]             └-> should return basic configuration of task manager
[00:00:00]               └-> "before each" hook: global before each
[00:00:00]               └- ✓ pass  (12ms) "task_manager health should return basic configuration of task manager"
[00:00:00]             └-> should return the task manager workload
[00:00:00]               └-> "before each" hook: global before each
[00:00:03]               │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1602514953838832103] [.kibana_task_manager_test_result] creating index, cause [auto(bulk api)], templates [], shards [1]/[1]
[00:00:03]               │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1602514953838832103] [.kibana_task_manager_test_result/Qecp69eQQ1y7C0hiHrvF9w] create_mapping
[00:00:03]               │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-18-tests-xxl-1602514953838832103] [ilm-history-3-000001] creating index, cause [api], templates [ilm-history], shards [1]/[0]
[00:00:03]               │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-18-tests-xxl-1602514953838832103] moving index [ilm-history-3-000001] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [ilm-history-ilm-policy]
[00:00:03]               │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-18-tests-xxl-1602514953838832103] moving index [ilm-history-3-000001] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"unfollow","name":"wait-for-indexing-complete"}] in policy [ilm-history-ilm-policy]
[00:00:03]               │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-18-tests-xxl-1602514953838832103] moving index [ilm-history-3-000001] from [{"phase":"hot","action":"unfollow","name":"wait-for-indexing-complete"}] to [{"phase":"hot","action":"unfollow","name":"wait-for-follow-shard-tasks"}] in policy [ilm-history-ilm-policy]
[00:00:05]               └- ✓ pass  (5.1s) "task_manager health should return the task manager workload"
[00:00:05]             └-> should return a breakdown of idleTasks in the task manager workload
[00:00:05]               └-> "before each" hook: global before each
[00:00:05]               └- ✖ fail: task_manager health should return a breakdown of idleTasks in the task manager workload
[00:00:05]               │       Error: expected 21 to sort of equal 20
[00:00:05]               │       + expected - actual
[00:00:05]               │ 
[00:00:05]               │       -21
[00:00:05]               │       +20
[00:00:05]               │       
[00:00:05]               │       at Assertion.assert (/dev/shm/workspace/parallel/5/kibana/packages/kbn-expect/expect.js:100:11)
[00:00:05]               │       at Assertion.eql (/dev/shm/workspace/parallel/5/kibana/packages/kbn-expect/expect.js:244:8)
[00:00:05]               │       at Context.it (test/plugin_api_integration/test_suites/task_manager/health_route.ts:155:50)
[00:00:05]               │ 
[00:00:05]               │ 

Stack Trace

{ Error: expected 21 to sort of equal 20
    at Assertion.assert (/dev/shm/workspace/parallel/5/kibana/packages/kbn-expect/expect.js:100:11)
    at Assertion.eql (/dev/shm/workspace/parallel/5/kibana/packages/kbn-expect/expect.js:244:8)
    at Context.it (test/plugin_api_integration/test_suites/task_manager/health_route.ts:155:50) actual: '21', expected: '20', showDiff: true }

---

Metrics [docs]

distributable file count

id	before	after	diff
default	48453	48464	+11

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream