[Stack Monitoring] Logstash migration

[phillipb]

Summary

Migrate logstash pages. Fixes: #111759

[elasticmachine]

Pinging @elastic/logs-metrics-ui (Team:logs-metrics-ui)

[matschaffer]

Got a couple code process notes. Looks decent overall. I'll try to exercise it.

[matschaffer]

We should probably add the single node view as well, or remove the "fixes" from the description here

[matschaffer]

Looks like we're missing the pipeline stage version and flyout too

Great start though! I'd be fine ✅ once the basics (merge issue, "fixes" comment) are fixed up.

[matschaffer]

@elasticmachine merge upstream

[matschaffer]

Spotted a couple of issues. But we could potentially fix in a follow up.

[klacabane]

nit: the fallback to an empty object breaks line 74 when reading clusterStatus.versions. Can we make the initial pageData check more robust (or maybe null is enough) and get rid of fallbacks and conditionals in the following lines ?

[kibanamachine]

💛 Build succeeded, but was flaky

• continuous-integration/kibana-ci/pull-request
• Commit: 18051a8
• Storybooks Preview
• Documentation Changes
• Flaky suites:
  • xpack-kibana-ciGroup6

---

Test Failures

Kibana Pipeline / general / X-Pack API Integration Tests.x-pack/test/api_integration/apis/search/session·ts.apis search search session touched time updates when you poll on an search

Link to Jenkins

Standard Out

Failed Tests Reporter:
  - Test has not failed recently on tracked branches

[00:00:00]                 │
[00:00:00]                   └-: apis
[00:00:00]                     └-> "before all" hook in "apis"
[00:00:00]                     └-: search
[00:00:00]                       └-> "before all" hook in "search"
[00:00:03]                       └-: search session
[00:00:03]                         └-> "before all" hook for "should fail to extend a nonexistent session"
[00:00:03]                         └-> should fail to extend a nonexistent session
[00:00:03]                           └-> "before each" hook: global before each for "should fail to extend a nonexistent session"
[00:00:03]                           │ proc [kibana] [2021-10-06T01:44:17.451+00:00][ERROR][plugins.dataEnhanced.data_enhanced] [object Object]
[00:00:03]                           └- ✓ pass  (86ms) "apis search search session should fail to extend a nonexistent session"
[00:00:03]                         └-> should sync search ids into not persisted session
[00:00:03]                           └-> "before each" hook: global before each for "should sync search ids into not persisted session"
[00:00:03]                           │ debg Waiting up to 5000ms for searches persisted into session...
[00:00:03]                           │ proc [kibana] [2021-10-06T01:44:17.612+00:00][ERROR][plugins.dataEnhanced.data_enhanced] [object Object]
[00:00:03]                           │ debg --- retry.waitForWithTimeout error: expected 200 "OK", got 404 "Not Found"
[00:00:04]                           │ proc [kibana] [2021-10-06T01:44:18.180+00:00][ERROR][plugins.dataEnhanced.data_enhanced] [object Object]
[00:00:04]                           │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:00:04]                           │ info [o.e.c.m.MetadataMappingService] [node-01] [.kibana_8.0.0_001/FNJrU6RqSFq_3NiAmOHqrA] update_mapping [_doc]
[00:00:04]                           └- ✓ pass  (1.3s) "apis search search session should sync search ids into not persisted session"
[00:00:04]                         └-> should complete session when searches complete
[00:00:04]                           └-> "before each" hook: global before each for "should complete session when searches complete"
[00:00:05]                           │ debg Waiting up to 5000ms for searches persisted into session...
[00:00:08]                           │ info [o.e.c.m.MetadataMappingService] [node-01] [.kibana_8.0.0_001/FNJrU6RqSFq_3NiAmOHqrA] update_mapping [_doc]
[00:00:15]                           │ debg Waiting up to 5000ms for searches eventually complete and session gets into the complete state...
[00:00:15]                           └- ✓ pass  (11.2s) "apis search search session should complete session when searches complete"
[00:00:15]                         └-> touched time updates when you poll on an search
[00:00:15]                           └-> "before each" hook: global before each for "touched time updates when you poll on an search"
[00:00:15]                           │ debg Waiting up to 20000ms for search session created...
[00:00:15]                           │ proc [kibana] [2021-10-06T01:44:30.018+00:00][ERROR][plugins.dataEnhanced.data_enhanced] [object Object]
[00:00:16]                           │ proc [kibana] [2021-10-06T01:44:30.599+00:00][ERROR][plugins.dataEnhanced.data_enhanced] [object Object]
[00:00:19]                           └- ✖ fail: apis search search session touched time updates when you poll on an search
[00:00:19]                           │      Error: expected '2021-10-06T01:44:30.989Z' to be below 2021-10-06T01:44:30.989Z
[00:00:19]                           │       at Assertion.assert (/dev/shm/workspace/parallel/12/kibana/node_modules/@kbn/expect/expect.js:100:11)
[00:00:19]                           │       at Assertion.lessThan.Assertion.below (/dev/shm/workspace/parallel/12/kibana/node_modules/@kbn/expect/expect.js:336:8)
[00:00:19]                           │       at Function.lessThan (/dev/shm/workspace/parallel/12/kibana/node_modules/@kbn/expect/expect.js:531:15)
[00:00:19]                           │       at Context.<anonymous> (test/api_integration/apis/search/session.ts:438:65)
[00:00:19]                           │       at runMicrotasks (<anonymous>)
[00:00:19]                           │       at processTicksAndRejections (internal/process/task_queues.js:95:5)
[00:00:19]                           │       at Object.apply (/dev/shm/workspace/parallel/12/kibana/node_modules/@kbn/test/target_node/functional_test_runner/lib/mocha/wrap_function.js:87:16)
[00:00:19]                           │ 
[00:00:19]                           │ 

Stack Trace

Error: expected '2021-10-06T01:44:30.989Z' to be below 2021-10-06T01:44:30.989Z
    at Assertion.assert (/dev/shm/workspace/parallel/12/kibana/node_modules/@kbn/expect/expect.js:100:11)
    at Assertion.lessThan.Assertion.below (/dev/shm/workspace/parallel/12/kibana/node_modules/@kbn/expect/expect.js:336:8)
    at Function.lessThan (/dev/shm/workspace/parallel/12/kibana/node_modules/@kbn/expect/expect.js:531:15)
    at Context.<anonymous> (test/api_integration/apis/search/session.ts:438:65)
    at runMicrotasks (<anonymous>)
    at processTicksAndRejections (internal/process/task_queues.js:95:5)
    at Object.apply (/dev/shm/workspace/parallel/12/kibana/node_modules/@kbn/test/target_node/functional_test_runner/lib/mocha/wrap_function.js:87:16)

---

Metrics [docs]

Module Count

Fewer modules leads to a faster build time

id	before	after	diff
monitoring	631	640	+9

Async chunks

Total size of all lazy-loaded chunks that will be downloaded as the user navigates the app

id	before	after	diff
monitoring	1011.0KB	1.0MB	+34.0KB

History

• 💔 Build #158254 failed c555bba
• 💚 Build #158004 succeeded 2ea390a
• 💚 Build #157853 succeeded eb68708
• 💔 Build #157515 failed 02c3195
• 💔 Build #157501 failed 5b87458

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

[matschaffer]

I think we can go with this. I noticed a few code level tweaks that I put in phillipb#1 for you (just merge if you're cool with it).

The other weird thing I notices is that the pipeline view detail drawer re-opens after you hit the "X" then you have to click it again to close. Here's a recording:

Otherwise looks good to me and we can patch up weirdness as a followup I think.

[kibanamachine]

💚 Backport successful

Status	Branch	Result
✅	7.x

This backport PR will be merged automatically after passing CI.