[osquery] Setup E2E against Serverless ES, Kibana, Fleet server standalone and Elastic agents in Docker by patrykkopycinski · Pull Request #165415 · elastic/kibana

patrykkopycinski · 2023-08-31T22:16:28Z

Summary

Let's automate E2E against Serverless

Changelog:

updated certs to include additional dns names we are using for testing locally, host.docker.internal, es01
updated certs generation README to include changes related to openssl@3
added new certs for Fleet server
added fleet-server service token
added support for ca_trusted_fingerprint in fleet preconfig

…-fix'

# Conflicts: # x-pack/plugins/security_solution/scripts/endpoint/common/stack_services.ts

# Conflicts: # x-pack/plugins/security_solution/scripts/endpoint/common/fleet_services.ts # x-pack/plugins/security_solution/scripts/endpoint/common/stack_services.ts

This reverts commit be6c000.

paul-tavares

Thanks for working on this. 👍

Ikuni17

LGTM.

# Conflicts: # x-pack/plugins/fleet/server/config.ts

MadameSheema

Please socialize before merging that docker is going to be needed as well for executing Cypress ESS in the local machine. Thanks.

MadameSheema

Please socialize before merging that docker is going to be needed as well for executing Cypress ESS in the local machine. Thanks.

oatkiller · 2023-09-26T13:40:39Z

What this PR Does

Runs fleet server in standalone mode. Previously we ran a single agent in fleet mode. This doesn't accurately mimic the experience users will have in serverless. Non serverless tests will run still run in the old way: against a single agent in fleet mode.

Note: this isn't intended to cause any changes to how SAET tests run today.

Breaking changes

You'll need docker installed locally to run tests with these changes. @patrykkopycinski may be able to change this limitations.

Changes to kbn-dev-utils & kbn-crypto

The old certificates only supported localhost dns. In order to support networking with an ES running in docker, we needed to update the dns names accepted by the certs. See this PR for background info: Add support for Docker and Serverless to kbn/es #161927
Updated README to use openssl v3 commands

Changes to kbn-es

Added new service account that can be used to enroll fleet.

Changes to x-pack/plugins/fleet

Expose and add types for ca_trusted_fingerprint. This allows us to authenticate with fleet using the certs mentioned above.

Follow up ideas:

We could run ES in docker for ESS tests as well. This might have better test performance.
SAET Cypress serverless tests will not run using the serverless ES via Docker with the changes in this PR. Follow up PRs could implement this.

jeramysoucy

LGTM. I just had a question regarding one of the new openssl rsa command options.

jeramysoucy · 2023-09-27T15:58:27Z

packages/kbn-dev-utils/certs/README.md


 # Extract the PEM-formatted PKCS #1 private key for Elasticsearch
-openssl pkcs12 -in elasticsearch.p12 -nocerts -passin pass:"storepass" -passout pass:"keypass" | openssl rsa -passin pass:keypass -out elasticsearch.key
+openssl pkcs12 -in elasticsearch.p12 -nocerts -passin pass:"storepass" -passout pass:"keypass" | openssl rsa -passin pass:keypass -out elasticsearch.key -traditional


I could not find documentation on the -traditional option. What does it do?

Update: found it..."When writing a private key, use the traditional PKCS#1 format instead of the PKCS#8 format". All set.

banderror · 2023-09-28T12:44:17Z

@oatkiller Thanks a lot for writing up this summary: #165415 (comment). Could you please elaborate on this:

SAET Cypress serverless tests will not run using the serverless ES via Docker with the changes in this PR. Follow up PRs could implement this.

What SAET Cypress serverless tests will be affected by this PR, and what does it mean "will not run"?

…s-fleet-cypress

kevinlog · 2023-09-28T15:14:43Z

@banderror

SAET Cypress serverless tests will not run using the serverless ES via Docker with the changes in this PR. Follow up PRs could implement this.

What SAET Cypress serverless tests will be affected by this PR, and what does it mean "will not run"?

I believe this is just stating that SAET tests are currently not going to run against the serverless ES in docker. Not that SAET tests are being broken by this PR. The follow up PRs could adjust the SAET tests to also run in this manner.

cc @oatkiller

…-fix'

…-ref HEAD~1..HEAD --fix'

kibana-ci · 2023-09-29T09:58:06Z

💔 Build Failed

Failed CI Steps

Test Failures

[job] [logs] Investigations - Security Solution Cypress Tests #5 / Discover State "before each" hook for "should remember filters when navigating away and back to discover " "before each" hook for "should remember filters when navigating away and back to discover "

Metrics [docs]

Public APIs missing comments

Total count of every public API that lacks a comment. Target amount is 0. Run node scripts/build_api_docs --plugin [yourplugin] --stats comments for more detailed information.

id	before	after	diff
`@kbn/dev-utils`	25	32	+7
`@kbn/es`	30	33	+3
total			+10

Unknown metric groups

API count

id	before	after	diff
`@kbn/dev-utils`	29	36	+7
`@kbn/es`	43	48	+5
total			+12

History

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

cc @patrykkopycinski

…Elastic endpoint agent in VM (#167720) ## Summary Run Defend Workflows Cypress E2E against Serverless stack, similar to #165415 --------- Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com> Co-authored-by: Gloria Hornero <gloria.hornero@elastic.co>

WIP

8a2243e

patrykkopycinski force-pushed the chore/serverless-fleet-cypress branch from df547a1 to 8a2243e Compare August 31, 2023 22:22

kibanamachine and others added 28 commits August 31, 2023 22:55

[CI] Auto-commit changed files from 'node scripts/eslint --no-cache -…

801c71a

…-fix'

tests

d089fc8

Merge branch 'main' into cypress-fleet

c6024d4

Merge branch 'main' into cypress-fleet

124c8a1

Merge branch 'main' into cypress-fleet

07752b8

# Conflicts: # x-pack/plugins/security_solution/scripts/endpoint/common/stack_services.ts

fix misisng semicolon

7dad906

Merge branch 'main' into cypress-fleet

1e2485f

Merge branch 'main' into cypress-fleet

778ac2b

test

b5fc090

test

ee6fda6

working agents

f6761cb

Merge branch 'main' into cypress-fleet

798e034

# Conflicts: # x-pack/plugins/security_solution/scripts/endpoint/common/fleet_services.ts # x-pack/plugins/security_solution/scripts/endpoint/common/stack_services.ts

fix

3740985

clean up

26ae0cb

rename cert files

36d27d4

clean up

e1b339b

add fleet-server.yml

5a8630b

add fleet-server.yml

c39a2f3

clean up

eb5dada

Merge branch 'main' into cypress-fleet

3864e2b

clean up

7e6896a

clean up

fd24d0e

clean up

cd4d0b5

localhost

e86f2e0

revert es and kibana certs

be6c000

fix test

ecdf28c

fix test

54012ac

Revert "revert es and kibana certs"

67b98bb

This reverts commit be6c000.

patrykkopycinski and others added 2 commits September 25, 2023 13:00

Merge branch 'main' into chore/serverless-fleet-cypress

2fb4fa7

Merge branch 'main' into chore/serverless-fleet-cypress

31cd478

paul-tavares approved these changes Sep 25, 2023

View reviewed changes

Merge branch 'main' into chore/serverless-fleet-cypress

30e4738

Ikuni17 approved these changes Sep 25, 2023

View reviewed changes

jloleysens approved these changes Sep 26, 2023

View reviewed changes

Merge branch 'main' into chore/serverless-fleet-cypress

714eb54

# Conflicts: # x-pack/plugins/fleet/server/config.ts

MadameSheema approved these changes Sep 26, 2023

View reviewed changes

patrykkopycinski added 3 commits September 26, 2023 17:46

PR comments

c9875be

Merge branch 'main' into chore/serverless-fleet-cypress

2e50f81

fix

28b2423

jeramysoucy approved these changes Sep 27, 2023

View reviewed changes

Merge branch 'main' of github.com:elastic/kibana into chore/serverles…

0306995

…s-fleet-cypress

kibanamachine and others added 2 commits September 28, 2023 15:28

[CI] Auto-commit changed files from 'node scripts/eslint --no-cache -…

9c5d005

…-fix'

Merge branch 'main' into chore/serverless-fleet-cypress

78a12d3

patrykkopycinski enabled auto-merge (squash) September 28, 2023 22:25

patrykkopycinski and others added 2 commits September 29, 2023 11:05

fix

7a27dbb

[CI] Auto-commit changed files from 'node scripts/precommit_hook.js -…

f89be74

…-ref HEAD~1..HEAD --fix'

banderror approved these changes Sep 29, 2023

View reviewed changes

patrykkopycinski merged commit 5dedc99 into elastic:main Sep 29, 2023

kibanamachine added v8.11.0 backport:skip This PR does not require backporting labels Sep 29, 2023

patrykkopycinski deleted the chore/serverless-fleet-cypress branch September 30, 2023 13:23

patrykkopycinski mentioned this pull request Oct 2, 2023

Setup E2E against Serverless ES, Kibana, Fleet server standalone and Elastic endpoint agent in VM #167720

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[osquery] Setup E2E against Serverless ES, Kibana, Fleet server standalone and Elastic agents in Docker#165415

[osquery] Setup E2E against Serverless ES, Kibana, Fleet server standalone and Elastic agents in Docker#165415
patrykkopycinski merged 107 commits intoelastic:mainfrom
patrykkopycinski:chore/serverless-fleet-cypress

patrykkopycinski commented Aug 31, 2023 •

edited

Loading

Uh oh!

paul-tavares left a comment

Uh oh!

Ikuni17 left a comment

Uh oh!

MadameSheema left a comment

Uh oh!

MadameSheema left a comment

Uh oh!

oatkiller commented Sep 26, 2023 •

edited

Loading

Uh oh!

jeramysoucy left a comment •

edited

Loading

Uh oh!

jeramysoucy Sep 27, 2023

Uh oh!

jeramysoucy Sep 27, 2023

Uh oh!

banderror commented Sep 28, 2023

Uh oh!

kevinlog commented Sep 28, 2023

Uh oh!

kibana-ci commented Sep 29, 2023 •

edited

Loading

API count

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

14 participants

Conversation

patrykkopycinski commented Aug 31, 2023 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Uh oh!

paul-tavares left a comment

Choose a reason for hiding this comment

Uh oh!

Ikuni17 left a comment

Choose a reason for hiding this comment

Uh oh!

MadameSheema left a comment

Choose a reason for hiding this comment

Uh oh!

MadameSheema left a comment

Choose a reason for hiding this comment

Uh oh!

oatkiller commented Sep 26, 2023 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What this PR Does

Breaking changes

Changes to kbn-dev-utils & kbn-crypto

Changes to kbn-es

Changes to x-pack/plugins/fleet

Follow up ideas:

Uh oh!

jeramysoucy left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

jeramysoucy Sep 27, 2023

Choose a reason for hiding this comment

Uh oh!

jeramysoucy Sep 27, 2023

Choose a reason for hiding this comment

Uh oh!

banderror commented Sep 28, 2023

Uh oh!

kevinlog commented Sep 28, 2023

Uh oh!

kibana-ci commented Sep 29, 2023 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

💔 Build Failed

Failed CI Steps

Test Failures

Metrics [docs]

Public APIs missing comments

API count

History

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

14 participants

patrykkopycinski commented Aug 31, 2023 •

edited

Loading

oatkiller commented Sep 26, 2023 •

edited

Loading

jeramysoucy left a comment •

edited

Loading

kibana-ci commented Sep 29, 2023 •

edited

Loading