Skip to content

Use dockerized package registry for serverless#250680

Merged
mohamedhamed-ahmed merged 15 commits intoelastic:mainfrom
mohamedhamed-ahmed:use-dockerized-package-registry-in-serverless-tests
Jan 30, 2026
Merged

Use dockerized package registry for serverless#250680
mohamedhamed-ahmed merged 15 commits intoelastic:mainfrom
mohamedhamed-ahmed:use-dockerized-package-registry-in-serverless-tests

Conversation

@mohamedhamed-ahmed
Copy link
Copy Markdown
Contributor

@mohamedhamed-ahmed mohamedhamed-ahmed commented Jan 28, 2026

closes #235057

After [Dataset quality] configuring dockerized package registry in tests has been merged successfully, this PR makes use of the dockerized package registry in serverless configs.

@mohamedhamed-ahmed mohamedhamed-ahmed added release_note:skip Skip the PR/issue when compiling release notes backport:skip This PR does not require backporting ci:all-cypress-suites labels Jan 28, 2026
@mohamedhamed-ahmed mohamedhamed-ahmed added backport:version Backport to applied version labels v9.1.0 v8.19.0 v9.2.0 v9.3.0 and removed backport:skip This PR does not require backporting labels Jan 28, 2026
@mohamedhamed-ahmed mohamedhamed-ahmed marked this pull request as ready for review January 29, 2026 06:19
@mohamedhamed-ahmed mohamedhamed-ahmed requested review from a team as code owners January 29, 2026 06:19
Copy link
Copy Markdown
Contributor

@rStelmach rStelmach left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

Copy link
Copy Markdown
Contributor

@dmlemeshko dmlemeshko left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

changes in x-pack/platform/test lgtm. Thanks a lot for taking time and fixing it 🙇

...services,
...options.services,
},
...(!enableFleetDockerRegistry && { dockerServers: undefined }),
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

does this only limit the fleet docker? Could the dockerServers contain other services than fleet? With this setting it would nullify anything passed on, no?

Copy link
Copy Markdown
Contributor Author

@mohamedhamed-ahmed mohamedhamed-ahmed Jan 29, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this is a good point here, needs to be updated. @dmlemeshko wdyt?

I know at the moment we only have the registry docker server, but it could probably hold more servers in the future right?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Something like

dockerServers: enableFleetDockerRegistry
  ? svlSharedConfig.get('dockerServers')
  : {
      ...svlSharedConfig.get('dockerServers'),
      registry: {
        ...svlSharedConfig.get('dockerServers.registry'),
        enabled: false,
      },
    },

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@delanni should be fixed here

Copy link
Copy Markdown
Contributor

@seanrathier seanrathier left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think the CSPM related change need to have the Fleet Registry to make requests to the load and check on integration ingestion statuses. You can conform by setting enableFleetDockerRegistry to true.

],
// load tests in the index file
testFiles: [require.resolve('../test_suites/ftr/cloud_security_posture/agentless')],
enableFleetDockerRegistry: false,
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These test suite needs Fleet Registry to load an integration. Could this be why I am seeing E2E test failures for cloud_security_posture/agentless?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@seanrathier they do need it but not the dockerized version of the registry, that is why I set this to false here. The failure is due to something else I am working on it now and will keep you posted.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@seanrathier issue fixed in this commit 👍

@elasticmachine
Copy link
Copy Markdown
Contributor

💛 Build succeeded, but was flaky

Failed CI Steps

Test Failures

  • [job] [logs] FTR Configs #5 / "before all" hook in "{root}"

Metrics [docs]

✅ unchanged

History

Copy link
Copy Markdown
Member

@delanni delanni left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

.buildkite/ftr_oblt_serverless_configs.yml 👍

@kibanamachine
Copy link
Copy Markdown
Contributor

Starting backport for target branches: 8.19, 9.1, 9.2, 9.3

https://github.com/elastic/kibana/actions/runs/21512156474

1 similar comment
@kibanamachine
Copy link
Copy Markdown
Contributor

Starting backport for target branches: 8.19, 9.1, 9.2, 9.3

https://github.com/elastic/kibana/actions/runs/21512156474

@kibanamachine
Copy link
Copy Markdown
Contributor

💔 All backports failed

Status Branch Result
8.19 Backport failed because of merge conflicts
9.1 Backport failed because of merge conflicts
9.2 Backport failed because of merge conflicts
9.3 Backport failed because of merge conflicts

Manual backport

To create the backport manually run:

node scripts/backport --pr 250680

Questions ?

Please refer to the Backport tool documentation

mohamedhamed-ahmed added a commit to mohamedhamed-ahmed/kibana that referenced this pull request Jan 30, 2026
After [[Dataset quality] configuring dockerized package registry in
tests](elastic#250040) has been merged
successfully, this PR makes use of the dockerized package registry in
serverless configs.

---------

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
(cherry picked from commit aaaef09)

# Conflicts:
#	x-pack/platform/test/serverless/functional/config.base.ts
mohamedhamed-ahmed added a commit to mohamedhamed-ahmed/kibana that referenced this pull request Jan 30, 2026
After [[Dataset quality] configuring dockerized package registry in
tests](elastic#250040) has been merged
successfully, this PR makes use of the dockerized package registry in
serverless configs.

---------

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
(cherry picked from commit aaaef09)

# Conflicts:
#	x-pack/platform/test/serverless/api_integration/config.base.ts
#	x-pack/platform/test/serverless/functional/config.base.ts
#	x-pack/platform/test/serverless/shared/types/index.ts
#	x-pack/solutions/observability/test/serverless/functional/configs/index.ts
#	x-pack/solutions/security/test/serverless/functional/configs/config.cloud_security_posture.complete.ts
mohamedhamed-ahmed added a commit to mohamedhamed-ahmed/kibana that referenced this pull request Jan 30, 2026
After [[Dataset quality] configuring dockerized package registry in
tests](elastic#250040) has been merged
successfully, this PR makes use of the dockerized package registry in
serverless configs.

---------

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
(cherry picked from commit aaaef09)

# Conflicts:
#	x-pack/platform/test/serverless/api_integration/config.base.ts
#	x-pack/platform/test/serverless/functional/config.base.ts
#	x-pack/platform/test/serverless/shared/types/index.ts
#	x-pack/solutions/observability/test/serverless/functional/configs/index.ts
#	x-pack/solutions/security/test/serverless/functional/configs/config.cloud_security_posture.complete.ts
mohamedhamed-ahmed added a commit to mohamedhamed-ahmed/kibana that referenced this pull request Jan 30, 2026
After [[Dataset quality] configuring dockerized package registry in
tests](elastic#250040) has been merged
successfully, this PR makes use of the dockerized package registry in
serverless configs.

---------

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
(cherry picked from commit aaaef09)

# Conflicts:
#	.buildkite/ftr_oblt_serverless_configs.yml
#	x-pack/platform/test/serverless/api_integration/config.base.ts
#	x-pack/platform/test/serverless/functional/config.base.ts
#	x-pack/platform/test/serverless/shared/types/index.ts
#	x-pack/solutions/observability/test/serverless/functional/configs/index.ts
#	x-pack/solutions/security/test/serverless/functional/configs/config.cloud_security_posture.cloud.ts
#	x-pack/solutions/security/test/serverless/functional/configs/config.cloud_security_posture.complete.ts
@mohamedhamed-ahmed
Copy link
Copy Markdown
Contributor Author

💚 All backports created successfully

Status Branch Result
9.3
9.2
9.1
8.19

Note: Successful backport PRs will be merged automatically after passing CI.

Questions ?

Please refer to the Backport tool documentation

mohamedhamed-ahmed added a commit that referenced this pull request Jan 30, 2026
# Backport

This will backport the following commits from `main` to `9.3`:
- [Use dockerized package registry for serverless
(#250680)](#250680)

<!--- Backport version: 10.2.0 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)

<!--BACKPORT
[{"author":{"name":"mohamedhamed-ahmed","email":"mohamed.ahmed@elastic.co"},"sourceCommit":{"committedDate":"2026-01-30T10:10:09Z","message":"Use
dockerized package registry for serverless (#250680)\n\nAfter [[Dataset
quality] configuring dockerized package registry
in\ntests](#250040) has been
merged\nsuccessfully, this PR makes use of the dockerized package
registry in\nserverless configs.\n\n---------\n\nCo-authored-by:
kibanamachine
<42973632+kibanamachine@users.noreply.github.com>","sha":"aaaef09bd49d0054017beed37850b668bb78e9c7","branchLabelMapping":{"^v9.4.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","ci:all-cypress-suites","backport:version","v9.1.0","v8.19.0","v9.2.0","v9.3.0","v9.4.0"],"title":"Use
dockerized package registry for
serverless","number":250680,"url":"https://github.com/elastic/kibana/pull/250680","mergeCommit":{"message":"Use
dockerized package registry for serverless (#250680)\n\nAfter [[Dataset
quality] configuring dockerized package registry
in\ntests](#250040) has been
merged\nsuccessfully, this PR makes use of the dockerized package
registry in\nserverless configs.\n\n---------\n\nCo-authored-by:
kibanamachine
<42973632+kibanamachine@users.noreply.github.com>","sha":"aaaef09bd49d0054017beed37850b668bb78e9c7"}},"sourceBranch":"main","suggestedTargetBranches":["9.1","8.19","9.2","9.3"],"targetPullRequestStates":[{"branch":"9.1","label":"v9.1.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.19","label":"v8.19.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"9.2","label":"v9.2.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"9.3","label":"v9.3.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"main","label":"v9.4.0","branchLabelMappingKey":"^v9.4.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/250680","number":250680,"mergeCommit":{"message":"Use
dockerized package registry for serverless (#250680)\n\nAfter [[Dataset
quality] configuring dockerized package registry
in\ntests](#250040) has been
merged\nsuccessfully, this PR makes use of the dockerized package
registry in\nserverless configs.\n\n---------\n\nCo-authored-by:
kibanamachine
<42973632+kibanamachine@users.noreply.github.com>","sha":"aaaef09bd49d0054017beed37850b668bb78e9c7"}}]}]
BACKPORT-->
mohamedhamed-ahmed added a commit that referenced this pull request Jan 30, 2026
)

# Backport

This will backport the following commits from `main` to `8.19`:
- [Use dockerized package registry for serverless
(#250680)](#250680)

<!--- Backport version: 10.2.0 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)

<!--BACKPORT
[{"author":{"name":"mohamedhamed-ahmed","email":"mohamed.ahmed@elastic.co"},"sourceCommit":{"committedDate":"2026-01-30T10:10:09Z","message":"Use
dockerized package registry for serverless (#250680)\n\nAfter [[Dataset
quality] configuring dockerized package registry
in\ntests](#250040) has been
merged\nsuccessfully, this PR makes use of the dockerized package
registry in\nserverless configs.\n\n---------\n\nCo-authored-by:
kibanamachine
<42973632+kibanamachine@users.noreply.github.com>","sha":"aaaef09bd49d0054017beed37850b668bb78e9c7","branchLabelMapping":{"^v9.4.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","ci:all-cypress-suites","backport:version","v9.1.0","v8.19.0","v9.2.0","v9.3.0","v9.4.0"],"title":"Use
dockerized package registry for
serverless","number":250680,"url":"https://github.com/elastic/kibana/pull/250680","mergeCommit":{"message":"Use
dockerized package registry for serverless (#250680)\n\nAfter [[Dataset
quality] configuring dockerized package registry
in\ntests](#250040) has been
merged\nsuccessfully, this PR makes use of the dockerized package
registry in\nserverless configs.\n\n---------\n\nCo-authored-by:
kibanamachine
<42973632+kibanamachine@users.noreply.github.com>","sha":"aaaef09bd49d0054017beed37850b668bb78e9c7"}},"sourceBranch":"main","suggestedTargetBranches":["9.1","8.19","9.2","9.3"],"targetPullRequestStates":[{"branch":"9.1","label":"v9.1.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.19","label":"v8.19.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"9.2","label":"v9.2.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"9.3","label":"v9.3.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"main","label":"v9.4.0","branchLabelMappingKey":"^v9.4.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/250680","number":250680,"mergeCommit":{"message":"Use
dockerized package registry for serverless (#250680)\n\nAfter [[Dataset
quality] configuring dockerized package registry
in\ntests](#250040) has been
merged\nsuccessfully, this PR makes use of the dockerized package
registry in\nserverless configs.\n\n---------\n\nCo-authored-by:
kibanamachine
<42973632+kibanamachine@users.noreply.github.com>","sha":"aaaef09bd49d0054017beed37850b668bb78e9c7"}}]}]
BACKPORT-->
hannahbrooks pushed a commit to hannahbrooks/kibana that referenced this pull request Jan 30, 2026
After [[Dataset quality] configuring dockerized package registry in
tests](elastic#250040) has been merged
successfully, this PR makes use of the dockerized package registry in
serverless configs.

---------

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
mohamedhamed-ahmed added a commit that referenced this pull request Jan 30, 2026
# Backport

This will backport the following commits from `main` to `9.2`:
- [Use dockerized package registry for serverless
(#250680)](#250680)

<!--- Backport version: 10.2.0 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)

<!--BACKPORT
[{"author":{"name":"mohamedhamed-ahmed","email":"mohamed.ahmed@elastic.co"},"sourceCommit":{"committedDate":"2026-01-30T10:10:09Z","message":"Use
dockerized package registry for serverless (#250680)\n\nAfter [[Dataset
quality] configuring dockerized package registry
in\ntests](#250040) has been
merged\nsuccessfully, this PR makes use of the dockerized package
registry in\nserverless configs.\n\n---------\n\nCo-authored-by:
kibanamachine
<42973632+kibanamachine@users.noreply.github.com>","sha":"aaaef09bd49d0054017beed37850b668bb78e9c7","branchLabelMapping":{"^v9.4.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","ci:all-cypress-suites","backport:version","v9.1.0","v8.19.0","v9.2.0","v9.3.0","v9.4.0"],"title":"Use
dockerized package registry for
serverless","number":250680,"url":"https://github.com/elastic/kibana/pull/250680","mergeCommit":{"message":"Use
dockerized package registry for serverless (#250680)\n\nAfter [[Dataset
quality] configuring dockerized package registry
in\ntests](#250040) has been
merged\nsuccessfully, this PR makes use of the dockerized package
registry in\nserverless configs.\n\n---------\n\nCo-authored-by:
kibanamachine
<42973632+kibanamachine@users.noreply.github.com>","sha":"aaaef09bd49d0054017beed37850b668bb78e9c7"}},"sourceBranch":"main","suggestedTargetBranches":["9.1","8.19","9.2","9.3"],"targetPullRequestStates":[{"branch":"9.1","label":"v9.1.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.19","label":"v8.19.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"9.2","label":"v9.2.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"9.3","label":"v9.3.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"main","label":"v9.4.0","branchLabelMappingKey":"^v9.4.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/250680","number":250680,"mergeCommit":{"message":"Use
dockerized package registry for serverless (#250680)\n\nAfter [[Dataset
quality] configuring dockerized package registry
in\ntests](#250040) has been
merged\nsuccessfully, this PR makes use of the dockerized package
registry in\nserverless configs.\n\n---------\n\nCo-authored-by:
kibanamachine
<42973632+kibanamachine@users.noreply.github.com>","sha":"aaaef09bd49d0054017beed37850b668bb78e9c7"}}]}]
BACKPORT-->

---------

Co-authored-by: Dzmitry Lemechko <dzmitry.lemechko@elastic.co>
mohamedhamed-ahmed added a commit that referenced this pull request Feb 2, 2026
# Backport

This will backport the following commits from `main` to `9.1`:
- [Use dockerized package registry for serverless
(#250680)](#250680)

<!--- Backport version: 10.2.0 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)

<!--BACKPORT
[{"author":{"name":"mohamedhamed-ahmed","email":"mohamed.ahmed@elastic.co"},"sourceCommit":{"committedDate":"2026-01-30T10:10:09Z","message":"Use
dockerized package registry for serverless (#250680)\n\nAfter [[Dataset
quality] configuring dockerized package registry
in\ntests](#250040) has been
merged\nsuccessfully, this PR makes use of the dockerized package
registry in\nserverless configs.\n\n---------\n\nCo-authored-by:
kibanamachine
<42973632+kibanamachine@users.noreply.github.com>","sha":"aaaef09bd49d0054017beed37850b668bb78e9c7","branchLabelMapping":{"^v9.4.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","ci:all-cypress-suites","backport:version","v9.1.0","v8.19.0","v9.2.0","v9.3.0","v9.4.0"],"title":"Use
dockerized package registry for
serverless","number":250680,"url":"https://github.com/elastic/kibana/pull/250680","mergeCommit":{"message":"Use
dockerized package registry for serverless (#250680)\n\nAfter [[Dataset
quality] configuring dockerized package registry
in\ntests](#250040) has been
merged\nsuccessfully, this PR makes use of the dockerized package
registry in\nserverless configs.\n\n---------\n\nCo-authored-by:
kibanamachine
<42973632+kibanamachine@users.noreply.github.com>","sha":"aaaef09bd49d0054017beed37850b668bb78e9c7"}},"sourceBranch":"main","suggestedTargetBranches":["9.1","8.19","9.2","9.3"],"targetPullRequestStates":[{"branch":"9.1","label":"v9.1.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.19","label":"v8.19.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"9.2","label":"v9.2.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"9.3","label":"v9.3.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"main","label":"v9.4.0","branchLabelMappingKey":"^v9.4.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/250680","number":250680,"mergeCommit":{"message":"Use
dockerized package registry for serverless (#250680)\n\nAfter [[Dataset
quality] configuring dockerized package registry
in\ntests](#250040) has been
merged\nsuccessfully, this PR makes use of the dockerized package
registry in\nserverless configs.\n\n---------\n\nCo-authored-by:
kibanamachine
<42973632+kibanamachine@users.noreply.github.com>","sha":"aaaef09bd49d0054017beed37850b668bb78e9c7"}}]}]
BACKPORT-->
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

7 participants