[Synthetics] Schema configuration and Server side changes for CCS settings by mgiota · Pull Request #262497 · elastic/kibana

mgiota · 2026-04-10T11:10:52Z

Closes #259264
Closes #259265
Closes #259266
Closes #259267
Closes #259269

Summary

Add runtime type definitions for cross-cluster search (CCS) settings and remote monitor info, in preparation for federated views support - [Synthetics] [CCS] Define remote cluster settings types and extend API response types #259264
Add CCS settings API, saved object, and route wrapper wiring. Implement the persistence and server-side integration layer for cross-cluster search support: settings saved object with per-space isolation, repository, GET/PUT API routes, index resolution service, and route wrapper wiring gated behind experimental.ccs.enabled flag - [Synthetics] [CCS] Implement settings API and saved object for remote cluster preferences #259265
SyntheticsEsClient constructor accepts CCS index patterns, search/msearch/count use resolved indices, and route wrapper passes CCS-aware indices. [Synthetics] [CCS] Extend SyntheticsEsClient to support cross-cluster search index expressions #259266
Update server-side query modules [Synthetics] [CCS] Update server-side query modules to support CCS-aware index patterns #259267
Add Remote Settings UI - 259269

Add runtime type definitions for cross-cluster search (CCS) settings and remote monitor info, in preparation for federated views support. Closes elastic#259264

macroscopeapp · 2026-04-10T11:13:45Z

Approvability

Verdict: Needs human review

This PR introduces a new Cross-Cluster Search (CCS) feature for Synthetics, including new UI settings, schema changes, and modifications to how ES queries are constructed to potentially include remote cluster indices. The significant scope of new functionality and unresolved architectural questions from reviewers warrant human review.

^{You can customize Macroscope's approvability policy. Learn more.}

Implement the persistence and server-side integration layer for cross-cluster search support: settings saved object with per-space isolation, repository, GET/PUT API routes, index resolution service, and route wrapper wiring gated behind experimental.ccs.enabled flag. Closes elastic#259265

Wire remoteKibanaUrls through RouteContext so route handlers can resolve deep links to remote Kibana instances. Add remote_result_utils with helpers to detect CCS index names and build RemoteMonitorInfo, and extend PingType and OverviewStatusMetaData with an optional remote field.

Thread remoteKibanaUrls into queryPings and attach remote monitor info to each ping based on its _index field. Verified get_journey_steps and get_certs work with CCS indices as-is. Overview status remote monitor visibility deferred to the UI phase.

…rd list

…tic#259269) Add a "Remote Clusters" tab to the Settings page (stateful only) with controls for selecting remote clusters and configuring Kibana URLs for deep linking. Includes toggle for all clusters, combo box for specific selection, and a full-width URL mapping table per cluster.

The remote monitor detection logic in processOverviewStatus (building localMonitorIds Set, scanning statusData for unmatched IDs, and calling getRemoteMonitorDetails) was running unconditionally on every overview status request, even when CCS was disabled. This added unnecessary processing on a hot path and contributed to OOM failures in CI tests that create large datasets (15k buckets). Wrap the entire block in the same isCCSEnabled check already used by getEsDataFilters, so the work is only done when CCS is actually active. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

… object

…ination test Extract SUMMARIES_PAGE_SIZE to a separate constants module so the test can mock it to a small value (10 instead of 5000) and eliminate the OOM crash in CI Jest shard 1/3 Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

…e UI issue

…gate

shahzad31 · 2026-04-15T12:11:54Z

@mgiota for kibana url we should index it via fields api to synthetics data automatically when monitor is being created for private locations and for public location when sync is happening

i think this UI would be a burden for users

mgiota · 2026-04-15T13:12:11Z

@shahzad31 I removed remoteKibanaUrls changes from current PR in this commit. I will handle kibanaRemoteUrls separately in this issue

elasticmachine · 2026-04-15T21:37:26Z

💚 Build Succeeded

Buildkite Build
Commit: 0e20e3c

Metrics [docs]

Module Count

Fewer modules leads to a faster build time

id	before	after	diff
`synthetics`	1278	1283	+5

Async chunks

Total size of all lazy-loaded chunks that will be downloaded as the user navigates the app

id	before	after	diff
`synthetics`	1.1MB	1.1MB	+5.9KB

Page load bundle

Size of the bundles that are downloaded on every page load. Target size is below 100kb

id	before	after	diff
`synthetics`	28.9KB	29.2KB	+269.0B

Unknown metric groups

ESLint disabled line counts

id	before	after	diff
`synthetics`	59	60	+1

Total ESLint disabled count

id	before	after	diff
`synthetics`	64	65	+1

History

💔 Build #428440 failed 461fd1c
💔 Build #428107 failed 2869239
💔 Build #427992 failed 4afce36
💔 Build #427721 failed 190913f
💔 Build #427668 failed 2e9bff7
💔 Build #427645 failed f2cfd29

cc @mgiota

mgiota · 2026-04-15T22:40:21Z

@shahzad31 CI is finally green. I started an initial attempt to index kibanaUrl in this draft WIP PR. Let me know if we can merge current PR.

shahzad31 · 2026-04-16T05:21:08Z

+  method: 'PUT',
+  path: SYNTHETICS_API_URLS.CCS_SETTINGS,
+  validate: {
+    body: CCSSettingsSchema,
+  },
+  writeAccess: true,


i am double minded on this one as well, if we need a separate route here, i guess since we are using existing settings object, probably makes sense to use that

Yep makes sense, I removed separate route in this commit. I see you already approved, I have one more question. The current dynamic_settings.ts route has no serverless guard. It will happily persist useAllRemoteClusters/selectedRemoteClusters to the saved object even in serverless mode.

In practice this is low risk, since the UI hides the entire Remote Clusters tab when isServerless || !isCCSEnabled. However if we want to hard block the PUT in serverless, we'd need to add a serverless guard inside dynamic_settings.ts for the CCS-specific fields. Is the UI + query-path gating sufficient or we should add that guard (could be follow up)

I merge now that CI is green and we address things as follow ups

shahzad31 · 2026-04-16T05:25:05Z

+      let heartbeatIndices = SYNTHETICS_INDEX_PATTERN;
+      if (isCCSEnabled(server)) {
+        try {
+          const dynamicSettings = await getSyntheticsDynamicSettings(savedObjectsClient);
+          const ccsSettings = {
+            useAllRemoteClusters: dynamicSettings.useAllRemoteClusters ?? false,
+            selectedRemoteClusters: dynamicSettings.selectedRemoteClusters ?? [],
+          };
+          const { indices } = await getSyntheticsIndices(esClient.asCurrentUser, ccsSettings);
+          heartbeatIndices = indices;
+        } catch (e) {
+          server.logger.warn(`Failed to resolve CCS indices, falling back to local: ${e.message}`);
+        }
+      }


i wonder if it's worth caching this, since this is being used against all routes, so it will also impacts the routes which are for example simple routes like creating a monitor or editing a monitor, perhaps create a follow up issue to apply this only where this is required?

other way might be to make it a service like a funciton which gets called getHeartbeatIndices() and pass that, that way it will be only called when its being used in the route.

worth caching this

Yep I had that in my todo list for a follow up.

shahzad31

Only two remaining comments and we should be good to go

shahzad31

LGTM !!

Define CCS settings and remote monitor io-ts types

1e35b0d

Add runtime type definitions for cross-cluster search (CCS) settings and remote monitor info, in preparation for federated views support. Closes elastic#259264

mgiota requested a review from a team as a code owner April 10, 2026 11:10

mgiota self-assigned this Apr 10, 2026

github-actions bot added the author:actionable-obs PRs authored by the actionable obs team label Apr 10, 2026

mgiota added release_note:skip Skip the PR/issue when compiling release notes backport:skip This PR does not require backporting labels Apr 10, 2026

mgiota changed the title ~~Define CCS settings and remote monitor io-ts types~~ [Synthetics] Define CCS settings and remote monitor io-ts types Apr 10, 2026

mgiota marked this pull request as draft April 10, 2026 11:12

mgiota added 2 commits April 10, 2026 16:13

remove storedSyntheticsCCSSettingsSchema, not needed, it is a new SO

a7c72dd

mgiota marked this pull request as ready for review April 10, 2026 14:19

mgiota requested a review from a team as a code owner April 10, 2026 14:19

mgiota requested a review from elena-shostak April 10, 2026 14:19

Changes from node scripts/check_mappings_update --fix

1e1aeb8

elastic-vault-github-plugin-prod bot requested a review from a team as a code owner April 10, 2026 14:40

kibanamachine and others added 2 commits April 10, 2026 15:10

Changes from node scripts/eslint_all_files --no-cache --fix

82672ca

add unit tests for get_synthetics_indices and settings repository

efb4d05

github-advanced-security AI found potential problems Apr 10, 2026

View reviewed changes

Comment thread x-pack/solutions/observability/plugins/synthetics/server/routes/settings/ccs_settings.ts Fixed

mgiota and others added 6 commits April 11, 2026 00:29

fix failing check_registered_types tests

825bce9

CI fixes

53f7ba1

add maxSize to the remoteKibanaUrls schema

55db7fe

Merge branch 'main' into ccs/types-and-settings-api

247e55a

add unit tests for remote_result_utils

1ba8f33

mgiota changed the title ~~[Synthetics] Define CCS settings and remote monitor io-ts types~~ [Synthetics] Schema configuration and Server side changes for CCS settings Apr 10, 2026

mgiota and others added 4 commits April 11, 2026 02:35

Changes from node scripts/eslint_all_files --no-cache --fix

18f4d03

Register synthetics-ccs-settings in the previouslyRegisteredTypes gua…

113ada6

…rd list

mgiota and others added 6 commits April 15, 2026 00:39

remove leftover artifacts after using existing dynamic settings saved…

9ca5221

… object

add isCCSEnabled utility helper

a58a069

ccs test coverage

2648664

revert changes to overview_status_service, this will be handled in th…

190913f

…e UI issue

mgiota force-pushed the ccs/types-and-settings-api branch from 0407ae2 to 190913f Compare April 15, 2026 06:14

fix(synthetics): fix CCS settings form test mocking for isCCSEnabled …

4afce36

…gate

Merge branch 'main' into ccs/types-and-settings-api

ee18bcd

legrego removed request for a team and elena-shostak April 15, 2026 13:07

revert remoteKibanaUrls changes

2869239

mgiota requested a review from shahzad31 April 15, 2026 13:12

gsoldevila approved these changes Apr 15, 2026

View reviewed changes

mgiota and others added 5 commits April 15, 2026 21:37

fix failing unit tests

dc70043

Changes from node scripts/eslint_all_files --no-cache --fix

461fd1c

types cleanup

dc28bb5

more test coverage

ebb6f5b

Merge branch 'main' into ccs/types-and-settings-api

0e20e3c

shahzad31 reviewed Apr 16, 2026

View reviewed changes

remove ccs_settings route & use existing dynamic_settings route

6149283

shahzad31 approved these changes Apr 16, 2026

View reviewed changes

mgiota merged commit c980e80 into elastic:main Apr 16, 2026
22 checks passed

kibanamachine added the v9.5.0 label Apr 16, 2026

Conversation

mgiota commented Apr 10, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Uh oh!

macroscopeapp bot commented Apr 10, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Approvability

Uh oh!

Uh oh!

shahzad31 commented Apr 15, 2026

Uh oh!

mgiota commented Apr 15, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

elasticmachine commented Apr 15, 2026

💚 Build Succeeded

Metrics [docs]

Module Count

Async chunks

Page load bundle

ESLint disabled line counts

Total ESLint disabled count

History

Uh oh!

mgiota commented Apr 15, 2026

Uh oh!

shahzad31 Apr 16, 2026

Choose a reason for hiding this comment

Uh oh!

mgiota Apr 16, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

mgiota Apr 16, 2026

Choose a reason for hiding this comment

Uh oh!

shahzad31 Apr 16, 2026

Choose a reason for hiding this comment

Uh oh!

mgiota Apr 16, 2026

Choose a reason for hiding this comment

Uh oh!

shahzad31 left a comment

Choose a reason for hiding this comment

Uh oh!

shahzad31 left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

mgiota commented Apr 10, 2026 •

edited

Loading

macroscopeapp bot commented Apr 10, 2026 •

edited

Loading

mgiota commented Apr 15, 2026 •

edited

Loading

mgiota Apr 16, 2026 •

edited

Loading