Service template support for remoteClusterServer interface by eedugon · Pull Request #8892 · elastic/cloud-on-k8s

eedugon · 2025-11-05T11:16:16Z

Add service customization support for remoteClusterServer

This PR adds the ability to customize the Kubernetes Service manifest for Elasticsearch's remote cluster server, similar to how spec.http.service and spec.transport.service work.

For your consideration, if you believe there's no need to support this please ignore. The main use case where this is needed is remote clusters functionality from external clusters trying to reach the ECK-managed cluster.

For example in ECH and ECE, port 9443 is accessible in the platform proxies, and it would be great to offer a way to open it up for ECK managed clusters, same as HTTP.

What changed

Added service field to RemoteClusterServer struct using ServiceTemplate
Updated NewRemoteClusterService to use the user-provided service template
Maintains backward compatibility: if service is not specified, the service is created with the same defaults as before (ClusterIP with ClusterIP=None)

Example Usage

spec:
  remoteClusterServer:
    enabled: true
    service:
      spec:
        type: LoadBalancer

Added unit tests to verify default behavior and user-provided template customization
All existing tests continue to pass

prodsecmachine · 2025-11-05T11:16:29Z

✅ Snyk checks have passed. No issues have been found so far.

Status	Scanner	Critical	High	Medium	Low	Total (0)
✅	Licenses	0	0	0	0	0 issues
✅	Open Source Security	0	0	0	0	0 issues

💻 Catch issues earlier using the plugins for VS Code, JetBrains IDEs, Visual Studio, and Eclipse.

…terServer

github-actions · 2025-11-05T11:46:32Z

🔍 Preview links for changed docs

docs/reference/api-reference/main.md

pkg/controller/elasticsearch/services/services.go

barkbay

LGTM

pkg/apis/elasticsearch/v1/elasticsearch_types.go

Co-authored-by: Michael Morello <michael.morello@elastic.co>

This PR contains the following updates: | Package | Update | Change | |---|---|---| | [eck-operator](https://github.com/elastic/cloud-on-k8s) | minor | `3.2.0` → `3.3.0` | --- ### Release Notes <details> <summary>elastic/cloud-on-k8s (eck-operator)</summary> ### [`v3.3.0`](https://github.com/elastic/cloud-on-k8s/releases/tag/v3.3.0) [Compare Source](elastic/cloud-on-k8s@v3.2.0...v3.3.0) ##### Elastic Cloud on Kubernetes 3.3.0 - [Quickstart guide](https://www.elastic.co/docs/deploy-manage/deploy/cloud-on-k8s#eck-quickstart) ##### Release Highlights ##### AutoOps Integration (Enterprise feature) ECK now supports integration with Elastic AutoOps through a new `AutoOpsAgentPolicy` custom resource. This allows you to instrument multiple Elasticsearch clusters at once for automated health monitoring and performance recommendations. The [AutoOps documentation](https://www.elastic.co/docs/deploy-manage/monitor/autoops) provides more details. ##### Elastic Package Registry Integration ECK now supports deploying and managing Elastic Package Registry (EPR) through a new `PackageRegistry` custom resource. This is particularly useful for air-gapped environments, enabling Kibana to reference a self-hosted registry instead of the public one. The [package registry documentation](https://www.elastic.co/docs/deploy-manage/deploy/cloud-on-k8s/package-registry) provides more details. ##### Multiple Stack Configuration Policies composition support (Enterprise feature) ECK now includes support for multiple Stack Config Policies targeting the same Elasticsearch cluster or Kibana instance, using a weight-based priority system for deterministic policy composition. The [stack config policy documentation](https://www.elastic.co/docs/deploy-manage/deploy/cloud-on-k8s/elastic-stack-configuration-policies) provides more details. ##### Features and enhancements - AutoOpsAgentPolicy support [#8941](elastic/cloud-on-k8s#8941) (issue: [#8789](elastic/cloud-on-k8s#8789)) - ElasticPackageRegistry support [#8800](elastic/cloud-on-k8s#8800) (issue: [#8925](elastic/cloud-on-k8s#8925)) - Stack Config Policies composition support [#8917](elastic/cloud-on-k8s#8917) - Use standard Kibana labels and Helm labels on the ECK Operator pod [#8840](elastic/cloud-on-k8s#8840) (issue: [#8584](elastic/cloud-on-k8s#8584)) - Add service customization support for Elasticsearch remote cluster server [#8892](elastic/cloud-on-k8s#8892) - Removal of Elasticsearch 6.x support from codebase [#8979](elastic/cloud-on-k8s#8979) ##### Fixes - Upgrade master StatefulSets last when performing a version upgrade of Elasticsearch [#8871](elastic/cloud-on-k8s#8871) (issue: [#8429](elastic/cloud-on-k8s#8429)) - Fix race condition for pre-existing Stack Config Policy [#8928](elastic/cloud-on-k8s#8928) (issue: [#8912](elastic/cloud-on-k8s#8912)) - Do not set Kibana server.name [#8930](elastic/cloud-on-k8s#8930) (issue: [#8929](elastic/cloud-on-k8s#8929)) - Do not write `elasticsearch.k8s.elastic.co/managed-remote-clusters` when not necessary [#8932](elastic/cloud-on-k8s#8932) (issue: [#8781](elastic/cloud-on-k8s#8781)) - Cleanup orphaned secret mounts when removed from StackConfigPolicy [#8937](elastic/cloud-on-k8s#8937) (issue: [#8921](elastic/cloud-on-k8s#8921)) - Avoid duplicate error logging for generate GET operations on a GVK [#8957](elastic/cloud-on-k8s#8957) - Remove single master at a time upscale restriction [#8940](elastic/cloud-on-k8s#8940) (issue: [#8939](elastic/cloud-on-k8s#8939)) - AutoOps: Ignore deprecated ES clusters [#9008](elastic/cloud-on-k8s#9008) (issue: [#9000](elastic/cloud-on-k8s#9000)) - AutoOps: Require 9.2.1 for AutoOps agent [#9007](elastic/cloud-on-k8s#9007) (issue: [#9000](elastic/cloud-on-k8s#9000)) - Multi-SCP: Flip weight semantics - higher weight takes precedence [#9046](elastic/cloud-on-k8s#9046) ##### Documentation improvements - Update Google Cloud LoadBalancer recipe for new requirements [#8843](elastic/cloud-on-k8s#8843) - Fix minUnavailable typo in PDB documentation [#8898](elastic/cloud-on-k8s#8898) - Use GKE ComputeClass instead of DaemonSet for GKE AutoPilot [#8982](elastic/cloud-on-k8s#8982) - Adjust `vm.max_map_count` to [`1048576`](elastic/cloud-on-k8s@1048576) in GKE AutoPilot recipes [#8986](elastic/cloud-on-k8s#8986) - Remove support for Stack 7.17. [#9038](elastic/cloud-on-k8s#9038) ##### Dependency updates - Go 1.25.2 => 1.25.6 - github.com/KimMachineGun/automemlimit v0.7.4 => v0.7.5 - github.com/elastic/go-ucfg v0.8.9-0.20250307075119-2a22403faaea => v0.8.9-0.20251017163010-3520930bed4f - github.com/gkampitakis/go-snaps v0.5.15 => v0.5.19 - github.com/google/go-containerregistry v0.20.6 => v0.20.7 - github.com/googlecloudplatform/compute-class-api => v0.0.0-20251208134148-ae2e7936c1f8 - github.com/prometheus/common v0.67.1 => v0.67.5 - github.com/spf13/cobra v1.10.1 => v1.10.2 - go.elastic.co/apm/v2 v2.7.1 => v2.7.2 - go.uber.org/zap v1.27.0 => v1.27.1 - golang.org/x/crypto v0.40.0 => v0.46.0 - k8s.io/api v0.34.1 => v0.35.0 - k8s.io/apimachinery v0.34.1 => v0.35.0 - k8s.io/client-go v0.34.1 => v0.35.0 - k8s.io/utils v0.0.0-20250604170112-4c0f3b243397 => v0.0.0-20251002143259-bc988d571ff4 - sigs.k8s.io/controller-runtime v0.22.2 => v0.22.4 - sigs.k8s.io/controller-tools v0.19.0 => v0.20.0 </details> --- ### Configuration 📅 **Schedule**: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined). 🚦 **Automerge**: Disabled by config. Please merge this manually once you are satisfied. ♻ **Rebasing**: Whenever PR is behind base branch, or you tick the rebase/retry checkbox. 🔕 **Ignore**: Close this PR and you won't be reminded about this update again. --- - [ ] If you want to rebase/retry this PR, check this box --- This PR has been generated by [Renovate Bot](https://github.com/renovatebot/renovate).  Reviewed-on: https://gitea.alexlebens.dev/alexlebens/infrastructure/pulls/3682 Co-authored-by: Renovate Bot <renovate-bot@alexlebens.net> Co-committed-by: Renovate Bot <renovate-bot@alexlebens.net>

This PR contains the following updates: | Package | Update | Change | |---|---|---| | [elastic/cloud-on-k8s](https://github.com/elastic/cloud-on-k8s) | minor | `v3.2.0` → `v3.3.0` | --- ### Release Notes <details> <summary>elastic/cloud-on-k8s (elastic/cloud-on-k8s)</summary> ### [`v3.3.0`](https://github.com/elastic/cloud-on-k8s/releases/tag/v3.3.0) [Compare Source](elastic/cloud-on-k8s@v3.2.0...v3.3.0) ### Elastic Cloud on Kubernetes 3.3.0 - [Quickstart guide](https://www.elastic.co/docs/deploy-manage/deploy/cloud-on-k8s#eck-quickstart) ##### Release Highlights ##### AutoOps Integration (Enterprise feature) ECK now supports integration with Elastic AutoOps through a new `AutoOpsAgentPolicy` custom resource. This allows you to instrument multiple Elasticsearch clusters at once for automated health monitoring and performance recommendations. The [AutoOps documentation](https://www.elastic.co/docs/deploy-manage/monitor/autoops) provides more details. ##### Elastic Package Registry Integration ECK now supports deploying and managing Elastic Package Registry (EPR) through a new `PackageRegistry` custom resource. This is particularly useful for air-gapped environments, enabling Kibana to reference a self-hosted registry instead of the public one. The [package registry documentation](https://www.elastic.co/docs/deploy-manage/deploy/cloud-on-k8s/package-registry) provides more details. ##### Multiple Stack Configuration Policies composition support (Enterprise feature) ECK now includes support for multiple Stack Config Policies targeting the same Elasticsearch cluster or Kibana instance, using a weight-based priority system for deterministic policy composition. The [stack config policy documentation](https://www.elastic.co/docs/deploy-manage/deploy/cloud-on-k8s/elastic-stack-configuration-policies) provides more details. ##### Features and enhancements - AutoOpsAgentPolicy support [#8941](elastic/cloud-on-k8s#8941) (issue: [#8789](elastic/cloud-on-k8s#8789)) - ElasticPackageRegistry support [#8800](elastic/cloud-on-k8s#8800) (issue: [#8925](elastic/cloud-on-k8s#8925)) - Stack Config Policies composition support [#8917](elastic/cloud-on-k8s#8917) - Use standard Kibana labels and Helm labels on the ECK Operator pod [#8840](elastic/cloud-on-k8s#8840) (issue: [#8584](elastic/cloud-on-k8s#8584)) - Add service customization support for Elasticsearch remote cluster server [#8892](elastic/cloud-on-k8s#8892) - Removal of Elasticsearch 6.x support from codebase [#8979](elastic/cloud-on-k8s#8979) ##### Fixes - Upgrade master StatefulSets last when performing a version upgrade of Elasticsearch [#8871](elastic/cloud-on-k8s#8871) (issue: [#8429](elastic/cloud-on-k8s#8429)) - Fix race condition for pre-existing Stack Config Policy [#8928](elastic/cloud-on-k8s#8928) (issue: [#8912](elastic/cloud-on-k8s#8912)) - Do not set Kibana server.name [#8930](elastic/cloud-on-k8s#8930) (issue: [#8929](elastic/cloud-on-k8s#8929)) - Do not write `elasticsearch.k8s.elastic.co/managed-remote-clusters` when not necessary [#8932](elastic/cloud-on-k8s#8932) (issue: [#8781](elastic/cloud-on-k8s#8781)) - Cleanup orphaned secret mounts when removed from StackConfigPolicy [#8937](elastic/cloud-on-k8s#8937) (issue: [#8921](elastic/cloud-on-k8s#8921)) - Avoid duplicate error logging for generate GET operations on a GVK [#8957](elastic/cloud-on-k8s#8957) - Remove single master at a time upscale restriction [#8940](elastic/cloud-on-k8s#8940) (issue: [#8939](elastic/cloud-on-k8s#8939)) - AutoOps: Ignore deprecated ES clusters [#9008](elastic/cloud-on-k8s#9008) (issue: [#9000](elastic/cloud-on-k8s#9000)) - AutoOps: Require 9.2.1 for AutoOps agent [#9007](elastic/cloud-on-k8s#9007) (issue: [#9000](elastic/cloud-on-k8s#9000)) - Multi-SCP: Flip weight semantics - higher weight takes precedence [#9046](elastic/cloud-on-k8s#9046) ##### Documentation improvements - Update Google Cloud LoadBalancer recipe for new requirements [#8843](elastic/cloud-on-k8s#8843) - Fix minUnavailable typo in PDB documentation [#8898](elastic/cloud-on-k8s#8898) - Use GKE ComputeClass instead of DaemonSet for GKE AutoPilot [#8982](elastic/cloud-on-k8s#8982) - Adjust `vm.max_map_count` to [`1048576`](elastic/cloud-on-k8s@1048576) in GKE AutoPilot recipes [#8986](elastic/cloud-on-k8s#8986) - Remove support for Stack 7.17. [#9038](elastic/cloud-on-k8s#9038) ##### Dependency updates - Go 1.25.2 => 1.25.6 - github.com/KimMachineGun/automemlimit v0.7.4 => v0.7.5 - github.com/elastic/go-ucfg v0.8.9-0.20250307075119-2a22403faaea => v0.8.9-0.20251017163010-3520930bed4f - github.com/gkampitakis/go-snaps v0.5.15 => v0.5.19 - github.com/google/go-containerregistry v0.20.6 => v0.20.7 - github.com/googlecloudplatform/compute-class-api => v0.0.0-20251208134148-ae2e7936c1f8 - github.com/prometheus/common v0.67.1 => v0.67.5 - github.com/spf13/cobra v1.10.1 => v1.10.2 - go.elastic.co/apm/v2 v2.7.1 => v2.7.2 - go.uber.org/zap v1.27.0 => v1.27.1 - golang.org/x/crypto v0.40.0 => v0.46.0 - k8s.io/api v0.34.1 => v0.35.0 - k8s.io/apimachinery v0.34.1 => v0.35.0 - k8s.io/client-go v0.34.1 => v0.35.0 - k8s.io/utils v0.0.0-20250604170112-4c0f3b243397 => v0.0.0-20251002143259-bc988d571ff4 - sigs.k8s.io/controller-runtime v0.22.2 => v0.22.4 - sigs.k8s.io/controller-tools v0.19.0 => v0.20.0 </details> --- ### Configuration 📅 **Schedule**: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined). 🚦 **Automerge**: Disabled by config. Please merge this manually once you are satisfied. ♻ **Rebasing**: Whenever PR is behind base branch, or you tick the rebase/retry checkbox. 🔕 **Ignore**: Close this PR and you won't be reminded about this update again. --- - [ ] If you want to rebase/retry this PR, check this box --- This PR has been generated by [Renovate Bot](https://github.com/renovatebot/renovate).  Reviewed-on: https://gitea.alexlebens.dev/alexlebens/infrastructure/pulls/3685 Co-authored-by: Renovate Bot <renovate-bot@alexlebens.net> Co-committed-by: Renovate Bot <renovate-bot@alexlebens.net>

service template support for remoteClusterServer interface

d9403ed

botelastic bot added the triage label Nov 5, 2025

eedugon added 3 commits November 5, 2025 12:23

comments updated

9fb1b3f

Update generated deepcopy code for RemoteClusterServer.Service

cf9d002

Regenerate CRDs and API docs after adding Service field to RemoteClus…

f79c019

…terServer

eedugon requested review from barkbay and pebrc November 5, 2025 12:06

eedugon commented Nov 5, 2025

View reviewed changes

pkg/controller/elasticsearch/services/services.go Show resolved Hide resolved

pebrc added the >enhancement Enhancement of existing functionality label Nov 7, 2025

botelastic bot removed the triage label Nov 7, 2025

barkbay self-assigned this Nov 13, 2025

barkbay added the v3.3.0 label Nov 13, 2025

barkbay approved these changes Nov 13, 2025

View reviewed changes

pkg/apis/elasticsearch/v1/elasticsearch_types.go Outdated Show resolved Hide resolved

eedugon and others added 3 commits November 13, 2025 10:54

Apply suggestions from code review

e9990ac

Co-authored-by: Michael Morello <michael.morello@elastic.co>

Regenerate CRDs and docs after code review comment update

a5abced

Merge branch 'main' into remote_cluster_server_svc_support

32bdfc0

barkbay merged commit 656cdf0 into main Nov 14, 2025
9 checks passed

barkbay deleted the remote_cluster_server_svc_support branch November 14, 2025 06:44

eedugon changed the title ~~service template support for remoteClusterServer interface~~ Service template support for remoteClusterServer interface Nov 19, 2025

eedugon mentioned this pull request Nov 24, 2025

ECE and ECH to ECK remote clusters setup updated for API keys elastic/docs-content#3849

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Service template support for remoteClusterServer interface#8892

Service template support for remoteClusterServer interface#8892
barkbay merged 7 commits intomainfrom
remote_cluster_server_svc_support

eedugon commented Nov 5, 2025 •

edited

Loading

Uh oh!

prodsecmachine commented Nov 5, 2025 •

edited

Loading

Uh oh!

github-actions bot commented Nov 5, 2025 •

edited

Loading

Uh oh!

Uh oh!

barkbay left a comment

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Conversation

eedugon commented Nov 5, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Add service customization support for remoteClusterServer

What changed

Example Usage

Uh oh!

prodsecmachine commented Nov 5, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

✅ Snyk checks have passed. No issues have been found so far.

Uh oh!

github-actions bot commented Nov 5, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🔍 Preview links for changed docs

Uh oh!

Uh oh!

barkbay left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

eedugon commented Nov 5, 2025 •

edited

Loading

prodsecmachine commented Nov 5, 2025 •

edited

Loading

github-actions bot commented Nov 5, 2025 •

edited

Loading