Dynamically enable / disable plugins in correspondence to stateless mode. by mosche · Pull Request #142147 · elastic/elasticsearch

mosche · 2026-02-09T15:11:11Z

deploymentTarget provides a way to dynamically refine which plugins are loaded in a deployment based on stateless.enabled:

STATEFUL_ONLY: Only load plugin on stateful deployments (stateless mode disabled)
STATELESS_ONLY: Only load plugin on stateless deployments (stateless mode enabled)
ALL: Always load plugin (default)

Relates to ES-13956

…ode. The PluginDescriptor property `distribution.mode` can be optionally set to one of the following: - STATEFUL_ONLY (exclude plugin if stateless mode is enabled) - STATELESS_ONLY (exclude plugin if stateless mode is disabled) - ALWAYS (the default to always include the plugin) This provides a way to dynamically refine the current distribution and exclude plugins that may not be present in stateful or stateless respectively. Relates to ES-13956

elasticsearchmachine · 2026-02-10T08:35:08Z

Pinging @elastic/es-core-infra (Team:Core/Infra)

…ibutionMode

kingherc

LGTM, thanks Moritz! Feel free to see whether waiting for a Core/Infra approval as well would be good.

kingherc

Based on discussion, some more comments. Also can you make x-pack-monitoring STATEFUL_ONLY?

x-pack/plugin/transform/build.gradle

rjernst

Looks pretty good, a few thoughts

rjernst · 2026-02-11T14:33:40Z

server/src/main/java/org/elasticsearch/plugins/PluginDescriptor.java

+    private static Optional<DeploymentTarget> readDeploymentTarget(Map<String, String> propsMap, String pluginId) {
+        String rawValue = propsMap.remove("deployment.target");
+        if (rawValue == null || rawValue.isBlank()) {
+            return Optional.empty();


Do we need both Optional here and the default of ALWAYS? Could we just use ALWAYS and remove Optional?

Also, nit: instead of allowing "blank" to be the default could we error, ie enforce if the property is present, it must be one of the 3 values?

Just thinking, if we enforce this, would it maybe break 3rd party custom plugins?

I wasn't suggesting we require the property. Rather, when the property isn't set, the default of ALWAYS is used, rather than Optional.empty() which later gets interpreted to ALWAYS.

@rjernst I can do that. Though, one reason I decided for Optional was to not having to fallback to ALWAYS when reading a plugin descriptor from StreamInput (rather than from the descriptor file). Since this is really only relevant prior to loading the plugin, I decided against even serializing it (and having to account for different transport versions) as it's rather pointless at that point. If it wasn't supposed to be loaded, it won't be loaded - and won't be present.

@rjernst Finally picking this up again. Any thought on above?

I removed all optionals, BUT still not serializing deploymentTarget (neither binary, nor XContent).
When reading from StreamInput the target is always ALL. But at that point's it's not relevant anymore.

server/src/main/java/org/elasticsearch/plugins/PluginDescriptor.java

masseyke

I think my concerns are already addressed in other comments. Otherwise, LGTM

…ibutionMode

elasticsearchmachine · 2026-03-10T09:56:30Z

💔 Backport failed

Status	Branch	Result
❌	9.1	Commit could not be cherrypicked due to conflicts
✅	9.3
❌	8.19	Commit could not be cherrypicked due to conflicts
❌	9.2	Commit could not be cherrypicked due to conflicts

You can use sqren/backport to manually backport by running backport --upstream elastic/elasticsearch --pr 142147

…ode. (elastic#142147) deploymentTarget provides a way to dynamically refine which plugins are loaded for a deployment based on stateless.enabled: - STATEFUL_ONLY: Only load plugin on stateful deployments (stateless mode disabled) - STATELESS_ONLY: Only load plugin on stateless deployments (stateless mode enabled) - ALL: Always load plugin (default) Relates to ES-13956 Relates to ES-13956

…locations * upstream/main: (126 commits) Update KnnIndexTester to use more settings from datasets (elastic#143869) fix: dynamic template vector array is overridden by automatic dense_vector mapping (elastic#143733) ES|QL: Don't reuse the same alias for _fork column (elastic#143909) Close and initialize clients after each node upgrade in logsdb rolling upgrade tests. (elastic#143823) ESQL: Added GroupedTopNOperator for LIMIT BY, compute only (elastic#143476) Handle views in ResolveIndexAction (elastic#143561) Improve reindex rethrottle API in stateless (elastic#143771) Use a copy of the SearchExecutionContext for each Percolator execution (elastic#142765) Log the stacktrace when we encounter a deprecation warning for `default_metric` (elastic#143929) ESQL: evaluate ReferenceAttributes to potentially FieldAttributes for full-text functions restriction (elastic#143893) Add ClusterStateSerializationStats Serializatation Tests (elastic#142703) Adds Coordination Diagnostics Tests (elastic#142709) Upgrade Elasticsearch to Apache Lucene 10.4 (elastic#141882) ESQL: Add configurable bracket-based multi-value support for CSV reader (elastic#143890) time series es819 binary dv use up to a 1mb block size (elastic#143049) Dynamically enable / disable plugins in correspondence to stateless mode. (elastic#142147) ES|QL: Implement first/last_over_time for tdigest (elastic#143832) Document CHANGE_POINT limitation (elastic#143877) Fix OperationsOnSeqNoDisabledIndicesIT (elastic#143892) [Test] Test that sequence numbers are not pruned with retention lease (elastic#143825) ...

mosche added 3 commits February 9, 2026 15:33

nit

052328a

nit

112c178

elasticsearchmachine added the v9.4.0 label Feb 9, 2026

Merge branch 'main' into statelessOnPrem/distributionMode

d99317e

elasticsearchmachine added the serverless-linked Added by automation, don't add manually label Feb 9, 2026

mosche added 2 commits February 9, 2026 17:54

fix tests

d9ca9d0

Merge branch 'main' into statelessOnPrem/distributionMode

282d42d

mosche added auto-backport Automatically create backport pull requests when merged branch:9.2 branch:9.1 branch:8.19 branch:9.3 >non-issue :Core/Infra/Plugins Plugin API and infrastructure labels Feb 10, 2026

elasticsearchmachine added v9.3.1 v9.1.11 v8.19.12 v9.2.6 and removed branch:9.2 branch:9.1 branch:8.19 branch:9.3 labels Feb 10, 2026

mosche marked this pull request as ready for review February 10, 2026 08:34

mosche requested review from a team as code owners February 10, 2026 08:34

mosche requested review from kingherc and masseyke February 10, 2026 08:35

elasticsearchmachine added the Team:Core/Infra Meta label for core/infra team label Feb 10, 2026

mosche added 2 commits February 10, 2026 13:00

Merge remote-tracking branch 'origin/main' into statelessOnPrem/distr…

74eaa7e

…ibutionMode

make watcher stateful only

12a3570

kingherc approved these changes Feb 10, 2026

View reviewed changes

kingherc reviewed Feb 11, 2026

View reviewed changes

x-pack/plugin/transform/build.gradle Outdated Show resolved Hide resolved

rjernst reviewed Feb 11, 2026

View reviewed changes

elasticsearchmachine added v8.19.13 v9.3.2 v9.2.7 and removed v8.19.12 v9.3.1 v9.2.6 labels Feb 19, 2026

masseyke approved these changes Feb 27, 2026

View reviewed changes

mosche and others added 12 commits March 5, 2026 11:44

Merge remote-tracking branch 'origin/main' into statelessOnPrem/distr…

b6b89d8

…ibutionMode

Merge remote-tracking branch 'origin/main' into statelessOnPrem/distr…

40a2b51

…ibutionMode

review

1e4e2d0

[CI] Auto commit changes from spotless

5dea363

review

73abe4a

Merge remote-tracking branch 'origin/main' into statelessOnPrem/distr…

6d71fe4

…ibutionMode

fix test

3996474

Merge remote-tracking branch 'origin/main' into statelessOnPrem/distr…

4496e0e

…ibutionMode

Merge branch 'main' into statelessOnPrem/distributionMode

d7cfc5d

Merge branch 'main' into statelessOnPrem/distributionMode

0e788ca

Merge branch 'main' into statelessOnPrem/distributionMode

b08e39d

Merge remote-tracking branch 'origin/main' into statelessOnPrem/distr…

a01b8cf

…ibutionMode

mosche merged commit 4566c43 into elastic:main Mar 10, 2026
36 checks passed

mosche mentioned this pull request Mar 10, 2026

[9.3] Dynamically enable / disable plugins in correspondence to stateless mode. (#142147) #143932

Open

elasticsearchmachine added the backport pending label Mar 10, 2026

Conversation

mosche commented Feb 9, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

elasticsearchmachine commented Feb 10, 2026

Uh oh!

kingherc left a comment

Choose a reason for hiding this comment

Uh oh!

kingherc left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

rjernst left a comment

Choose a reason for hiding this comment

Uh oh!

rjernst Feb 11, 2026

Choose a reason for hiding this comment

Uh oh!

kingherc Feb 11, 2026

Choose a reason for hiding this comment

Uh oh!

rjernst Feb 11, 2026

Choose a reason for hiding this comment

Uh oh!

mosche Feb 12, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

mosche Mar 4, 2026

Choose a reason for hiding this comment

Uh oh!

mosche Mar 5, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

masseyke left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

elasticsearchmachine commented Mar 10, 2026

💔 Backport failed

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

mosche commented Feb 9, 2026 •

edited

Loading

mosche Feb 12, 2026 •

edited

Loading