feat: add keep_alive to async task status by lxrbox · Pull Request #144010 · elastic/elasticsearch

lxrbox · 2026-03-11T11:18:23Z

Add keep_alive field to task status for async search and ES|QL query tasks. The keep_alive value is now tracked in the task state and exposed via the task status API, allowing clients to observe the current keep_alive setting for running async operations.

Update AsyncTask interface to track keep_alive alongside expiration
Expose keep_alive in AsyncSearchTask and EsqlQueryTask status
Maintain backwards compatibility in task status serialization
Add integration tests verifying keep_alive in task info

Have you signed the contributor license agreement?
Have you followed the contributor guidelines?
If submitting code, have you built your formula locally prior to submission with gradle check?
If submitting code, is your pull request against main? Unless there is a good reason otherwise, we prefer pull requests against main and will backport as needed.
If submitting code, have you checked that your submission is for an OS and architecture that we support?
If you are submitting this code for a class then read our policy for that.

cla-checker-service · 2026-03-11T11:18:29Z

💚 CLA has been signed

lxrbox · 2026-03-11T11:34:12Z

CLA is signed. Could an Elastic maintainer please add an assignee and the
appropriate :Team / >type labels? CONTRIBUTING.md says changelog entries
are usually auto-created for external contributors, so I’ll wait unless you’d
prefer me to add docs/changelog/144010.yaml manually.

elasticsearchmachine · 2026-03-12T12:01:17Z

Pinging @elastic/es-search-relevance (Team:Search Relevance)

szybia · 2026-03-12T12:04:56Z

hi @lxrbox, thank you for the contribution!

hopefully someone from Search Relevance has some time to look at this.

tagging relevant issue: #142861

...k/plugin/async-search/src/test/java/org/elasticsearch/xpack/search/AsyncSearchTaskTests.java

thecoop · 2026-03-12T16:29:36Z

buildkite test this please

thecoop · 2026-03-12T17:16:21Z

@lxrbox there's several test failures, most specifically from :server:generateClusterFeaturesMetadata. Could you update from main, and fix up the test failures? You may need to re-generate the transport version number

lxrbox · 2026-03-13T00:49:37Z

@lxrbox there's several test failures, most specifically from :server:generateClusterFeaturesMetadata. Could you update from main, and fix up the test failures? You may need to re-generate the transport version number

Thanks for flagging this. I'll update from main, regenerate the transport version, and fix the failing checks.

thecoop · 2026-03-13T09:27:03Z

buildkite test this please

thecoop · 2026-03-13T11:09:35Z

...-search/src/internalClusterTest/java/org/elasticsearch/xpack/search/AsyncSearchActionIT.java

+        var targetTaskId = AsyncExecutionId.decode(asyncSearchId).getTaskId();
+        TaskInfo found = null;
+        for (TaskInfo taskInfo : client().admin().cluster().prepareListTasks().setDetailed(true).get().getTasks()) {
+            if (taskInfo.taskId().equals(targetTaskId)) {


could this be a stream? ...getTasks().stream().filter(task()==targetTaskId).findAny()

thecoop · 2026-03-13T11:10:17Z

...k/plugin/async-search/src/test/java/org/elasticsearch/xpack/search/AsyncSearchTaskTests.java

+        try (AsyncSearchTask task = createAsyncSearchTask()) {
+            TaskInfo taskInfo = task.taskInfo("node1", true);
+            assertThat(taskInfo.status(), notNullValue());
+            assertThat(taskInfo.toString(), containsString("\"request_id\" : \"" + task.getExecutionId().getEncoded() + "\""));


nit - these can be hasToString(containsString(...))

thecoop · 2026-03-13T11:11:58Z

...k/plugin/async-search/src/test/java/org/elasticsearch/xpack/search/AsyncSearchTaskTests.java

+                List.of(new NamedWriteableRegistry.Entry(Task.Status.class, RawTaskStatus.NAME, RawTaskStatus::new))
+            );
+            TaskInfo taskInfo = task.taskInfo("node1", true);
+            TransportVersion previousVersion = TransportVersionUtils.getPreviousVersion(TransportVersion.current());


You need to get the transport version previous to the specific change you're introducing here, not the previous to current() (which will move forwards). You can use the randomVersionNotSupporting method for this.

thecoop · 2026-03-13T11:15:00Z

x-pack/plugin/esql/src/test/java/org/elasticsearch/xpack/esql/action/EsqlQueryRequestTests.java

+            new AsyncExecutionId(randomAlphaOfLength(10), new TaskId(randomAlphaOfLength(4), randomNonNegativeLong())),
+            TimeValue.timeValueDays(2)
+        );
+        TransportVersion previousVersion = TransportVersionUtils.getPreviousVersion(TransportVersion.current());


See comment on TransportVersion checks above

thecoop · 2026-03-13T11:16:02Z

Looking pretty good. A couple more comments, and this also needs a changelog, and an update from main, and then we're good to go

lxrbox · 2026-03-13T15:26:53Z

看起来不错。再补充几点，还需要一个更新日志，以及主分支的更新，然后就可以正式发布了。

Addressed the remaining comments:

switched the task lookup helper to a stream
updated the transport-version BWC checks to use randomVersionNotSupporting(...) with the feature-specific transport version
added a changelog
rebased onto main

thecoop · 2026-03-13T15:32:15Z

The changelog needs to be for this PR number, #144010

lxrbox · 2026-03-13T15:41:21Z

The changelog needs to be for this PR number, #144010

Updated the changelog to use this PR number (#144010).

thecoop · 2026-03-13T15:57:38Z

buildkite test this

Add keep_alive field to task status for async search and ES|QL query tasks. The keep_alive value is now tracked in the task state and exposed via the task status API, allowing clients to observe the current keep_alive setting for running async operations. - Update AsyncTask interface to track keep_alive alongside expiration - Expose keep_alive in AsyncSearchTask and EsqlQueryTask status - Maintain backwards compatibility in task status serialization - Add integration tests verifying keep_alive in task info

Use hasEntry with allOf in AsyncSearchTaskTests to assert the serialized RawTaskStatus map more explicitly and avoid repeated toMap() calls.

Use a feature-specific transport version for async task status compatibility checks instead of deriving from current(). Also apply the follow-up review cleanups by switching the task lookup helper to a stream-based implementation, using hasToString assertions, and adding a changelog entry.

Rename the changelog entry to match the actual PR number so the community PR validation passes.

lxrbox · 2026-03-13T23:51:21Z

updated the transport-version checks to use the feature-specific version boundary

thecoop · 2026-03-16T08:50:58Z

buildkite test this

thecoop · 2026-03-16T11:32:50Z

All merged, thanks for the contribution!

lxrbox · 2026-03-16T11:37:35Z

All merged, thanks for the contribution!

Thanks for the review and merge! Glad to contribute.

…elocations * upstream/main: (33 commits) Unmute InferenceRestIT and DefaultEndPointsIT (elastic#144217) feat: add keep_alive to async task status (elastic#144010) Add explicit isNoOpUpdate() method to MapperService (elastic#144113) Always attach APM Agent (elastic#144120) Fix random_score nightly tests (elastic#144176) Add nested query checks for disabled sequence numbers (elastic#144185) Return sentinel values from Fetch when sequence numbers are disabled (elastic#144212) [Test] Test peer-recovery with sequence numbers pruning (elastic#144116) Remove `scaled-*` field assertions from mixed cluster downsampling test (elastic#144295) Refactor: Use range syntax in ES|QL exponential histogram tests (elastic#144110) Move resolve aliases to IndexAbstractionOptions (elastic#143953) unmute test (elastic#144299) Fix approximation csvtests (elastic#144233) fix test (elastic#144171) Add int4 vector scoring benchmarks (elastic#144105) Mute org.elasticsearch.xpack.esql.qa.single_node.GenerativeIT test elastic#143023 Mute org.elasticsearch.test.apmintegration.MetricsApmIT testApmIntegration {withOTel=false} elastic#144282 Native cli launcher (elastic#143712) Mute org.elasticsearch.xpack.esql.qa.multi_node.GenerativeIT test elastic#143023 Mute org.elasticsearch.xpack.esql.heap_attack.HeapAttackSubqueryIT testManyRandomKeywordFieldsInSubqueryIntermediateResults elastic#144274 ...

Add keep_alive field to task status for async search and ES|QL query tasks. The keep_alive value is now tracked in the task state and exposed via the task status API, allowing clients to observe the current keep_alive setting for running async operations. --------- Co-authored-by: Simon Cooper <simon.cooper@elastic.co>

elasticsearchmachine added v9.4.0 needs:triage Requires assignment of a team area label external-contributor Pull request authored by a developer outside the Elasticsearch team labels Mar 11, 2026

szybia added :Search Relevance/ES|QL Search functionality in ES|QL and removed needs:triage Requires assignment of a team area label labels Mar 12, 2026

elasticsearchmachine added the Team:Search Relevance Meta label for the Search Relevance team in Elasticsearch label Mar 12, 2026

szybia added >enhancement and removed Team:Search Relevance Meta label for the Search Relevance team in Elasticsearch labels Mar 12, 2026

elasticsearchmachine added the Team:Search Relevance Meta label for the Search Relevance team in Elasticsearch label Mar 12, 2026

thecoop reviewed Mar 12, 2026

View reviewed changes

...k/plugin/async-search/src/test/java/org/elasticsearch/xpack/search/AsyncSearchTaskTests.java Outdated Show resolved Hide resolved

lxrbox force-pushed the issue-142861-tasks-keep-alive branch from 04cec53 to a53f32f Compare March 13, 2026 01:17

thecoop reviewed Mar 13, 2026

View reviewed changes

thecoop self-assigned this Mar 13, 2026

lxrbox force-pushed the issue-142861-tasks-keep-alive branch from a53f32f to 5ecd818 Compare March 13, 2026 15:24

lxrbox force-pushed the issue-142861-tasks-keep-alive branch from 5ecd818 to 500e696 Compare March 13, 2026 15:40

lxrbox added 5 commits March 14, 2026 07:25

Refine async task status map assertions

6004cc2

Use hasEntry with allOf in AsyncSearchTaskTests to assert the serialized RawTaskStatus map more explicitly and avoid repeated toMap() calls.

Add changelog for PR 144010

231a04c

Rename the changelog entry to match the actual PR number so the community PR validation passes.

Update transport version

deacdfb

lxrbox force-pushed the issue-142861-tasks-keep-alive branch from bd8f1c0 to deacdfb Compare March 13, 2026 23:30

lxrbox and others added 5 commits March 14, 2026 21:18

Merge branch 'main' into issue-142861-tasks-keep-alive

be84960

Merge branch 'main' into issue-142861-tasks-keep-alive

7fa0a91

Merge branch 'main' into issue-142861-tasks-keep-alive

4ff01ab

Merge branch 'main' into issue-142861-tasks-keep-alive

cae1f38

Merge branch 'main' into issue-142861-tasks-keep-alive

548f582

lxrbox added 2 commits March 16, 2026 18:22

Merge branch 'main' into issue-142861-tasks-keep-alive

c24bbb5

Merge branch 'main' into issue-142861-tasks-keep-alive

565986a

thecoop merged commit 556119e into elastic:main Mar 16, 2026
10 checks passed

szybia mentioned this pull request Apr 1, 2026

Tasks API | Async Search+ESQL report keep_alive #142861

Closed

Conversation

lxrbox commented Mar 11, 2026

Uh oh!

cla-checker-service bot commented Mar 11, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

lxrbox commented Mar 11, 2026

Uh oh!

elasticsearchmachine commented Mar 12, 2026

Uh oh!

szybia commented Mar 12, 2026

Uh oh!

Uh oh!

thecoop commented Mar 12, 2026

Uh oh!

thecoop commented Mar 12, 2026

Uh oh!

lxrbox commented Mar 13, 2026

Uh oh!

thecoop commented Mar 13, 2026

Uh oh!

thecoop Mar 13, 2026

Choose a reason for hiding this comment

Uh oh!

thecoop Mar 13, 2026

Choose a reason for hiding this comment

Uh oh!

thecoop Mar 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

thecoop Mar 13, 2026

Choose a reason for hiding this comment

Uh oh!

thecoop commented Mar 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

lxrbox commented Mar 13, 2026

Uh oh!

thecoop commented Mar 13, 2026

Uh oh!

lxrbox commented Mar 13, 2026

Uh oh!

thecoop commented Mar 13, 2026

Uh oh!

lxrbox commented Mar 13, 2026

Uh oh!

thecoop commented Mar 16, 2026

Uh oh!

Uh oh!

thecoop commented Mar 16, 2026

Uh oh!

lxrbox commented Mar 16, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

cla-checker-service bot commented Mar 11, 2026 •

edited

Loading

thecoop Mar 13, 2026 •

edited

Loading

thecoop commented Mar 13, 2026 •

edited

Loading