Skip to content

Comments

Revert "Partition time-series source (#140475)"#141229

Merged
dnhatn merged 1 commit intoelastic:mainfrom
dnhatn:revert-partition
Jan 24, 2026
Merged

Revert "Partition time-series source (#140475)"#141229
dnhatn merged 1 commit intoelastic:mainfrom
dnhatn:revert-partition

Conversation

@dnhatn
Copy link
Member

@dnhatn dnhatn commented Jan 24, 2026

The competitive benchmark shows a significant performance regression from #140475. This is likely due to the high number of CPUs in the benchmark, which results in many small slices and adds significant overhead.

It is better to revert this change for now and adjust the partitioning for cases with high CPU and more than one shard before merging again.

Relates #140475

@dnhatn dnhatn added :StorageEngine/ES|QL Timeseries / metrics / PromQL / logsdb capabilities in ES|QL v9.3.1 >non-issue auto-backport Automatically create backport pull requests when merged auto-merge-without-approval Automatically merge pull request when CI checks pass (NB doesn't wait for reviews!) labels Jan 24, 2026
@dnhatn dnhatn marked this pull request as ready for review January 24, 2026 04:15
@dnhatn dnhatn requested a review from kkrik-es January 24, 2026 04:16
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-storage-engine (Team:StorageEngine)

@dnhatn dnhatn enabled auto-merge (squash) January 24, 2026 04:16
@dnhatn dnhatn disabled auto-merge January 24, 2026 04:17
@dnhatn dnhatn merged commit 1146b88 into elastic:main Jan 24, 2026
35 checks passed
@dnhatn dnhatn deleted the revert-partition branch January 24, 2026 04:17
@elasticsearchmachine
Copy link
Collaborator

💔 Backport failed

Status Branch Result
9.3 Commit could not be cherrypicked due to conflicts

You can use sqren/backport to manually backport by running backport --upstream elastic/elasticsearch --pr 141229

@dnhatn
Copy link
Member Author

dnhatn commented Jan 24, 2026

💚 All backports created successfully

Status Branch Result
9.3

Questions ?

Please refer to the Backport tool documentation

dnhatn added a commit to dnhatn/elasticsearch that referenced this pull request Jan 24, 2026
The competitive benchmark shows a significant performance regression
from elastic#140475. This is likely due to the high number of CPUs in the
benchmark, which results in many small slices and adds significant
overhead.

It is better to revert this change for now and adjust the partitioning
for cases with high CPU and more than one shard before merging again.

Relates elastic#14047

(cherry picked from commit 1146b88)

# Conflicts:
#	x-pack/plugin/esql/qa/testFixtures/src/main/resources/k8s-timeseries.csv-spec
elasticsearchmachine pushed a commit that referenced this pull request Jan 24, 2026
The competitive benchmark shows a significant performance regression
from #140475. This is likely due to the high number of CPUs in the
benchmark, which results in many small slices and adds significant
overhead.

It is better to revert this change for now and adjust the partitioning
for cases with high CPU and more than one shard before merging again.

Relates #14047

(cherry picked from commit 1146b88)

# Conflicts:
#	x-pack/plugin/esql/qa/testFixtures/src/main/resources/k8s-timeseries.csv-spec
@kkrik-es
Copy link
Contributor

Makes sense, let's iterate.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

auto-backport Automatically create backport pull requests when merged auto-merge-without-approval Automatically merge pull request when CI checks pass (NB doesn't wait for reviews!) >non-issue :StorageEngine/ES|QL Timeseries / metrics / PromQL / logsdb capabilities in ES|QL Team:StorageEngine v9.3.1 v9.4.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants