Skip to content

ESQL: Consolidate doc values memory tracking#142816

Merged
nik9000 merged 7 commits intoelastic:mainfrom
nik9000:esql_rework_loader_tracking
Feb 23, 2026
Merged

ESQL: Consolidate doc values memory tracking#142816
nik9000 merged 7 commits intoelastic:mainfrom
nik9000:esql_rework_loader_tracking

Conversation

@nik9000
Copy link
Copy Markdown
Member

@nik9000 nik9000 commented Feb 22, 2026

Moves the memory tracking for doc values loading in BlockLoader.Reader into Tracking*DocValues classes and a couple of utilities to atomically create them.

@nik9000
Copy link
Copy Markdown
Member Author

nik9000 commented Feb 22, 2026

This should be easier to read.

@elasticsearchmachine
Copy link
Copy Markdown
Collaborator

Pinging @elastic/es-analytical-engine (Team:Analytics)

@elasticsearchmachine elasticsearchmachine added the Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) label Feb 22, 2026
@nik9000
Copy link
Copy Markdown
Member Author

nik9000 commented Feb 22, 2026

@dnhatn, this was my idea for making this more readable. There's a lot of super(null) going on here, but if we like this I'll remove those in a followup.

@nik9000
Copy link
Copy Markdown
Member Author

nik9000 commented Feb 22, 2026

#142807 removes most of the remaining references to the super(null) thing.

@nik9000 nik9000 requested a review from dnhatn February 23, 2026 12:08
Copy link
Copy Markdown
Member

@martijnvg martijnvg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, looks cleaner to me 👍

* Wraps a {@link BinaryDocValues}, reserving some space in a {@link CircuitBreaker}
* while it is live.
*/
public class TrackingBinaryDocValues implements Releasable {
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can this also be a record? And would the same apply for the others tracking classes below?

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

will check

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done

@nik9000 nik9000 enabled auto-merge (squash) February 23, 2026 15:44
Copy link
Copy Markdown
Member

@dnhatn dnhatn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Thank you for the follow-up!

@nik9000 nik9000 merged commit 70f0da7 into elastic:main Feb 23, 2026
35 checks passed
nik9000 added a commit to nik9000/elasticsearch that referenced this pull request Feb 23, 2026
In elastic#142816 we moved memory tracking into `Tracking*DocValues` classes
for all block loaders except one. This gets the last one.
jdconrad pushed a commit to jdconrad/elasticsearch that referenced this pull request Feb 24, 2026
Moves the memory tracking for doc values loading in `BlockLoader.Reader`
into `Tracking*DocValues` classes and a couple of utilities to
atomically create them.
szybia added a commit to szybia/elasticsearch that referenced this pull request Feb 24, 2026
…on-sliced-reindex

* upstream/main:
  Update docs for v9.3.1 release (elastic#142887)
  Update docs for v9.2.6 release (elastic#142888)
  Improves visibility of vector index options and inference configuration (elastic#141653)
  Disable CAE in microsoft-graph-authz plugin (elastic#142848)
  Small improvements to `GetSnapshotsIT#testAllFeatures` (elastic#142825)
  Fix IndexSettingsTests synthetic ID tests (elastic#142654)
  [Test] Unmute tests of SnapshotShutdownIT (elastic#142921)
  Fixing metrics_info.json kibana definition file name (elastic#142813)
  [Packaging] Disable glibc 2.43 malloc huge pages in Wolfi images (elastic#142894)
  Mute org.elasticsearch.xpack.searchablesnapshots.SearchableSnapshotsTSDBSyntheticIdIntegTests testSearchableSnapshot elastic#142918
  Add shard heap usage to ClusterInfo (elastic#139557)
  ESQL: Load script fields row-by-row (elastic#142807)
  ESQL: Consolidate doc values memory tracking (elastic#142816)
  ES-14124  Create Index Count Limit User documentation Page (elastic#142570)
  Add a es819 codec test to verify tryRead returns null if may contain duplicates (elastic#142409)
  Support arithmetic operations for dense_vectors: scalar version (elastic#141060)
  [Transform] Allow project_routing (elastic#142421)
  Refactor query rewrite async actions for knn and sparse_vector queries (elastic#142889)
  Do not mark bulk indexing requests as retried after primary relocations (elastic#142157)
sidosera pushed a commit to sidosera/elasticsearch that referenced this pull request Feb 24, 2026
Moves the memory tracking for doc values loading in `BlockLoader.Reader`
into `Tracking*DocValues` classes and a couple of utilities to
atomically create them.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

:Analytics/ES|QL AKA ESQL >non-issue Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) v9.4.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants