Add docs and tests about StreamOutput to memory#140365
Merged
DaveCTurner merged 4 commits intoelastic:mainfrom Jan 12, 2026
Merged
Add docs and tests about StreamOutput to memory#140365DaveCTurner merged 4 commits intoelastic:mainfrom
StreamOutput to memory#140365DaveCTurner merged 4 commits intoelastic:mainfrom
Conversation
There's various ways to serialize a `Writeable` into in-memory buffers, but the differences are pretty subtle and took some digging to pin down. This commit adds docs to describe the area better, and some testing to demonstrate that all the options produce the same results.
DaveCTurner
added
>test
elasticsearchmachine
added
the
Team:Distributed Coordination (obsolete)
Collaborator
|
Pinging @elastic/es-distributed-coordination (Team:Distributed Coordination) |
mhl-b
approved these changes
Jan 9, 2026
Contributor
mhl-b
left a comment
mhl-b
left a comment
There was a problem hiding this comment.
LGTM, thank you, valuable documentation.
Comment on lines
41
to
42
| * collector, copying over the existing data to the new collector, so this can perform badly for larger objects. For large enough objects | ||
| * this will start to perform humongous allocations which can be stressful for the garbage collector. |
Contributor
There was a problem hiding this comment.
Maybe a hint what is a large object and what to use instead of ByteArrayOutputStream?
szybia
added a commit
to szybia/elasticsearch
that referenced
this pull request
Jan 12, 2026
…i-project-tests * upstream/main: (23 commits) Fix `testAckListenerReceivesNacksIfPublicationTimesOut` (elastic#140514) Reduce priority of clear-cache tasks (elastic#139685) Add docs and tests about `StreamOutput` to memory (elastic#140365) ES|QL - dense_vector support for COUNT, PRESENT, ABSENT aggregator functions (elastic#139914) Add release notes for v9.2.4 release (elastic#140487) Add release notes for v9.1.10 release (elastic#140488) Add conncectors release notes for 9.1.10, 9.2.4 (elastic#140499) Add parameter support in PromQL query durations (elastic#139873) Improve testing of STS credentials reloading (elastic#140114) Fix zstd native binary publishing script to support newer versions (elastic#140485) Add FlattenedFieldBinaryVsSortedSetDocValuesSyntheticSourceIT (elastic#140489) Store fallback match only text fields in binary doc values (elastic#140189) [DiskBBQ] Use the new merge executor for intra-merge parallelism (elastic#139942) ESQL: introduce support for mapping-unavailable fields (elastic#140463) Add ESNextOSQVectorsScorerTests (elastic#140436) Disable high cardinality tests on release builds (elastic#140503) ESQL: TRange timezone support (elastic#139911) Directly compressing `StreamOutput` (elastic#140502) ES|QL - fix dense vector enrich bug (elastic#139774) Use CrossProjectModeDecider in RemoteClusterService (elastic#140481) ...
spinscale
pushed a commit
to spinscale/elasticsearch
that referenced
this pull request
Jan 21, 2026
There's various ways to serialize a `Writeable` into in-memory buffers, but the differences are pretty subtle and took some digging to pin down. This commit adds docs to describe the area better, and some testing to demonstrate that all the options produce the same results.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
There's various ways to serialize a
Writeableinto in-memory buffers,but the differences are pretty subtle and took some digging to pin down.
This commit adds docs to describe the area better, and some testing to
demonstrate that all the options produce the same results.