Skip to content

Get from translog fails with large dense_vector (#104700)#104915

Merged
jimczi merged 1 commit intoelastic:8.12from
jimczi:backport_8_12_104700
Jan 30, 2024
Merged

Get from translog fails with large dense_vector (#104700)#104915
jimczi merged 1 commit intoelastic:8.12from
jimczi:backport_8_12_104700

Conversation

@jimczi
Copy link
Copy Markdown
Contributor

@jimczi jimczi commented Jan 30, 2024

Backport of #104700

This change fixes the engine to apply the current codec when retrieving documents from the translog.
We need to use the same codec than the main index in order to ensure that all the source data is indexable.
The internal codec treats some fields differently than the default one, for instance dense_vectors are limited to 1024 dimensions.
This PR ensures that these customizations are applied when indexing document for translog retrieval.

Closes elastic#104639

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
@jimczi jimczi added >bug :Distributed/Engine Anything around managing Lucene and the Translog in an open shard. backport v8.12.1 labels Jan 30, 2024
@jimczi jimczi requested a review from pxsalehi January 30, 2024 15:44
@jimczi jimczi merged commit 2258610 into elastic:8.12 Jan 30, 2024
@jimczi jimczi deleted the backport_8_12_104700 branch January 30, 2024 15:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport >bug :Distributed/Engine Anything around managing Lucene and the Translog in an open shard. v8.12.1

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants