-
Notifications
You must be signed in to change notification settings - Fork 25.6k
Closed
Labels
:Data Management/Data streamsData streams and their lifecyclesData streams and their lifecycles>enhancementTeam:Data ManagementMeta label for data/management teamMeta label for data/management team
Description
For tsdb data streams, the @timestamp field is used to determine to which backing index a data stream resolves to.
Currently in IndexAbstraction.DataStream#getWriteIndex(...) the source of the document is parsed in order to extract the @timestamp field. If an ingest pipeline is active then this parsing is redundant, because ingest parse the source of a document to into a map of maps in order for a pipeline to process it.
After the final pipeline has executed, ingest can extract the @timestamp field and attach it as String/Long to the IndexRequest class as a field. Then IndexAbstraction.DataStream#getWriteIndex(...) can check for whether that field has been set and if so use that parse it into a Instant instance.
Metadata
Metadata
Assignees
Labels
:Data Management/Data streamsData streams and their lifecyclesData streams and their lifecycles>enhancementTeam:Data ManagementMeta label for data/management teamMeta label for data/management team