Avoid refreshing search-idle shards that don't yield results after query rewrite #95541
Labels
>enhancement
:Search/Search
Search-related issues that do not fall into other categories
:StorageEngine/TSDB
You know, for Metrics
Team:Analytics
Meta label for analytical engine team (ESQL/Aggs/Geo)
Team:Search
Meta label for search team
Many search requests have the following structure:
The index pattern matches (
metrics-*
) matches all metric data streams, but thematch_phrase
query on thedata_stream.dataset
field, which is a constant keyword field, only matches with one specific data stream.Before query rewriting either in the
can_match
orquery
phases, shards that are search-idle get refreshed. This increases the query time significantly. Many o11y use cases rely on the default refresh behaviour. Which is the schedule a refresh every second when a shard is search active and don't schedule any refreshes when a shard is search-idle, this to favour indexing performance.The refresh that occurs before the query rewrite should not occur on shards that don't match with the required filter clause on the
data_stream.dataset
constant keyword field. That is the goal of this issue..The text was updated successfully, but these errors were encountered: