Skip to content

Support data streams and aliases in CCR shard changes API#118937

Merged
salvatore-campagna merged 3 commits intoelastic:mainfrom
salvatore-campagna:feature/shard-changes-data-stream-alias
Dec 18, 2024
Merged

Support data streams and aliases in CCR shard changes API#118937
salvatore-campagna merged 3 commits intoelastic:mainfrom
salvatore-campagna:feature/shard-changes-data-stream-alias

Conversation

@salvatore-campagna
Copy link
Contributor

@salvatore-campagna salvatore-campagna commented Dec 18, 2024

Extends the /{index}/ccr/shard_changes API to accept data stream and alias names in addition to index names.
This allows users to retrieve shard changes for data streams and indices accessed through aliases.
When a data stream is provided, the API targets the first backing index for retrieving shard changes.
Similarly, for an alias, the API targets the first index associated with the alias.

@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-storage-engine (Team:StorageEngine)

@salvatore-campagna salvatore-campagna requested review from kkrik-es and removed request for kkrik-es December 18, 2024 12:12
Copy link
Member

@martijnvg martijnvg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@salvatore-campagna salvatore-campagna merged commit 4e5b94a into elastic:main Dec 18, 2024
salvatore-campagna added a commit to elastic/rally-tracks that referenced this pull request Jan 22, 2025
…#722)

Benchmarking the new API introduced in PR elastic/elasticsearch#118608 to evaluate synthetic source recovery latency. The benchmark will target indices or data streams in the `elastic/logs`, `elastic/security`, and `tsdb` tracks.

Key notes:
- A retention lease must be added before indexing to prevent missing `seq_no` values during shard recovery.
- The API in PR elastic/elasticsearch#118937 supports data streams and index aliases, allowing flexibility in targeting indices, especially for data stream use cases.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

Comments