Skip to content
This repository has been archived by the owner on Jan 7, 2022. It is now read-only.

Point-In-Time Subscription Reset Capability #39

Open
soceanainn opened this issue Dec 6, 2018 · 1 comment
Open

Point-In-Time Subscription Reset Capability #39

soceanainn opened this issue Dec 6, 2018 · 1 comment

Comments

@soceanainn
Copy link

soceanainn commented Dec 6, 2018

Suggesting pinned offsets at scheduled times (once daily, or part thereof - tag the latest offset for each partition).

This will make it very easy for subscribers to recover after incidents, without having to search for the offsets. It will be used for "point-in-time" subscription reset.

It's a small scheduled job with very little overhead and would greatly reduce a lot of the support we have to provide our consumers for finding the appropriate offsets and for minimising the recovery time after incidents.

@soceanainn
Copy link
Author

A nice solution could be to provide hourly pinned offsets for the previous 24 hours, as well as daily pinned offsets for the previous 7 days

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant