Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Generalize TraceFrontier with upper frontier #370

Merged

Conversation

frankmcsherry
Copy link
Member

This PR adds an upper: Antichain<T> frontier to TraceFrontier, generalizing it from the time interval [since, ...) to [since, upper). One option for upper is the empty frontier, which is semantically identical. This generalization allows one to import and use an arrangement on an intentionally narrowed interval of time, for example such as when one knows that changes at times greater than or equal to upper are of no interest.

This PR causes the import operator to drop its capabilities at this point, so that it may shut down the dataflow. This does risk miscommunicating that the trace is now "complete", but only in the same sense that pressing the returned ShutdownButton does, so this is judged to be not a new risk.

Copy link
Member

@antiguru antiguru left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks good! Thank you

src/operators/arrange/agent.rs Outdated Show resolved Hide resolved
@frankmcsherry
Copy link
Member Author

Thanks for the review!

@frankmcsherry frankmcsherry merged commit 78e7319 into TimelyDataflow:master Aug 23, 2022
This was referenced Oct 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants