Skip to content
This repository has been archived by the owner on Sep 21, 2024. It is now read-only.

feat: History compaction for spheres and gateways #661

Merged
merged 2 commits into from
Oct 4, 2023

Conversation

cdata
Copy link
Collaborator

@cdata cdata commented Oct 3, 2023

This change proposes a form of incremental history compaction, the core of which is implemented in Sphere. Its only use at this time will be in the Noosphere Gateway, where it will be used to ensure that side-effects that cause history to accrue for the gateway's sphere do not result in unbounded version growth. As of this change, the gateway will attempt to compact its history once an hour. The compaction flattens all history since the last user sync point.

@cdata cdata changed the title feat: History compaction in spheres feat: History compaction for spheres Oct 3, 2023
@cdata cdata force-pushed the feat/history-compaction branch 3 times, most recently from 7622243 to 881a35c Compare October 4, 2023 07:32
@cdata cdata force-pushed the feat/history-compaction branch from 881a35c to 4369829 Compare October 4, 2023 07:35
@cdata cdata marked this pull request as ready for review October 4, 2023 07:35
@cdata cdata requested a review from jsantell October 4, 2023 07:38
@cdata cdata changed the title feat: History compaction for spheres feat: History compaction for spheres and gateways Oct 4, 2023
jsantell
jsantell previously approved these changes Oct 4, 2023
Copy link
Contributor

@jsantell jsantell left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fantastic work! some comments & questions

rust/noosphere-core/src/view/mutation.rs Outdated Show resolved Hide resolved
rust/noosphere-core/src/view/sphere.rs Outdated Show resolved Hide resolved
rust/noosphere-gateway/src/worker/cleanup.rs Show resolved Hide resolved
@cdata cdata force-pushed the feat/history-compaction branch from 192aabe to b40b93a Compare October 4, 2023 18:45
@cdata cdata merged commit b8f41b6 into main Oct 4, 2023
17 checks passed
@cdata cdata deleted the feat/history-compaction branch October 4, 2023 18:55
@github-actions github-actions bot mentioned this pull request Oct 4, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants