Skip to content

Add WAL Replay support for crash recovery #1954

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
jmacd merged 27 commits into from
Feb 6, 2026
Merged

Add WAL Replay support for crash recovery #1954

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
27 commits
Select commit Hold shift + click to select a range
594185c
Implement WAL replay support and enhance cursor management for crash …
AaronRM Jan 21, 2026
d04bc9b
Revert ArrowRecordBatch references
AaronRM Jan 21, 2026
ea4f7ad
Revert SystemTime change
AaronRM Jan 21, 2026
4ed23f8
Implement MultiFileWalReader for handling multiple WAL files during r…
AaronRM Jan 22, 2026
1938b08
Clarify slot name handling in ReplayBundle documentation and comments
AaronRM Jan 22, 2026
b770001
Refactor cursor sidecar path retrieval to use CursorSidecar struct me…
AaronRM Jan 22, 2026
d251d60
Reorder tests
AaronRM Feb 4, 2026
7b599f9
Fix an issue whtere MultiFileWalIter::next() was re-creating the WalE…
AaronRM Feb 4, 2026
c72b293
Clamp negative timestamps in ReplayBundle ingestion time
AaronRM Feb 4, 2026
8af7e46
Return structured result from WAL scanning
AaronRM Feb 4, 2026
50948c9
Reduce code duplication in WalConsumerCursor::after
AaronRM Feb 4, 2026
fac8252
Add #[must_use] reason to replay_wal
AaronRM Feb 4, 2026
b37649e
Enhance WAL replay error handling and logging for corrupt entries
AaronRM Feb 4, 2026
f7741cc
Refactor cursor sidecar filename usage in tests and engine
AaronRM Feb 4, 2026
2d07f74
Formatting
AaronRM Feb 4, 2026
68f712f
Handle CRC failures consistent with replay_wal()
AaronRM Feb 4, 2026
2e13068
Add tests for WAL replay handling of truncated and corrupted entries
AaronRM Feb 4, 2026
0a6f336
Add const to wal_position_start
AaronRM Feb 4, 2026
f326a00
Formatting
AaronRM Feb 4, 2026
487e64e
Refactor multi_file_reader test to use async and validate entry order…
AaronRM Feb 5, 2026
1e82125
Refactor wal_replay test to make more deterministic
AaronRM Feb 5, 2026
24723c2
Improve two WAL replay tests with stronger assertions
AaronRM Feb 5, 2026
aaa0c95
Formatting
AaronRM Feb 5, 2026
d9c2b28
Change skipped_corrupt to bool (stopped_at_corruption)
AaronRM Feb 5, 2026
a8fa833
Add wal_end_position method and tests for MultiFileWalReader
AaronRM Feb 5, 2026
b06dbf7
Enhance WAL replay to handle cursor sidecar issues and add tests for …
AaronRM Feb 5, 2026
d01da2a
Formatting
AaronRM Feb 5, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading
Loading