Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(pageserver): ensure GC computes time cutoff using the same start time #10193

Merged
merged 4 commits into from
Jan 6, 2025

Conversation

skyzh
Copy link
Member

@skyzh skyzh commented Dec 18, 2024

Problem

close #10192

Summary of changes

  • find_gc_time_cutoff takes now parameter so that all branches compute the cutoff based on the same start time, avoiding races.
  • gc-compaction uses a single get_gc_compaction_watermark function to get the safe LSN to compact.

@skyzh skyzh requested review from problame and arpad-m December 18, 2024 21:15
@skyzh skyzh requested a review from a team as a code owner December 18, 2024 21:15
@skyzh skyzh force-pushed the skyzh/watermark-compute branch from 4c7f881 to 74c2f20 Compare December 18, 2024 21:29
Copy link

github-actions bot commented Dec 18, 2024

7095 tests run: 6796 passed, 0 failed, 299 skipped (full report)


Flaky tests (1)

Postgres 17

Code coverage* (full report)

  • functions: 31.3% (8403 of 26878 functions)
  • lines: 48.0% (66726 of 139077 lines)

* collected from Rust tests only


The comment gets automatically updated with the latest test results
72c1deb at 2024-12-20T18:14:00.870Z :recycle:

pageserver/src/tenant.rs Outdated Show resolved Hide resolved
pageserver/src/tenant/timeline/compaction.rs Outdated Show resolved Hide resolved
Cargo.lock Outdated Show resolved Hide resolved
@skyzh skyzh force-pushed the skyzh/watermark-compute branch from 1b01e11 to 7184b22 Compare December 20, 2024 17:13
Signed-off-by: Alex Chi Z <[email protected]>
@skyzh skyzh enabled auto-merge December 20, 2024 17:14
@skyzh skyzh disabled auto-merge December 20, 2024 17:14
@skyzh skyzh enabled auto-merge December 20, 2024 17:15
@skyzh skyzh disabled auto-merge January 6, 2025 02:08
@skyzh skyzh added this pull request to the merge queue Jan 6, 2025
@skyzh skyzh removed this pull request from the merge queue due to a manual request Jan 6, 2025
github-merge-queue bot pushed a commit that referenced this pull request Jan 6, 2025
…time (#10193)

## Problem

close #10192

## Summary of changes

* `find_gc_time_cutoff` takes `now` parameter so that all branches
compute the cutoff based on the same start time, avoiding races.
* gc-compaction uses a single `get_gc_compaction_watermark` function to
get the safe LSN to compact.

---------

Signed-off-by: Alex Chi Z <[email protected]>
Co-authored-by: Arpad Müller <[email protected]>
@skyzh skyzh added this pull request to the merge queue Jan 6, 2025
Merged via the queue into main with commit 4a6556e Jan 6, 2025
82 checks passed
@skyzh skyzh deleted the skyzh/watermark-compute branch January 6, 2025 19:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

gc-compaction: find the correct horizon
2 participants