Skip to content

storage: add gc benchmarks with multiple range tombstones#88252

Merged
craig[bot] merged 1 commit intocockroachdb:masterfrom
aliher1911:range_tombstone_many_test
Sep 26, 2022
Merged

storage: add gc benchmarks with multiple range tombstones#88252
craig[bot] merged 1 commit intocockroachdb:masterfrom
aliher1911:range_tombstone_many_test

Conversation

@aliher1911
Copy link
Copy Markdown
Contributor

@aliher1911 aliher1911 commented Sep 20, 2022

Previously we only had tests that verify GC performance with no range tombstones or with a single range tombstone under all the data. This commit extends the benchmark to have many tombstones interleaving data at different keys.

Release note: None

Fixes #87417

@cockroach-teamcity
Copy link
Copy Markdown
Member

This change is Reviewable

@aliher1911 aliher1911 force-pushed the range_tombstone_many_test branch 3 times, most recently from 3656e30 to 30ec7fb Compare September 21, 2022 14:59
@aliher1911 aliher1911 requested a review from a team September 22, 2022 15:53
@aliher1911 aliher1911 self-assigned this Sep 22, 2022
@aliher1911 aliher1911 force-pushed the range_tombstone_many_test branch from 30ec7fb to f76afca Compare September 23, 2022 21:34
@aliher1911 aliher1911 marked this pull request as ready for review September 23, 2022 21:48
@aliher1911 aliher1911 requested a review from a team as a code owner September 23, 2022 21:48
@aliher1911 aliher1911 force-pushed the range_tombstone_many_test branch from f76afca to 7b3116c Compare September 24, 2022 08:56
@aliher1911
Copy link
Copy Markdown
Contributor Author

I didn't realize that adding multiple range tombstones will be so disruptive. With 1024 range keys bench will time out preparing the data because insertions become too slow.
I think it needs to have handful at most with an option to cover all data or not.

@aliher1911 aliher1911 force-pushed the range_tombstone_many_test branch 2 times, most recently from 417a8d3 to eec6d5a Compare September 26, 2022 09:41
Comment thread pkg/storage/bench_test.go Outdated
Comment thread pkg/storage/bench_test.go Outdated
Previously we only had tests that verify GC performance with no range
tombstones or with a single range tombstone under all the data.
This commit extends the benchmark to have many tombstones interleaving
data at different keys.

Release note: None
@aliher1911 aliher1911 force-pushed the range_tombstone_many_test branch from eec6d5a to ea2c567 Compare September 26, 2022 13:38
Copy link
Copy Markdown
Contributor

@erikgrinaker erikgrinaker left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@aliher1911
Copy link
Copy Markdown
Contributor Author

bors r=erikgrinaker

@craig
Copy link
Copy Markdown
Contributor

craig Bot commented Sep 26, 2022

Build failed:

@aliher1911
Copy link
Copy Markdown
Contributor Author

bors r=erikgrinaker

@craig
Copy link
Copy Markdown
Contributor

craig Bot commented Sep 26, 2022

Build succeeded:

@craig craig Bot merged commit c432bd7 into cockroachdb:master Sep 26, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

storage: add gc benchmark with multiple range tombstones

3 participants