Skip to content

perf: add benchmark for distributed vector merge finalization #6176

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
Xuanwo merged 4 commits into from
Mar 26, 2026
Merged

perf: add benchmark for distributed vector merge finalization #6176

Show file tree
Hide file tree
Changes from 2 commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
9141715
Add distributed vector merge benchmark
Xuanwo Mar 12, 2026
6e346d4
Merge branch 'main' into xuanwo/distributed-merge-benchmark
Xuanwo Mar 12, 2026
d2fd235
perf: measure find_partitions elapsed time
Xuanwo Mar 25, 2026
04f3688
bench: use public finalize API in distributed merge benchmark
Xuanwo Mar 26, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions rust/lance-datafusion/src/utils.rs
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -242,5 +242,6 @@ pub const ROWS_SCANNED_METRIC: &str = "rows_scanned";
pub const TASK_WAIT_TIME_METRIC: &str = "task_wait_time";
pub const DELTAS_SEARCHED_METRIC: &str = "deltas_searched";
pub const PARTITIONS_SEARCHED_METRIC: &str = "partitions_searched";
pub const FIND_PARTITIONS_CALLS_METRIC: &str = "find_partitions_calls";
pub const SCALAR_INDEX_SEARCH_TIME_METRIC: &str = "search_time";
pub const SCALAR_INDEX_SER_TIME_METRIC: &str = "ser_time";
4 changes: 4 additions & 0 deletions rust/lance/Cargo.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -182,6 +182,10 @@ harness = false
name = "vector_throughput"
harness = false

[[bench]]
name = "distributed_vector_build"
harness = false

[[bench]]
name = "mem_wal_write"
harness = false
Expand Down
Loading
Loading