Skip to content

perf: speed up format v2.2 scans by adding shortcut for full page #5981

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
Xuanwo merged 11 commits into from
Feb 27, 2026
Merged

perf: speed up format v2.2 scans by adding shortcut for full page #5981

Show file tree
Hide file tree
Changes from 5 commits
Commits
Show all changes
11 commits
Select commit Hold shift + click to select a range
573452c
Validate full-scan scheduling fix
Xuanwo Feb 22, 2026
5f547b1
ci: pin linux-build nightly toolchain for llvm-cov
Xuanwo Feb 22, 2026
bbdad60
Revert "ci: pin linux-build nightly toolchain for llvm-cov"
Xuanwo Feb 22, 2026
a1e606d
refactor(encoding): introduce FullZipReadSource for fullzip reads
Xuanwo Feb 24, 2026
8a27b96
Merge branch 'main' into xuanwo/fix-full-scan-rep-index
Xuanwo Feb 24, 2026
5c6fba4
fix(encoding): restore cache repetition index flag wiring
Xuanwo Feb 25, 2026
c0a96a6
Merge remote-tracking branch 'origin/main' into xuanwo/fix-full-scan-…
Xuanwo Feb 25, 2026
783e8ae
Merge remote-tracking branch 'origin/main' into xuanwo/fix-full-scan-…
Xuanwo Feb 26, 2026
73ea34d
fix: allow zero-width fullzip values with control words
Xuanwo Feb 26, 2026
9f9a032
style: format fullzip decoder validation
Xuanwo Feb 26, 2026
6834553
Merge remote-tracking branch 'origin/main' into xuanwo/fix-full-scan-…
Xuanwo Feb 26, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 0 additions & 3 deletions rust/lance-encoding/src/decoder.rs
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -704,7 +704,6 @@ impl CoreFieldDecoderStrategy {
let scheduler = Box::new(StructuralPrimitiveFieldScheduler::try_new(
column_info.as_ref(),
self.decompressor_strategy.as_ref(),
self.cache_repetition_index,
field,
)?);

Expand All @@ -721,7 +720,6 @@ impl CoreFieldDecoderStrategy {
let scheduler = Box::new(StructuralPrimitiveFieldScheduler::try_new(
column_info.as_ref(),
self.decompressor_strategy.as_ref(),
self.cache_repetition_index,
field,
)?);

Expand All @@ -745,7 +743,6 @@ impl CoreFieldDecoderStrategy {
let scheduler = Box::new(StructuralPrimitiveFieldScheduler::try_new(
column_info.as_ref(),
self.decompressor_strategy.as_ref(),
self.cache_repetition_index,
field,
)?);
column_infos.next_top_level();
Expand Down
Loading
Loading