[None][perf] Address inter-iter idle times - #16875

Merged

pcicotti merged 10 commits into

NVIDIA:feat/m3_with_msafrom

brb-nv:user/brb/address-inter-iter-delays-redo

Jul 26, 2026

Commits on Jul 26, 2026

[None][perf] Build MSA block ids into a single pinned buffer
brb-nv
committed
3bb3b04
[None][perf] Build the MSA page table on the host
brb-nv
committed
7e57b13
[None][perf] Vectorize MSA out_cache_loc and drop the req_to_token D2H
brb-nv
committed
3781dde
[None][perf] Stage MSA host mirrors through pinned memory
brb-nv
committed
45c9fd9
[None][perf] Remove host syncs from the MSA sparse plan builder
brb-nv
committed
b5cc3f5
[None][fix] Drop the stale MSA eager empty-block short-circuit
brb-nv
committed
6e096ad
[None][fix] Clamp corrected MSA kv_lens to the prepared extent
brb-nv
committed
5c314c3
[None][perf] Remove the blocking D2H from MSA on_update_kv_lens
brb-nv
committed
3eaf8e6
[None][fix] Patch the length MSA sparse plans actually mask with
brb-nv
committed
f549655
[None][fix] Repair the MSA run_indexer test fakes
brb-nv
committed
e2e3a39