Skip to content

[Perf] dsv4: Dequantize each shared sparse-prefill KV source once per forward - #45909

Merged
hnyls2002 merged 3 commits into
mainfrom
lsyin/dsv4-kv-dequant-once
Oct 23, 2026
Merged

hnyls2002 merged 3 commits into
mainfrom
lsyin/dsv4-kv-dequant-once

track the reused kv source in SparsePrefillKVBuffer; trim comments

a16b569
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar