Skip to content

[TRTLLM-16282][feat] Add sparse KV offload and GPU metadata publication - #19821

Merged
cascade812 merged 9 commits into
NVIDIA:mainfrom
cascade812:dsa-kv-offload-2
Oct 8, 2026
Merged

[TRTLLM-16282][feat] Add sparse KV offload and GPU metadata publication#19821
cascade812 merged 9 commits into
NVIDIA:mainfrom
cascade812:dsa-kv-offload-2

fix: handle sparse KV beam rows and serialize snapshots

93edc47
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs