Skip to content

[TRTLLM-14019][feat] Transfer the separate draft KV cache in disaggregated serving - #17371

Closed
zheyuf wants to merge 3 commits into
NVIDIA:feat/m3_with_msafrom
zheyuf:feat/m3-eagle3-draft-kv-transfer
Closed

[TRTLLM-14019][feat] Transfer the separate draft KV cache in disaggregated serving#17371
zheyuf wants to merge 3 commits into
NVIDIA:feat/m3_with_msafrom
zheyuf:feat/m3-eagle3-draft-kv-transfer