Skip to content

[TRTLLM-13969][perf] Optimize M3 head-mismatched KV transfer - #1

Closed
peihu-nv wants to merge 2 commits into
brb-nv:peihengh/trtllm-13969-minimax-m3-disaggfrom
peihu-nv:peihengh/trtllm-m3-disagg-structured-bounce
Closed

[TRTLLM-13969][perf] Optimize M3 head-mismatched KV transfer#1
peihu-nv wants to merge 2 commits into
brb-nv:peihengh/trtllm-13969-minimax-m3-disaggfrom
peihu-nv:peihengh/trtllm-m3-disagg-structured-bounce