[https://nvbugs/6479324][fix] Keep KV dtype for hybrid recurrent-states pool to unstall disagg transfers - #16812

[https://nvbugs/6479324][fix] Keep KV dtype for hybrid recurrent-states pool to unstall disagg transfers#16812

brnguyen2 wants to merge 2 commits into

NVIDIA:mainNVIDIA/TensorRT-LLM:mainfrom

brnguyen2:brnguyen/nvbug-6479324-fixbrnguyen2/TensorRT-LLM:brnguyen/nvbug-6479324-fixCopy head branch name to clipboard