[None][refactor] Remove the CUDA GVR heuristic top-K decode and skip prior state for the self-sampling engine - #18447

[None][refactor] Remove the CUDA GVR heuristic top-K decode and skip prior state for the self-sampling engine#18447

longcheng-nv wants to merge 7 commits into

NVIDIA:mainNVIDIA/TensorRT-LLM:mainfrom

longcheng-nv:feat/gvr-cuda-heuristic-removallongcheng-nv/TensorRT-LLM:feat/gvr-cuda-heuristic-removalCopy head branch name to clipboard