[TRTLLM-11628][perf] Batch the beam-search finish-reason reduction - #17494

[TRTLLM-11628][perf] Batch the beam-search finish-reason reduction#17494

zhaoyangwang-nvidia merged 1 commit into

NVIDIA:mainNVIDIA/TensorRT-LLM:mainfrom

zhaoyangwang-nvidia:batch-handle-finish-reasonszhaoyangwang-nvidia/TensorRT-LLM:batch-handle-finish-reasonsCopy head branch name to clipboard