Skip to content

[TRTLLM-6409][feat] Enable guided decoding with speculative decoding (part 1: two-model engine)#6300

Merged
syuoni merged 13 commits intoNVIDIA:mainfrom
syuoni:guided-with-spec
Aug 7, 2025
Merged

[TRTLLM-6409][feat] Enable guided decoding with speculative decoding (part 1: two-model engine)#6300
syuoni merged 13 commits intoNVIDIA:mainfrom
syuoni:guided-with-spec

Commits

Commits on Aug 7, 2025