[None][feat] Support ignored prompt length for penalties via new sampling config parameter#8127

Merged

jhaotingc merged 1 commit intoNVIDIA:mainfrom

nvxuanyuc:prompt_ignore_penalty

Oct 27, 2025

Commits on Oct 26, 2025

Add prompt_ignore_length to SamplingConfig to control how many tokens to ignore from the prompt for precense and frequency penalties for trt and torch path.

nvxuanyuc
authored and
jhaotingc
committed