Validate eos_token_id against vocab_size to prevent OOB write in ApplyMinLength - #2266

Merged

David Fan (jiafatom) merged 4 commits into

mainfrom

fix/eos-token-id-vocab-bounds

Jul 12, 2026

Commits on Jul 10, 2026

Validate eos_token_id against vocab_size to prevent OOB write

David Fan (jiafatom)
and
Copilot
committed
46efa7b
Address review: assert runtime_error in test and clarify range message

David Fan (jiafatom)
and
Copilot
committed
a00cfcd
Address review: drop per-inference eos_token_id checks (validate once at creation)

David Fan (jiafatom)
and
Copilot
committed
6f6725b
Fix SamplingTests broken by eos_token_id vocab-bounds validation

David Fan (jiafatom)
and
Copilot
committed
d4ef5ea