[None][refactor] Simplify decoder state initialization#6559

Merged

Funatiq merged 17 commits intoNVIDIA:mainfrom

Funatiq:dev/refactor_decoder_requests_2

Aug 12, 2025

Commits on Aug 12, 2025

refactor: Minor cleanup in CreateNewDecoderRequests
Funatiq
committed
refactor: remove BufferManager from CreateNewDecoderRequests parameters
Funatiq
committed
refactor: Move embedding bias initialization to a separate function in CreateNewDecoderRequests
Funatiq
committed
refactor: Extract setupWords function in CreateNewDecoderRequests
Funatiq
committed
refactor: Move newRequestSpeculativeDecoding out of newRequest
Funatiq
committed
refactor: Consolidate speculative decoding logic in createDecoderRequests
Funatiq
committed
refactor: Enhance embedding bias initialization in CreateNewDecoderRequests
Funatiq
committed
refactor: Update stopWords and badWords handling in CreateNewDecoderRequests
Funatiq
committed
refactor: Introduce initializeRequestIds and initializeBeamSearch functions in CreateNewDecoderRequests
Funatiq
committed
refactor: Remove ids and endId from decoder_batch::Request
Funatiq
committed
refactor: Introduce initializeLogProbs function in CreateNewDecoderRequests
Funatiq
committed
refactor: Use decoder stream for request initialization
Funatiq
committed
refactor: Move beam width check to CreateNewDecoderRequests
Funatiq
committed
refactor: Introduce initializeInputLengths function in CreateNewDecoderRequests
Funatiq
committed
refactor: Initialize request lengths in CreateNewDecoderRequests
Funatiq
committed
refactor: Rename newRequest to initializeOutputs
Funatiq
committed
refactor: Add setBeamWidth method to DecoderState
Funatiq
committed