[None][refactor] Simplify decoder state initialization for speculative decoding#6869

Merged

Funatiq merged 7 commits intoNVIDIA:mainfrom

Funatiq:dev/refactor_decoder_requests_x

Aug 22, 2025

Commits on Aug 20, 2025

refactor: Move speculative decoding setup functions to anonymous namespace
Funatiq
committed
refactor: Simplify Request structure and update function signatures
Funatiq
committed
refactor: Update draft token handling in llmRequest and CreateNewDecoderRequests
Funatiq
committed
refactor: Consolidate retrieveDraftLogits functionality into a standalone function
Funatiq
committed
refactor: Enhance draft logits handling in decoding process
Funatiq
committed
refactor: Remove Request class and update decoder request handling
Funatiq
committed
refactor: Add validation checks for draft logits metadata in retrieveDraftLogits
Funatiq
committed