[BugFix] Refactor add max_num_tokens_per_forward_pass to account for drafting#35038
Open
LucasWilkinson wants to merge 1 commit intovllm-project:mainfrom
Open
[BugFix] Refactor add max_num_tokens_per_forward_pass to account for drafting#35038LucasWilkinson wants to merge 1 commit intovllm-project:mainfrom
LucasWilkinson wants to merge 1 commit intovllm-project:mainfrom