[Perf][Attention] FlashInfer: skip the seq_lens copy with speculative decoding - #57352

[Perf][Attention] FlashInfer: skip the seq_lens copy with speculative decoding#57352

gf239 wants to merge 6 commits into

vllm-project:mainvllm-project/vllm:mainfrom

gf239:flashinfer-plan-no-syncgf239/vllm:flashinfer-plan-no-syncCopy head branch name to clipboard