[Continuous Batching] Packed prefill with cu_seq_lens for multiple requests#151

LxYuan0420 merged 6 commits into

vllm-project:mainvllm-project/vllm-metal:mainfrom

ricky-chaoju:feat/packed-prefill-cu-seqlenricky-chaoju/vllm-metal:feat/packed-prefill-cu-seqlenCopy head branch name to clipboard