Coalesce the final prefill chunk of off-grid prompts and share steps with decodes - #14

Coalesce the final prefill chunk of off-grid prompts and share steps with decodes#14

original-el8 wants to merge 2 commits into

FujitsuPolycom:feat/gb10-continuation-prefillFujitsuPolycom/vllm:feat/gb10-continuation-prefillfrom

original-el8:perf/prefill-tail-coalescing-on-699original-el8/vllm:perf/prefill-tail-coalescing-on-699Copy head branch name to clipboard