[Bugfix][Frontend] Aggregate cached tokens for multi-prompt completions - #55120

[Bugfix][Frontend] Aggregate cached tokens for multi-prompt completions#55120

waizuichougou wants to merge 2 commits into

vllm-project:mainvllm-project/vllm:mainfrom

waizuichougou:fix/aggregate-completion-cache-tokenswaizuichougou/vllm:fix/aggregate-completion-cache-tokensCopy head branch name to clipboard