[Core][CUDA Graph] add output buffer for cudagraph to reduce memory footprint#5074

youkaichao merged 10 commits into

vllm-project:mainvllm-project/vllm:mainfrom

youkaichao:cudagraph_save_memoryyoukaichao/vllm:cudagraph_save_memoryCopy head branch name to clipboard