[Perf] Bagel KV-ready early forwarding and time step consistency for /v1/chat/completions#2398

princepride merged 7 commits into

vllm-project:mainvllm-project/vllm-omni:mainfrom

natureofnature:bagel/kv_transfer_optnatureofnature/vllm-omni:bagel/kv_transfer_optCopy head branch name to clipboard