[Feature]async scheduling to overlap chunk IO and compute#951

hsliuustc0106 merged 2 commits into

vllm-project:mainvllm-project/vllm-omni:mainfrom

Shirley125:async_scheduleShirley125/vllm-omni:async_scheduleCopy head branch name to clipboard