[PD] Keep ingesting requests while a prefill forward result is pending - #42035

[PD] Keep ingesting requests while a prefill forward result is pending#42035

merrymercy merged 2 commits into

mainsgl-project/sglang:mainfrom

oss-sync-6bc05c7211sgl-project/sglang:oss-sync-6bc05c7211Copy head branch name to clipboard