Optimize online C128 state pool allocation using request state pool - #603

Optimize online C128 state pool allocation using request state pool#603

zhangxiaolei123456 merged 3 commits into

sync-pr-601-to-mainbytedance-iaas/sglang:sync-pr-601-to-mainfrom

sync-pr-601-c128-request-statebytedance-iaas/sglang:sync-pr-601-c128-request-stateCopy head branch name to clipboard