[model-gateway] Optimize memory usage in HTTP router#14667

slin1237 merged 1 commit intomainsgl-project/sglang:mainfrom

cpu-overhead-grpc-2sgl-project/sglang:cpu-overhead-grpc-2Copy head branch name to clipboard