Implementation of simple load balance routing proxy server (#1953)#2124

wangxiyuan merged 2 commits intovllm-project:mainvllm-project/vllm-ascend:mainfrom

ganyi1996ppo:ganyi/load_balance_proxyganyi1996ppo/vllm-ascend:ganyi/load_balance_proxyCopy head branch name to clipboard