Switch vllm_rollout endpoint /v1/completions to /inference/v1/generate - #16

Switch vllm_rollout endpoint /v1/completions to /inference/v1/generate#16

aoshen02 merged 5 commits into

mainvllm-project/vime:mainfrom

vllm-generate-endpointvllm-project/vime:vllm-generate-endpointCopy head branch name to clipboard