Add vllm serve to wrap vllm.entrypoints.openai.api_server

[simon-mo]

Easier to type. It will be now

(base) xmo@simon-devbox:~/vllm$ vllm serve --help
usage: vllm serve <model_tag> [options]

positional arguments:
  model                 The model tag to serve

options:
  -h, --help            show this help message and exit
  --host HOST           host name
  --port PORT           port number
  --uvicorn-log-level {debug,info,warning,error,critical,trace}
                        log level for uvicorn
  --allow-credentials   allow credentials
  --allowed-origins ALLOWED_ORIGINS
                        allowed origins
  --allowed-methods ALLOWED_METHODS
                        allowed methods
.....

[rkooo567]

shoudln't this be optional?

[rkooo567]

any way to add a simple regression test for this?

[rkooo567]

what's happening if vllm serve --model ?

[rkooo567]

this part of code is confusing. Add a comment to explain what this does?

[DarkLight1337]

Based on #4709, the :prog: value under CLI args (line 111) should be updated to vllm serve.

[sasha0552]

Is there any update on this? Having the command simplifies the installation of vllm to

pipx install vllm

# now you can use the command
vllm serve --help

with the wonderful pipx tool that manages virtual environments automatically. In the current state you cannot use vllm with pipx, pipx only supports exposing commands.

[DarkLight1337]

Would be nice if #4794 is also made available via CLI (perhaps vllm batch?).

[EthanqX]

Please refer to #5090 for the complete new CLI.