[Don't Merge][CLI] Add default generator device argument#2769

gcanlin wants to merge 1 commit into

vllm-project:release/v0.18.0.post1vllm-project/vllm-omni:release/v0.18.0.post1from

gcanlin:device-cligcanlin/vllm-omni:device-cliCopy head branch name to clipboard