Skip to content

feat: add post_init to support get device_id in async vllm init#668

Merged
ZhiyuLi-Nvidia merged 1 commit intozhiyul/refit_optimizationfrom
yukih/fix-async-vllm-init
Jul 15, 2025
Merged

feat: add post_init to support get device_id in async vllm init#668
ZhiyuLi-Nvidia merged 1 commit intozhiyul/refit_optimizationfrom
yukih/fix-async-vllm-init

Commits

Commits on Jul 15, 2025