Skip to content

feat: add post_init to support get device_id in async vllm init#668

Merged
ZhiyuLi-Nvidia merged 1 commit into
zhiyul/refit_optimizationfrom
yukih/fix-async-vllm-init
Jul 15, 2025
Merged

feat: add post_init to support get device_id in async vllm init#668
ZhiyuLi-Nvidia merged 1 commit into
zhiyul/refit_optimizationfrom
yukih/fix-async-vllm-init