Skip to content

Allow uneven shards for multi-GPU inference in vllm backend#494

Merged
SahilJain314 merged 2 commits into
mainfrom
zhaochengz/multi-gpu_eval
Jun 27, 2025
Merged

Allow uneven shards for multi-GPU inference in vllm backend#494
SahilJain314 merged 2 commits into
mainfrom
zhaochengz/multi-gpu_eval