Skip to content

Allow uneven shards for multi-GPU inference in vllm backend#494

Merged
SahilJain314 merged 2 commits intomainfrom
zhaochengz/multi-gpu_eval
Jun 27, 2025
Merged

Allow uneven shards for multi-GPU inference in vllm backend#494
SahilJain314 merged 2 commits intomainfrom
zhaochengz/multi-gpu_eval

Commits

Commits on Jun 9, 2025

Commits on Jun 26, 2025