Skip to content

[TPU][V1] Fix exponential padding when max-num-batched-tokens is not a power of 2#16596

Merged
mgoin merged 1 commit intovllm-project:mainfrom
NickLucche:tpu-fix-exponential-padding
Apr 14, 2025
Merged

[TPU][V1] Fix exponential padding when `max-num-batched-tokens` is not a power of 2#16596
mgoin merged 1 commit intovllm-project:mainfrom
NickLucche:tpu-fix-exponential-padding

Commits

Commits on Apr 14, 2025