Skip to content

[Perf] Optimize _update_states for GPU model runner#16910

Merged
DarkLight1337 merged 2 commits intovllm-project:mainfrom
SnowCharmQ:perf-runner
Apr 22, 2025
Merged

[Perf] Optimize `_update_states` for GPU model runner#16910
DarkLight1337 merged 2 commits intovllm-project:mainfrom
SnowCharmQ:perf-runner

Commits

Commits on Apr 21, 2025

Commits on Apr 22, 2025