Skip to content

[Core] Reduce TTFT with concurrent partial prefills#10235

Merged
comaniac merged 71 commits into
vllm-project:mainfrom
opendatahub-io:prefill-slots
Feb 14, 2025
Merged

[Core] Reduce TTFT with concurrent partial prefills#10235
comaniac merged 71 commits into
vllm-project:mainfrom
opendatahub-io:prefill-slots

:bug: fixup renamed fn ref

dad07a8
Select commit
Loading
Failed to load commit list.
Meta CodeSync / Meta Internal-Only Changes Check succeeded Jan 15, 2026 in 0s

There is no internal Diff connected, this can be merged now