feat(mocker): model prefill→decode KV stranding + abort for disagg cascade tests - #10557

Closed

nnshah1 wants to merge 15 commits into

mainfrom

neelays/mocker-dis2147-stranding

Commits on Jun 13, 2026

feat(mocker) [DIS-2147]: prefill holds KV until decode arrives + abort timeout
nnshah1
committed
4539f2d
fix(bindings) [DIS-2147]: expose kv_transfer_abort_timeout_ms in MockEngineArgs
nnshah1
committed
ddd9c95
fix(mocker) [DIS-2147 F1]: remove decode-side capacity-wait timeout
nnshah1
committed
4478414
refactor(mocker): address review on DIS-2147 port

nnshah1
and
claude
committed
8b8794d
fix(mocker): address review comments (strip ticket refs, devin findings)

nnshah1
and
claude
committed
b874918

Commits on Jun 15, 2026

fix(mocker): genuine prefill-KV stranding via shared pinned scheduler state

nnshah1
and
claude
committed
4a44959
fix(mocker): don't let stranded prefill KV skew router load metric

nnshah1
and
claude
committed
6d16bab
docs(mocker): design spec for vLLM disagg_params KV stranding

nnshah1
and
claude
committed
290a532
feat(mocker): model vLLM disagg KV stranding via disaggregated_params

nnshah1
and
claude
committed
474ec7a
fix(mocker): monotonic transfer_id + infallible disagg_params build

nnshah1
and
claude
committed
de8f294
fix(mocker): engage vLLM disagg_params KV stranding live + fix pinned-worker busy-spin
nnshah1
committed
0cb234e
docs(mocker): spec — bootstrap-free live engagement, scheduler liveness, abort parity
nnshah1
committed
57f324d
test(router): LL frontend + vLLM mocker disagg_params KV-stranding e2e
nnshah1
committed
6c97bbb
chore(mocker): drop in-repo design spec (superpowers artifact) from the PR
nnshah1
committed
639d2f7

Commits on Jun 16, 2026

fix(mocker): release prefill pin at decode slot-admission in offline replay
nnshah1
committed
70f972d