Repository navigation
Conversation
luckyq
marked this pull request as draft
October 27, 2026 19:33
This was referenced Oct 27, 2026
luckyq
force-pushed
the
doxu/phase1-7-docs
branch
from
November 2, 2026 07:38
bfd22fb to
b061d34
Compare
luckyq
force-pushed
the
doxu/phase1-6-ci-job
branch
from
November 2, 2026 07:38
c884e44 to
f1b3652
Compare
luckyq
force-pushed
the
doxu/phase1-7-docs
branch
from
November 2, 2026 18:55
b061d34 to
a54cda0
Compare
luckyq
force-pushed
the
doxu/phase1-6-ci-job
branch
2 times, most recently
from
November 2, 2026 22:44
1ef84bb to
d9afc04
Compare
luckyq
force-pushed
the
doxu/phase1-7-docs
branch
2 times, most recently
from
November 2, 2026 23:15
95288ce to
f8c6273
Compare
luckyq
force-pushed
the
doxu/phase1-6-ci-job
branch
from
November 2, 2026 23:15
d9afc04 to
ee09f97
Compare
luckyq
force-pushed
the
doxu/phase1-7-docs
branch
from
November 2, 2026 23:17
f8c6273 to
d0ee9ba
Compare
luckyq
force-pushed
the
doxu/phase1-6-ci-job
branch
2 times, most recently
from
November 2, 2026 23:53
79d7005 to
c651ce5
Compare
luckyq
force-pushed
the
doxu/phase1-7-docs
branch
2 times, most recently
from
November 3, 2026 18:18
9dc92ef to
7a4064c
Compare
luckyq
force-pushed
the
doxu/phase1-6-ci-job
branch
2 times, most recently
from
November 3, 2026 19:13
44985ac to
1802764
Compare
luckyq
force-pushed
the
doxu/phase1-7-docs
branch
from
November 3, 2026 19:13
7a4064c to
5a72359
Compare
luckyq
force-pushed
the
doxu/phase1-6-ci-job
branch
from
November 3, 2026 19:45
1802764 to
e576f09
Compare
luckyq
force-pushed
the
doxu/phase1-7-docs
branch
2 times, most recently
from
November 3, 2026 19:46
b251d31 to
9939a50
Compare
luckyq
force-pushed
the
doxu/phase1-6-ci-job
branch
2 times, most recently
from
November 3, 2026 20:22
2453f00 to
b3a0c2f
Compare
luckyq
force-pushed
the
doxu/phase1-7-docs
branch
2 times, most recently
from
November 3, 2026 21:24
bc2f9f3 to
eba47f4
Compare
luckyq
force-pushed
the
doxu/phase1-6-ci-job
branch
from
November 3, 2026 21:24
b3a0c2f to
dd2364c
Compare
Case mapping, topology, sequence, evidence layout, how to run (container, Docker wrapper, dlcluster, K8s), known limits, the KVCR v0.1.1 execution history (dense and hybrid, 2P+1D single and two nodes), the findings (first Guard-served request miss, MultiConnector top-level config, decode keeps a dead prefill's KV mapped, hybrid SSM checkpoint over-transfer), the review-driven verdict tightening and candidate hint-dispatcher cases. scripts/probes holds the bare vllm serve probes behind the hybrid analysis. Part 7 of the stacked Phase 1 series. Signed-off-by: doxu <doxu@nvidia.com>
luckyq
force-pushed
the
doxu/phase1-6-ci-job
branch
from
November 4, 2026 01:14
dd2364c to
8feab26
Compare
luckyq
force-pushed
the
doxu/phase1-7-docs
branch
from
November 4, 2026 01:14
eba47f4 to
0095cbc
Compare
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Series map (Phase 1 harness, one PR per step; each is based on the previous one)
phase1job invllm-e2e.ymlon the two-GPU runner (TC-01; #138/#139 extend--cases)kvcr_service, 2P+1D, two nodes, k8s / Slurm / Docker runners;phase1-2p1dCI job (2P+1D on the two-GPU runner, prefill workers share GPU 0)docs/ci.md: what the two CI lanes verify, how to run them elsewhere, how to read evidence--engine sglang: dynamo.sglang + HiCache KVCR storage backend (quick-start config), SGLang telemetry mapping, deterministic mode; no Guard/disaggReplaces #103. All seven are drafts until the per-PR GPU runs on the current main image are done.
Problem
What this adds
docs/test-plan-phase1.md: case mapping (TC-01..06 → requirements and checks), topology and configuration, sequence, evidence layout, how to run (container, Docker wrapper, dlcluster, K8s), known limits, execution history on KVCR v0.1.1 (dense and hybrid, 2P+1D single and two nodes), findings (First peer transfer after Guard promotion or worker replacement is refused (missing target agent metadata) #51, MultiConnector top-level config, decode keeps a dead prefill's KV mapped, hybrid SSM checkpoint over-transfer), the review-driven verdict tightening, and candidate cases for the hint dispatcher (Add a KV hint dispatcher for multi-hint envelopes #118).scripts/probes/: three barevllm serveprobes that established the engine facts the hybrid verdicts rely on (one SSM checkpoint per request; junction checkpoint on the first fork; offload events per KV cache group before/after [KV Offload] Emit self-describing events for recurrent state groups vllm-project/vllm#62613).Validation
ruffon the probes.