Skip to content

docs: Phase 1 test plan, run history and bare-vLLM probes - #143

Draft
luckyq wants to merge 1 commit into
doxu/phase1-6-ci-jobfrom
doxu/phase1-7-docs
Draft

luckyq wants to merge 1 commit into
doxu/phase1-6-ci-jobfrom
doxu/phase1-7-docs

Conversation

@luckyq

@luckyq luckyq commented Oct 27, 2026 •

Copy link
Copy Markdown
Collaborator

Series map (Phase 1 harness, one PR per step; each is based on the previous one)

PR Step Test cases
#137 Harness core: stack, client, telemetry, reference engine, CI unit tests; phase1 job in vllm-e2e.yml on the two-GPU runner (TC-01; #138/#139 extend --cases) TC-01 integration generation correctness
#138 Local DRAM flow and hinted peer transfer, hybrid geometry flags TC-02, TC-03
#139 Guard protection, takeover, replacement TC-04
#140 Streaming client, performance arms, Guard recovery timing TC-05, TC-06
#141 Sidecar kvcr_service, 2P+1D, two nodes, k8s / Slurm / Docker runners; phase1-2p1d CI job (2P+1D on the two-GPU runner, prefill workers share GPU 0) all cases on those topologies
#142 docs/ci.md: what the two CI lanes verify, how to run them elsewhere, how to read evidence —
#143 Test plan, run history, bare-vLLM probes —
#180 --engine sglang: dynamo.sglang + HiCache KVCR storage backend (quick-start config), SGLang telemetry mapping, deterministic mode; no Guard/disagg TC-01..03, TC-05 on SGLang

Replaces #103. All seven are drafts until the per-PR GPU runs on the current main image are done.

Problem

  • Part 7 (last) of the stacked Phase 1 series. The harness, topologies and CI job are in; the test plan that maps requirements to cases, the run history with findings, and the bare-vLLM probes behind the hybrid-model analysis have no home in the repo.

What this adds

Validation

  • Docs only; ruff on the probes.

@copy-pr-bot

copy-pr-bot Bot commented Oct 27, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@luckyq
luckyq marked this pull request as draft October 27, 2026 19:33
@luckyq
luckyq force-pushed the doxu/phase1-7-docs branch from bfd22fb to b061d34 Compare November 2, 2026 07:38
@luckyq
luckyq force-pushed the doxu/phase1-6-ci-job branch from c884e44 to f1b3652 Compare November 2, 2026 07:38
@luckyq
luckyq force-pushed the doxu/phase1-7-docs branch from b061d34 to a54cda0 Compare November 2, 2026 18:55
@luckyq
luckyq force-pushed the doxu/phase1-6-ci-job branch 2 times, most recently from 1ef84bb to d9afc04 Compare November 2, 2026 22:44
@luckyq
luckyq force-pushed the doxu/phase1-7-docs branch 2 times, most recently from 95288ce to f8c6273 Compare November 2, 2026 23:15
@luckyq
luckyq force-pushed the doxu/phase1-6-ci-job branch from d9afc04 to ee09f97 Compare November 2, 2026 23:15
@luckyq
luckyq force-pushed the doxu/phase1-7-docs branch from f8c6273 to d0ee9ba Compare November 2, 2026 23:17
@luckyq
luckyq force-pushed the doxu/phase1-6-ci-job branch 2 times, most recently from 79d7005 to c651ce5 Compare November 2, 2026 23:53
@luckyq
luckyq force-pushed the doxu/phase1-7-docs branch 2 times, most recently from 9dc92ef to 7a4064c Compare November 3, 2026 18:18
@luckyq
luckyq force-pushed the doxu/phase1-6-ci-job branch 2 times, most recently from 44985ac to 1802764 Compare November 3, 2026 19:13
@luckyq
luckyq force-pushed the doxu/phase1-7-docs branch from 7a4064c to 5a72359 Compare November 3, 2026 19:13
@luckyq
luckyq force-pushed the doxu/phase1-6-ci-job branch from 1802764 to e576f09 Compare November 3, 2026 19:45
@luckyq
luckyq force-pushed the doxu/phase1-7-docs branch 2 times, most recently from b251d31 to 9939a50 Compare November 3, 2026 19:46
@luckyq
luckyq force-pushed the doxu/phase1-6-ci-job branch 2 times, most recently from 2453f00 to b3a0c2f Compare November 3, 2026 20:22
@luckyq
luckyq force-pushed the doxu/phase1-7-docs branch 2 times, most recently from bc2f9f3 to eba47f4 Compare November 3, 2026 21:24
@luckyq
luckyq force-pushed the doxu/phase1-6-ci-job branch from b3a0c2f to dd2364c Compare November 3, 2026 21:24
Case mapping, topology, sequence, evidence layout, how to run (container,
Docker wrapper, dlcluster, K8s), known limits, the KVCR v0.1.1 execution
history (dense and hybrid, 2P+1D single and two nodes), the findings
(first Guard-served request miss, MultiConnector top-level config, decode
keeps a dead prefill's KV mapped, hybrid SSM checkpoint over-transfer), the
review-driven verdict tightening and candidate hint-dispatcher cases.
scripts/probes holds the bare vllm serve probes behind the hybrid analysis.

Part 7 of the stacked Phase 1 series.

Signed-off-by: doxu <doxu@nvidia.com>

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant