docs(blog): add Dynamo shadow engine failover post - #13124
Draft
mohammedabdulwahhab wants to merge 2 commits into
Draft
docs(blog): add Dynamo shadow engine failover post#13124mohammedabdulwahhab wants to merge 2 commits into
mohammedabdulwahhab wants to merge 2 commits into
Conversation
Rebuild the Dynamo Bulwark blog post on the current Fern blog layout (docs/fern/pages/blog/2026 + _assets, MDX, BlogStyles/BlogArticleMeta) and replace the placeholder benchmark section with the measured Kimi-K2.6 NVFP4 three-node cascade result. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com> Signed-off-by: furkhan324@berkeley.edu <furkhan324@berkeley.edu>
|
Rename throughout from "Dynamo Bulwark" to Shadow Engine Failover, retitle, and add Vikram and Maksim to the byline. Lead the intro with zero-copy weight sharing through GMS, add a GMS overview diagram and the intuition for why a GMS-backed weight read costs no more than an engine-allocated one, and note that KV cache under GMS is active work rather than shipped behaviour. Drop the scratch-aliased KV section as too confusing, explain the 17 failed requests as the cutover window, quantify a parked shadow at ~6.2 GB per GPU, remove the two results rows whose near-ties read as a baseline win, and add the DRA prerequisite to the caveats. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com> Signed-off-by: furkhan324@berkeley.edu <furkhan324@berkeley.edu>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Revives #9381 (closed; its branch was deleted from origin). The old post sat at
docs/digest/dynamo-bulwark/dynamo-bulwark.md, a tree that no longer exists — #12373 movedblog content to
docs/fern/pages/blog/. Rather than rebase, this rebuilds the post on thecurrent Fern blog convention, replaces its placeholder benchmark section with a real
measurement, and applies a round of editorial review.
Structure — follows
docs/fern/pages/blog/README.md: MDX underpages/blog/2026/,figures under
_assets/bulwark/,<BlogStyles/>+<BlogArticleMeta/>, no body H1,<Frame>+<Info className="fig-caption">figures, plus the nav entry, landing-page cardand sidebar date label.
Benchmarks — the previous section carried projected TRT-LLM numbers on Qwen3-235B with an
"illustrative, will be replaced before publication" warning. Replaced with a measured
Kimi-K2.6 NVFP4 three-node cascade (3× B200, TP=8, code-agent trace at 100k/1k, concurrency 24;
three engine kills 60 s apart after steady state):
The harness emits light-canvas Matplotlib;
_assets/bulwark/tools/darkify.pyinverts lightnessin HLS while preserving hue and saturation so the charts sit on the site's dark canvas. No data
point, axis, or label is altered, only pixel colour.
Editorial review (second commit) — renamed throughout from "Dynamo Bulwark" to
Shadow Engine Failover, since "Bulwark" appears nowhere in
mainand the shipped featurehas a name. The pod-level unit is now "failover worker" rather than a coined product noun.
Also:
question is answered before it forms.
gms-overview.svgdiagram: two engines, own contexts, one physical copy in HBM, GMSoff the access path. Fills a
TODOplaceholder the original PR never produced.one: mapping is one-time at startup and GMS is absent at read time.
it left behind.
2,304 words, down from 2,766.
Validation
fern check --local --warnings→ 0 errors; 11 warnings, all pre-existing onmain.check_asset_paths.py,check_style_components.py,check_component_imports.py→ pass.@mdx-js/mdx; the blog components esbuild-parse.fern docs dev.Known issue for reviewers
The two request-outcome charts have mismatched y-axes (baseline 0–200, shadow failover 0–35),
which makes them hard to compare by eye. Fixing it needs a re-plot from the benchmark harness;
the per-bin counts are not recoverable from the committed images (a reconstruction attempt
missed the known category totals by 3–75% depending on method, so it was rejected rather than
shipped). Options are to regenerate on a shared axis, substitute the
cumulative_successespair from the same run, or drop the pair. Until then the caption states the axis difference
explicitly.
Open questions
benchmarks/kimi-cascade-failover/lives on a separate branch, so ablob/main/...link would 404. The post is self-contained for now.Primary on the NVIDIA Tech Blog with the GitHub Digest carrying a short link-out. Filed here
as the working draft; if it goes to the Tech Blog, this PR should shrink to a blurb.
Draft while the post is out for editorial review.