Repository navigation
blog: Understanding PR #6162 — SVDQuant W4A4 for MiniMax-H3 on Blackwell - #20
Merged
Merged
Conversation
Design-explainer post for draft PR #6162 (not merged): how SVDQuant's rank-32 BF16 residual makes W4A4 viable for the H3 FL2VA DiT, the canonical-layout + hardware-dispatch design, and the author-reported B300 numbers (1.265x E2E, -34.25% peak memory), all labeled as PR evidence pending independent cookbook runs. - figures captured from the interactive explainer, which ships as docs/visualizations/pr-6162-svdquant-explainer.html (linked in post) - remove the rendered-template dummy post (first real post has landed) - verified: JEKYLL_NO_BUNDLER_REQUIRE=1 jekyll build clean; post renders with all 3 figures and 2 tables on the served site
This was referenced Aug 16, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What
First PR-analysis post for the SVDQuant W4A4 draft PR (vllm-omni#6162, not merged — written as a design explainer per the proposal variant of the blog-post skill):
blog/_posts/2026-08-16-understanding-pr-6162-svdquant-w4a4-blackwell.md— TL;DR (proposal status + headline author-reported B300 numbers) → background (W4A4 outlier problem) → design (smooth + SVD absorption, canonical layout, fail-fast dispatch, feature-detected fusion, precision tiering incl. compact AdaLN) → key changes → measured impact (author-reported only, cookbook gap stated) → how to use → limitations incl. open review threads → references.docs/visualizations/pr-6162-svdquant-explainer.htmland is linked from the post.Verification
JEKYLL_NO_BUNDLER_REQUIRE=1 jekyll buildclean (remote theme fetched, GFM admonitions injected).Notes
8f15b357, MiniMax-H3-only, +4340/−41, 21 files); the post is written against the current state and binds all numbers to PR-body evidence.