fix: support canonical Nemotron 3.5 Super checkpoint - #34
Merged
TomerBN-Nvidia merged 1 commit intoAug 6, 2026
Merged
Conversation
TomerBN-Nvidia
force-pushed
the
tbn/nemotron-3.5-super-minimal-compat
branch
from
August 3, 2026 13:06
da16be6 to
a19a890
Compare
Load the canonical Nemotron 3.5 Super multimodal and MTP config, map its native RADIO checkpoint names, and preserve its dynamic-resolution preprocessing metadata. Co-authored-by: OpenAI Codex <codex@openai.com> Signed-off-by: tbarnatan <tbarnatan@nvidia.com>
TomerBN-Nvidia
force-pushed
the
tbn/nemotron-3.5-super-minimal-compat
branch
from
August 6, 2026 09:19
a19a890 to
436aefb
Compare
TomerBN-Nvidia
changed the base branch from
tbn/super-vl-bf16-btk-prep
to
super_vl_rl_v0.25.1
August 6, 2026 09:19
TomerBN-Nvidia
marked this pull request as ready for review
August 6, 2026 09:20
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Why
Enable the canonical
nvidia/NVIDIA-Nemotron-3.5-Super-120B-A12B-SourceOfTruthcheckpoint directly on the custom release branch, without editing checkpoint metadata or passing--hf-overrides.The checkpoint advertises
NemotronH_Omni_Reasoning_V3, uses a flat TransformersRadioConfig, and stores dynamic image-processing bounds inpreprocessor_config.jsonwhileprocessor_config.jsonhas no nested image processor.What changed
(1280, 32, 16, 5120)used by this checkpoint.preprocessor_config.jsonwhen Transformers returns an empty image-processor config, preserving the checkpoint's1024..13312dynamic patch bounds.language_model.mtp.*, and set the Nano Nemotron image token ID for multimodal drafting.Relationship to #33
This is the narrower replacement for #33 on the canonical release line. #33 was merged only into the older BTK preparation branch; it is not present on
super_vl_rl_v0.25.1. Its generic flat-RADIO conversion did not register the checkpoint's real architecture and did not preserve the dynamic processor bounds, so the r7 serving test required architecture and processor overrides.Rather than revert the obsolete preparation branch, this PR is rebased directly onto
super_vl_rl_v0.25.1after merged PR #37.Validation
5916941: mounted the exact pre-fix: support Nemotron 3.5 Super Omni serving and MTP #33 + this PR production tree, plus PR fix: unpack FA4 auxiliary outputs #37's FA4 fix, into r7.--hf-overridesNemotronH_Omni_Reasoning_V3directlyFLASH_ATTNVIT backend0:0, final statusPASSDuplicate-work check
No open upstream PR was found for
NemotronH_Omni_Reasoning_V3. Upstream vllm-project#39767 concerns missing legacy layer-scale tensors and is intentionally not included.AI assistance
OpenAI Codex assisted with investigation, implementation, rebasing, and validation. The human maintainer requested this comparison and replacement and must understand the changed lines before merge.