Skip to content

[CI] Fix Nemotron nightly mixed precision checkpoints test - #27284

Merged
Fridge003 merged 2 commits into
mainfrom
brayden/fix-nemotron-nightly
Jun 5, 2026
Merged

[CI] Fix Nemotron nightly mixed precision checkpoints test#27284
Fridge003 merged 2 commits into
mainfrom
brayden/fix-nemotron-nightly

Conversation

@b8zhong

@b8zhong b8zhong commented Jun 4, 2026

Copy link
Copy Markdown
Collaborator

It's broken by #18005, which will break when the quantization is mixed precision (so all Nemotron NVFP4 checkpoints are not working). Also, I think this code should be moved to quark quantization only, and it's only a log.


CI States

Latest PR Test (Base): ❌ Run #26980331986
Latest PR Test (Extra): ❌ Run #26980331868

@b8zhong

b8zhong commented Jun 4, 2026

Copy link
Copy Markdown
Collaborator Author

/rerun-test test_nvidia_nemotron_3_super_nvfp4.py test_nvidia_nemotron_3_super_nightly.py

@b8zhong b8zhong changed the title [CI] Fix Nemotron mixed precision checkpoints test [CI] Fix Nemotron nightly mixed precision checkpoints test Jun 4, 2026
@gemini-code-assist

Copy link
Copy Markdown
Contributor

Warning

You have reached your daily quota limit. Please wait up to 24 hours and I will start processing your requests again!

@github-actions

github-actions Bot commented Jun 4, 2026

Copy link
Copy Markdown
Contributor

Results for /rerun-test test_nvidia_nemotron_3_super_nvfp4.py test_nvidia_nemotron_3_super_nightly.py:

🚀 4-gpu-b200 (1 test): ✅ View workflow run

cd test/ && python3 registered/4-gpu-models/test_nvidia_nemotron_3_super_nvfp4.py

🚀 8-gpu-h200 (1 test): ✅ View workflow run

cd test/ && python3 registered/8-gpu-models/test_nvidia_nemotron_3_super_nightly.py

@b8zhong b8zhong mentioned this pull request Jun 4, 2026
33 tasks
@Fridge003

Copy link
Copy Markdown
Collaborator

@b8zhong Looks like this logic was added by AMD in this commit 293816a#diff-65c6ac2c41977f68e460f18e35053b97089631f88a9958b0796343fccee78a67.

We need to check with them whether removing them is OK

@b8zhong

b8zhong commented Jun 4, 2026

Copy link
Copy Markdown
Collaborator Author

/rerun-test test_nvidia_nemotron_3_super_nvfp4.py test_nvidia_nemotron_3_super_nightly.py

@b8zhong

b8zhong commented Jun 4, 2026

Copy link
Copy Markdown
Collaborator Author

@Fridge003 Yeah, let me make the fix more defensive

@github-actions

github-actions Bot commented Jun 4, 2026

Copy link
Copy Markdown
Contributor

Results for /rerun-test test_nvidia_nemotron_3_super_nvfp4.py test_nvidia_nemotron_3_super_nightly.py:

🚀 4-gpu-b200 (1 test): ✅ View workflow run

cd test/ && python3 registered/4-gpu-models/test_nvidia_nemotron_3_super_nvfp4.py

🚀 8-gpu-h200 (1 test): ✅ View workflow run

cd test/ && python3 registered/8-gpu-models/test_nvidia_nemotron_3_super_nightly.py

@Fridge003
Fridge003 merged commit d381ec7 into main Jun 5, 2026
93 of 105 checks passed
@Fridge003
Fridge003 deleted the brayden/fix-nemotron-nightly branch June 5, 2026 20:51
Chronostasys pushed a commit to MindLab-Research/sglang that referenced this pull request Aug 24, 2026
…ct#27284)

Co-authored-by: Brayden Zhong <brayden.zhong@radixark.ai>
jakki-amd pushed a commit to jakki-amd/sglang that referenced this pull request Sep 9, 2026
…ct#27284)

Co-authored-by: Brayden Zhong <brayden.zhong@radixark.ai>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants