Skip to content

fix: honor weight-check skips for quantized entries - #32809

Merged
guapisolo merged 1 commit into
sglang-miles-v0.5.16from
fix/quantized-weight-check-skip
Jul 29, 2026
Merged

fix: honor weight-check skips for quantized entries#32809
guapisolo merged 1 commit into
sglang-miles-v0.5.16from
fix/quantized-weight-check-skip

Conversation

@guapisolo

@guapisolo guapisolo commented Jul 29, 2026

Copy link
Copy Markdown
Collaborator

Summary

Restore weight-check skip semantics and per-role checksum assertions after the v0.5.16 rebase.

Symptom & Reproduction

  • Symptom: A quantized weight matched by skip_tensor_list was still compared.
  • Reproduction: test_skip_set_marks_quantized_entry_not_compared observed should_compare=True before the fix.

Root Cause

  1. _build_check_entries hard-coded True for quantized entries.
  2. test_weight_checker_e2e.py retained the pre-list parallelism_info assertion.

Fix

Use name not in skip_compare_names for quantized entries and restore the omitted CUDA and E2E assertions.

Verification

  • New test: test_skip_set_marks_quantized_entry_not_compared verifies a skipped quantized entry has should_compare=False.
  • Existing suite: test_weight_checker.py passes all 60 tests.
  • Lint: ruff passes.
  • Formatting: black and isort pass.
  • Whitespace: git diff --check passes.
  • E2E collection: The checksum E2E collects successfully.
  • E2E runtime: Server startup stops before the assertion because installed sglang-kernel==0.4.4 is below required 0.4.5.

Review Focus

  • Scrutinize _build_check_entries to confirm the raw non-persistent-buffer behavior remains unchanged.
  • Scrutinize test_e_checksum_returns_ranks_with_hashes against the current List[ParallelismInfo] wire shape.

CI States

Latest PR Test (Base): ❌ Run #30487047856
Latest PR Test (Extra): ❌ Run #30487047560

Propagate skip_compare_names through the quantized CheckEntry path so
skip_tensor_list excludes quantized weights from comparison and checksums.

Restore the matching CUDA regression and update the checksum E2E assertion
for the per-role parallelism_info wire shape.
@gemini-code-assist

Copy link
Copy Markdown
Contributor

Caution

The consumer version of Gemini Code Assist on GitHub has been sunset. All code review activity has officially ceased.

@guapisolo

Copy link
Copy Markdown
Collaborator Author

original 6f950d9#diff-4238ed068079ac033fe2371b4005d0ffca61b898e16cb8f946ea6bb3e23a0bafR322
buggy bb17e99

@guapisolo
guapisolo merged commit 5138eb2 into sglang-miles-v0.5.16 Jul 29, 2026
72 of 81 checks passed
@guapisolo
guapisolo deleted the fix/quantized-weight-check-skip branch July 29, 2026 20:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants