Skip to content

feat: expand weight loader v2 PR2 coverage - #32565

Open
JD-ETH wants to merge 1 commit into
sgl-project:mainfrom
JD-ETH:feat/weight-loader-v2-pr2-expanded
Open

JD-ETH wants to merge 1 commit into
sgl-project:mainfrom
JD-ETH:feat/weight-loader-v2-pr2-expanded

Conversation

@JD-ETH

@JD-ETH JD-ETH commented Jul 27, 2026 •

Copy link
Copy Markdown
Contributor

Motivation

Implement Weight Loader v2 PR2 from #31051.

Modifications

  • Add strict stacked/expert dispatch.
  • Migrate 69 dense, MoE, and wrapper loaders behind the v2 gate.
  • Add mapping, gate, completeness, wrapper, and equivalence coverage.

Accuracy Tests

  • 269 CPU tests passed.
  • Added five-category GPU equivalence coverage; local execution is blocked by the sgl_kernel/PyTorch ABI.

Speed Tests and Profiling

N/A; loading-only changes behind an environment gate.

Checklist

  • Formatted and linted.
  • Added unit tests.
  • Followed SGLang code style.

CI States

Latest PR Test (Base): ❌ Run #30297442315
Latest PR Test (Extra): ❌ Run #30297441379

Migrate the scoped dense, MoE, and wrapper loaders while adding strict dispatch and scalable equivalence coverage.

Co-authored-by: Cursor <cursoragent@cursor.com>
@JD-ETH
JD-ETH requested a review from b8zhong as a code owner July 27, 2026 19:15
@gemini-code-assist

Copy link
Copy Markdown
Contributor

Caution

The consumer version of Gemini Code Assist on GitHub has been sunset. All code review activity has officially ceased.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

deepseek quant LLM Quantization

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant