Skip to content

Skip missing expert bias updates - #55

Merged
yueming-yuan merged 1 commit into
miles-mainfrom
yueming/skip-missing-expert-bias-update
Jun 8, 2026
Merged

Skip missing expert bias updates#55
yueming-yuan merged 1 commit into
miles-mainfrom
yueming/skip-missing-expert-bias-update

Conversation

@yueming-yuan

Copy link
Copy Markdown

Summary

  • Skip router expert-bias updates for modules whose expert_bias is absent or None
  • Assert local_tokens_per_expert exists for modules that participate in expert-bias updates

Validation

  • Covered by the DeepSeek V4 16-node disaggregate debug run that reached step 1 with this change in place
  • No local test suite run for this single-file Megatron change

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant