Skip to content

[Sampling Replay 7/8] Validate sampling-support replay end to end - #3352

Closed
nanjiangwill wants to merge 5 commits into
radixark:mainfrom
nanjiangwill:test/sampling-replay-e2e
Closed

nanjiangwill wants to merge 5 commits into
radixark:mainfrom
nanjiangwill:test/sampling-replay-e2e

Conversation

@nanjiangwill

@nanjiangwill nanjiangwill commented Sep 21, 2026 •

Copy link
Copy Markdown
Contributor

Stack position

Part 7/8 of the bounded sampling-support replay series. Merge after #3351. #3321 is merged in main.

Layer-only diff: nanjiangwill/miles@feat/sampling-replay-validation...test/sampling-replay-e2e

Review umbrella: #3354.

Summary

Add one focused 2xH200 Qwen3-0.6B E2E that exercises:

  • live SGLang TP=2 native support capture;
  • Megatron TP=2 actor support replay;
  • one GRPO training update and weight synchronization;
  • the existing CI log-probability consistency assertion;
  • metric-history tracking for train/train_rollout_logprob_abs_diff.

The recipe intentionally excludes KL, entropy, and unrelated algorithm flags so failures remain attributable to sampling-support replay.

@claude claude Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Claude Code Review

This pull request is from a fork — automated review is disabled. A repository maintainer can comment @claude review to run a one-time review.

@nanjiangwill
nanjiangwill force-pushed the test/sampling-replay-e2e branch from c09dd72 to eb53911 Compare September 21, 2026 18:59
@nanjiangwill

Copy link
Copy Markdown
Contributor Author

Closing this layer-specific review PR in favor of the single integrated sampling-replay PR #3354. The implementation and validation remain available there.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant