Skip to content

[Fix] Drop the duplicated DSpark draft sample_block call - #36934

Merged
hnyls2002 merged 1 commit into
mainfrom
lsyin/fix-dspark-double-sample-block
Aug 29, 2026
Merged

hnyls2002 merged 1 commit into
mainfrom
lsyin/fix-dspark-double-sample-block

Conversation

@hnyls2002

@hnyls2002 hnyls2002 commented Aug 29, 2026

Copy link
Copy Markdown
Collaborator

DsparkDraftSampler.__call__ runs sample_block twice: the call added inside the if draft_tokens is None: block (#33561) plus the original trailing one, which overwrites it. self.out came from the second call and self.corrected_out from the first, so the emitted draft tokens and the corrected logits were drawn from two separate passes.

Note this activates the fused greedy fast path, whose result was previously computed and then discarded.


CI States

Latest PR Test (Base): 🚫 Run #33223878538
Latest PR Test (Extra): ❌ Run #33223878487
Latest PR Test (AMD ROCm 7.2): 🚫 Run #33223878558

@hnyls2002

Copy link
Copy Markdown
Collaborator Author

/rerun-test registered/core/test_basic_sanity_dspark.py registered/spec/dspark/test_dspark_kernel_parity.py registered/spec/dspark/test_dspark_stacked_ctx_kv_parity.py

@github-actions

github-actions Bot commented Aug 29, 2026

Copy link
Copy Markdown
Contributor

Results for /rerun-test registered/core/test_basic_sanity_dspark.py registered/spec/dspark/test_dspark_kernel_parity.py registered/spec/dspark/test_dspark_stacked_ctx_kv_parity.py:

🚀 1-gpu-h100 (1 test): ✅ View workflow run

cd test/ && python3 registered/core/test_basic_sanity_dspark.py

🚀 1-gpu-5090 (2 tests): ✅ View workflow run

cd test/ && python3 registered/spec/dspark/test_dspark_kernel_parity.py
cd test/ && python3 registered/spec/dspark/test_dspark_stacked_ctx_kv_parity.py

@hnyls2002

Copy link
Copy Markdown
Collaborator Author

/tag-and-rerun-ci

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant