[Spec V2] Migrate V2 path to EagleDraftExtendInput; verify returns EagleVerifyOutput#24860

Open

hnyls2002 wants to merge 22 commits into

mainfrom

lsyin/spec-pr2

Commits on May 9, 2026

introduce EagleDraftExtendInput; split phase from EagleDraftInput
hnyls2002
committed
rename extend_input -> draft_extend_input
hnyls2002
committed
add isinstance asserts at draft_extend_input phase boundaries
hnyls2002
committed
move draft_extend_input install out of verify() into forward_draft_extend_after_decode
hnyls2002
committed
move spec_info phase install to executor (forward_batch_generation)
hnyls2002
committed
V1: forward_draft_extend_after_decode returns next_draft_input; executor installs
hnyls2002
committed
drop unused model_worker_batch from verify() return
hnyls2002
committed
drop redundant spec_info.positions = None
hnyls2002
committed
drop stale draft_extend shape note on EagleDraftInput.hidden_states
hnyls2002
committed
move generate_attn_arg_prefill to EagleDraftExtendInput; tighten select_last_verified_seed
hnyls2002
committed
drop redundant spec_info args; read spec_info from batch
hnyls2002
committed
move verify->extend handoff fields onto EagleDraftExtendInput
hnyls2002
committed
forward_batch_info: getattr-guard num_accepted_drafts on draft-phase spec_info
hnyls2002
committed
forward_batch_info: getattr-guard topk_p/topk_index on draft-extend spec_info
hnyls2002
committed
v1: install empty EagleDraftInput when extend skipped (retract edge case)
hnyls2002
committed
restore num_accepted_drafts/tokens on EagleDraftInput for V2
hnyls2002
committed
v2: install EagleDraftExtendInput as draft-extend spec_info
hnyls2002
committed
v2 sample returns EagleVerifyOutput; thread draft_extend_input via batch_result
hnyls2002
committed
fold can_run_cuda_graph into EagleVerifyOutput; verify returns single object
hnyls2002
committed
drop GenerationBatchResult.next_draft_extend_input; v2 verify returns (batch_result, verify_output)
hnyls2002
committed
group spec_info fields by common / v2 / v1 sections
hnyls2002
committed

Commits on May 12, 2026

merge main
hnyls2002
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Spec V2] Migrate V2 path to EagleDraftExtendInput; verify returns EagleVerifyOutput#24860

[Spec V2] Migrate V2 path to EagleDraftExtendInput; verify returns EagleVerifyOutput#24860
hnyls2002 wants to merge 22 commits into
mainfrom
lsyin/spec-pr2

Commits on May 9, 2026

introduce EagleDraftExtendInput; split phase from EagleDraftInput

rename extend_input -> draft_extend_input

add isinstance asserts at draft_extend_input phase boundaries

move draft_extend_input install out of verify() into forward_draft_extend_after_decode

move spec_info phase install to executor (forward_batch_generation)

V1: forward_draft_extend_after_decode returns next_draft_input; executor installs

drop unused model_worker_batch from verify() return

drop redundant spec_info.positions = None

drop stale draft_extend shape note on EagleDraftInput.hidden_states

move generate_attn_arg_prefill to EagleDraftExtendInput; tighten select_last_verified_seed

drop redundant spec_info args; read spec_info from batch

move verify->extend handoff fields onto EagleDraftExtendInput

forward_batch_info: getattr-guard num_accepted_drafts on draft-phase spec_info

forward_batch_info: getattr-guard topk_p/topk_index on draft-extend spec_info

v1: install empty EagleDraftInput when extend skipped (retract edge case)

restore num_accepted_drafts/tokens on EagleDraftInput for V2

v2: install EagleDraftExtendInput as draft-extend spec_info

v2 sample returns EagleVerifyOutput; thread draft_extend_input via batch_result

fold can_run_cuda_graph into EagleVerifyOutput; verify returns single object

drop GenerationBatchResult.next_draft_extend_input; v2 verify returns (batch_result, verify_output)

group spec_info fields by common / v2 / v1 sections

Commits on May 12, 2026

merge main