Skip to content

Context / Sequence Parallel 4/5: split long prefills over position-stored KV (all-gather and ring) - #1141

Open
dghosef wants to merge 44 commits into
sp/1-strategiesfrom
sp/2-pcp
Open

Context / Sequence Parallel 4/5: split long prefills over position-stored KV (all-gather and ring)#1141
dghosef wants to merge 44 commits into
sp/1-strategiesfrom
sp/2-pcp

Merge sp/1-strategies (h2d numpy staging, flashinfer stub spec) into …

cf33656
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar