Repository navigation

dsv4.1: RoPE and FP4 packing kernels - #39656

Merged

hnyls2002 merged 39 commits into

mainfrom

dsv4.1-rope-fp4

Sep 16, 2026

Commits on Sep 16, 2026
- dsv4.1: extract Top-k kernels and candidate helpers
  hnyls2002
  committed
  bdaf2e2
- dsv4.1: skip unwritten Top-k plans in metadata comparisons
  hnyls2002
  committed
  9b17c0d
- fix dsv4 top-k edge cases and trim tests
  
  BBuf
  authored and
  hnyls2002
  committed
  f51894f
- dsv4.1: extract communication kernels and wrappers
  hnyls2002
  committed
  ed1c649
- dsv4.1: extract vocab gather and sharded greedy selection
  hnyls2002
  committed
  5873fba
- fix sharded greedy test suite
  hnyls2002
  committed
  8c02375
- clarify sharded greedy docstring; split test cases; fix stale usage path
  hnyls2002
  committed
  b297ac2
- fix communication guards and cover ragged collectives
  
  BBuf
  authored and
  hnyls2002
  committed
  d3d9a85
- remove standalone nvlink communication test
  
  BBuf
  authored and
  hnyls2002
  committed
  5a8166b
- dsv4.1: extract compression and metadata kernels
  hnyls2002
  committed
  3c5130f
- dsv4.1: extract KV store and dequantization paths
  hnyls2002
  committed
  b14c741
- dsv4.1: preserve 64K prefill planner indices and reject sentinel collisions
  hnyls2002
  committed
  a0ae65a
- fix c2 padding and trim metadata tests
  
  BBuf
  authored and
  hnyls2002
  committed
  e36a479
- dsv4.1: restore C2 padding test entry point
  hnyls2002
  committed
  1b94c71
- remove standalone dsv4 metadata tests
  
  BBuf
  authored and
  hnyls2002
  committed
  ed29816
- dsv4.1: extract candidate indexer library
  hnyls2002
  committed
  1333f2a
- dsv4.1: extract RoPE and FP4 packing kernels
  hnyls2002
  committed
  dee8e7d
- merge main; drop stale topk lineage
  hnyls2002
  committed
  cde9da0
- merge dsv4.1-communication
  hnyls2002
  committed
  313f98d
- merge dsv4.1-metadata
  hnyls2002
  committed
  0eb0eb8
- merge dsv4.1-candidate
  hnyls2002
  committed
  cc33d85
- remove standalone sparse indexer test
  BBuf
  committed
  0a66478
- Merge dsv4.1-candidate test cleanup into rope stack
  BBuf
  committed
  8295eb6
- remove standalone compressed KV quant test
  BBuf
  committed
  294d3e8
- merge main
  hnyls2002
  committed
  be34bc2
- merge metadata
  hnyls2002
  committed
  02076c3
- merge candidate
  hnyls2002
  committed
  f8979c3
- drop norm-only c2 entry and aliases; move small metadata into dsv4; name low-ratio metadata fields
  hnyls2002
  committed
  56efc4a
- drop unused fp4 torch reference quantizer
  hnyls2002
  committed
  c888f9e
- c2: drop the dead duplicate freqs_cis load
  
  BBuf
  and
  claude
  committed
  f33acae
- merge c1/c2 wrappers; split small metadata into its homes; move torch_quant next to the kernels; align compress kernel names
  hnyls2002
  committed
  8af4e43
- merge metadata
  hnyls2002
  committed
  b32b53d
- merge candidate
  hnyls2002
  committed
  68ce340
- merge main
  hnyls2002
  committed
  fe06b61
- merge candidate
  hnyls2002
  committed
  90723f1
- merge main
  hnyls2002
  committed
  b1be221
- drop unused index_q_rope_pack and INDEX_PAGE_SIZE
  hnyls2002
  committed
  577043c
- fp4 rope kernels: align names with main; fold pack kernel into fp4_indexer; share slot and floor constants
  hnyls2002
  committed
  3e5b0bd
- trim comments
  hnyls2002
  committed
  4bfcadf

Commits

Commits on Sep 16, 2026