Repository navigation

Support unified memory page-envelope transfers in PD - #39477

Merged

ch-wan merged 90 commits into

mainfrom

yonghao/ump-pd-page-envelopes

Sep 19, 2026

Commits on Sep 1, 2026
- Support unified memory with speculative decoding
  
  yhzhuang
  and
  ZYHowell
  committed
  22b209a
- fix: use hybrid SWA draft flag for pool setup
  
  merrymercy
  authored and
  yhzhuang
  committed
  e887a18
- Use shared byte capacity for unified SWA pools
  
  yhzhuang
  and
  ZYHowell
  committed
  ad6c3b4
- Avoid double-rounding unified SWA demand
  
  ZYHowell
  authored and
  yhzhuang
  committed
  1aac878
- Reject unsupported unified pool scheduler modes
  yhzhuang
  committed
  7ee2c74
- Remove unified pool gate-only tests
  yhzhuang
  committed
  c54b97d
- Limit shared-capacity changes to enabled paths
  
  yhzhuang
  and
  ZYHowell
  committed
  8892c52
- Fix unified SWA eviction over-reclaim
  
  yhzhuang
  and
  ZYHowell
  committed
  48b2a24
- Remove added unified eviction planner test
  
  YhZhuang
  authored and
  yhzhuang
  committed
  139a9a1
- Remove low-signal unified capacity tests
  
  yhzhuang
  and
  ZYHowell
  committed
  9c31d3d
- Adapt shared capacity to current main
  yhzhuang
  committed
  1599357
- Address unified SWA admission feedback
  yhzhuang
  committed
  c2296be
- Support unified memory page envelopes in PD transfers
  
  yhzhuang
  and
  ZYHowell
  committed
  05cfb81
- Use decode request pool for unified SWA PD
  
  yhzhuang
  and
  ZYHowell
  committed
  c4551a5
- Reject unified Mooncake speculative transfers
  yhzhuang
  committed
  623f762
- Simplify unified draft index plumbing
  yhzhuang
  committed
  c9b4c29
- Fix unified SWA PD capacity accounting
  yhzhuang
  committed
  5a7d1ef
Commits on Sep 2, 2026
- Prefer same-side eviction for unified SWA
  ZYHowell
  committed
  08a06eb
- Merge updated shared-capacity branch into PD page envelopes
  ZYHowell
  committed
  6c46fed
- Prefer SWA tombstones before unified FULL eviction
  yhzhuang
  committed
  fe5787a
- Merge updated shared-capacity policy
  yhzhuang
  committed
  5d19c4f
- Restore upstream unified cache eviction policy
  yhzhuang
  committed
  e6e491b
- Merge restored eviction policy into PD page envelopes
  yhzhuang
  committed
  cc12f23
- Use joint capacity accounting for unified SWA
  yhzhuang
  committed
  66fed93
- Merge joint capacity accounting into PD page envelopes
  yhzhuang
  committed
  aa6d1cd
Commits on Sep 4, 2026
- Add unified capacity regression coverage
  yhzhuang
  committed
  c41b068
- Use physical SWA indices for PD transfer
  yhzhuang
  committed
  43ecd06
- Merge unified capacity fixes into PD envelopes
  yhzhuang
  committed
  6fe1e7d
- Merge remote-tracking branch 'origin/main' into yonghao/ump-shared-capacity
  yhzhuang
  committed
  d315b7d
- Merge commit 'd315b7d65e' into yonghao/ump-pd-page-envelopes
  yhzhuang
  committed
  7fadf8e
- Update PD priority test fixture for draft indices
  yhzhuang
  committed
  940d41b
- Update HiSparse test fixture for unified memory
  yhzhuang
  committed
  d01513d
- Merge commit 'd01513db8e' into yonghao/ump-pd-page-envelopes
  yhzhuang
  committed
  25d1e3b
Commits on Sep 8, 2026
- Plan unified FULL/SWA reclaim against physical capacity
  yhzhuang
  committed
  8bc1586
- Merge shared-capacity fixes into page-envelope transfers
  yhzhuang
  committed
  7f10ff8
- Restore unified pool cleanup and scoped compatibility gates
  yhzhuang
  committed
  653c010
- Merge shared-capacity cleanup into PD page envelopes
  yhzhuang
  committed
  07df3f4
Commits on Sep 10, 2026
- Merge upstream main and adapt unified capacity to allocator refactors
  yhzhuang
  committed
  f83adaf
- Merge shared capacity refresh and adapt PD envelope allocators
  yhzhuang
  committed
  b32e13e
- Keep HiSparse fixture compatible with Python 3.10
  yhzhuang
  committed
  f604efb
- Merge Python 3.10 fixture compatibility fix from shared capacity
  yhzhuang
  committed
  e09999e
- Remove unrelated UMP diff churn
  yhzhuang
  committed
  70312b5
- Merge shared-capacity cleanup into PD page envelopes
  yhzhuang
  committed
  054c220
Commits on Sep 12, 2026
- Fix unified pool admission rounding
  yhzhuang
  committed
  4e0e1c3
- Fix full-envelope PD transfers and merge capacity fixes
  yhzhuang
  committed
  69747f6
Commits on Sep 13, 2026
- Refactor unified SWA budget handling
  yhzhuang
  committed
  70671d5
- Merge shared-capacity cleanup
  yhzhuang
  committed
  66a2172
- Centralize decode SWA reservation routing
  yhzhuang
  committed
  cb88f1f
- Simplify shared SWA budget paths
  yhzhuang
  committed
  29545f8
- Merge shared SWA budget cleanup
  yhzhuang
  committed
  8d4460c
- Fix unified capturer indexing and asymmetric SWA reservation
  yhzhuang
  committed
  4d1fa0f
- Merge shared-capacity fixes and repair unified CPU copy API
  yhzhuang
  committed
  d0a10e5
- Consolidate unified allocation, admission and capacity policies
  yhzhuang
  committed
  567f4f5
- Merge capacity cleanup and cover real SWA tail allocation
  yhzhuang
  committed
  6066493
- Refactor SWA admission into allocator-owned memory budgets
  ch-wan
  committed
  6c7be62
Commits on Sep 14, 2026
- Fix unaligned unified SWA prefill admission
  yhzhuang
  committed
  4fdb2a7
- Merge unified prefill rounding fix into PD support
  yhzhuang
  committed
  5a8f410
- Refactor unified SWA allocators into sibling capacity policies
  yhzhuang
  committed
  089673a
- Clean up unified PD rejection and transfer interfaces
  yhzhuang
  committed
  121fdde
- Merge reviewed shared-capacity cleanup into PD layer
  yhzhuang
  committed
  3c9040a
- Use shared byte capacity for unified SWA pools
  
  yhzhuang
  authored and
  ch-wan
  committed
  564845d
- Keep HiSparse fixture compatible with Python 3.10
  
  yhzhuang
  authored and
  ch-wan
  committed
  a7084b3
- Remove unrelated UMP diff churn
  
  yhzhuang
  authored and
  ch-wan
  committed
  b505c11
- Fix unified pool admission rounding
  
  yhzhuang
  authored and
  ch-wan
  committed
  99ee780
- Refactor unified SWA budget handling
  
  yhzhuang
  authored and
  ch-wan
  committed
  8fd4aa4
- Simplify shared SWA budget paths
  
  yhzhuang
  authored and
  ch-wan
  committed
  fa6c95a
- Fix unified capturer indexing and asymmetric SWA reservation
  
  yhzhuang
  authored and
  ch-wan
  committed
  d9c7447
- Consolidate unified allocation, admission and capacity policies
  
  yhzhuang
  authored and
  ch-wan
  committed
  6cf450c
- Refactor SWA admission into allocator-owned memory budgets
  ch-wan
  committed
  0a80658
- Fix unaligned unified SWA prefill admission
  
  yhzhuang
  authored and
  ch-wan
  committed
  1f3b496
- Refactor unified SWA allocators into sibling capacity policies
  
  yhzhuang
  authored and
  ch-wan
  committed
  f208606
- Fix shared prefill deferral and capture and draft capacity bounds
  ch-wan
  committed
  f0a0085
- Validate inherited unified allocator PD and free-group contracts
  ch-wan
  committed
  ab2ea29
- Merge updated shared-capacity branch into UMP PD support
  yhzhuang
  committed
  e3fa99e
- Explain SWA prefill reservation and chunking safety
  yhzhuang
  committed
  ab7d973
- Merge shared-capacity updates and simplify PD reservation checks
  yhzhuang
  committed
  ea634ec
- Refresh shared KV budgets during decode admission
  yhzhuang
  committed
  81d00a3
- Port profiled SWA byte-budget fix from #36729
  yhzhuang
  committed
  405e92b
Commits on Sep 15, 2026
- Merge latest main after shared-capacity PR landed
  ZYHowell
  committed
  1c2fe92
- Sync main through b803cfa0c4
  ZYHowell
  committed
  ba4a021
Commits on Sep 16, 2026
- Share precise SWA tail allocation across unified layouts
  ZYHowell
  committed
  f7e5443
- Merge main b02e16a895 and retain both PD transfer test groups
  ZYHowell
  committed
  e514294
Commits on Sep 18, 2026
- Let the pool price a decode-node preallocation
  
  ch-wan
  and
  claude
  committed
  8431803
- Price tri-pool preallocation on the shared grid, and fix mamba retraction
  
  ch-wan
  and
  claude
  committed
  4e50b49
- Pin the pair that actually double-counts, and trim the docstring
  
  ch-wan
  and
  claude
  committed
  7c60449
- Cover the hybrid-Mamba retraction path that shipped untested
  
  ch-wan
  and
  claude
  committed
  b167da6
- Merge main 1fdd6c8921
  
  ch-wan
  and
  claude
  committed
  7200139
- Move the SWA tail allocation test under the kernels taxonomy
  
  ch-wan
  and
  claude
  committed
  1f25db5
- Merge latest main into unified memory PD branch
  ZYHowell
  committed
  8cf543e
- Fix HiSparse capacity test setup for unified PD admission
  ZYHowell
  committed
  8233419

Commits

Commits on Sep 1, 2026

Commits on Sep 2, 2026

Commits on Sep 4, 2026

Commits on Sep 8, 2026

Commits on Sep 10, 2026

Commits on Sep 12, 2026

Commits on Sep 13, 2026

Commits on Sep 14, 2026

Commits on Sep 15, 2026

Commits on Sep 16, 2026

Commits on Sep 18, 2026