Repository navigation

Fix unified HiCache physical transfers - #39479

Merged

merrymercy merged 173 commits into

mainfrom

yonghao/ump-hicache-physical-transfers

Oct 4, 2026

Commits on Sep 1, 2026
- Support unified memory with speculative decoding
  
  yhzhuang
  and
  ZYHowell
  committed
  22b209a
- fix: use hybrid SWA draft flag for pool setup
  
  merrymercy
  authored and
  yhzhuang
  committed
  e887a18
- Use shared byte capacity for unified SWA pools
  
  yhzhuang
  and
  ZYHowell
  committed
  ad6c3b4
- Avoid double-rounding unified SWA demand
  
  ZYHowell
  authored and
  yhzhuang
  committed
  1aac878
- Reject unsupported unified pool scheduler modes
  yhzhuang
  committed
  7ee2c74
- Remove unified pool gate-only tests
  yhzhuang
  committed
  c54b97d
- Limit shared-capacity changes to enabled paths
  
  yhzhuang
  and
  ZYHowell
  committed
  8892c52
- Fix unified SWA eviction over-reclaim
  
  yhzhuang
  and
  ZYHowell
  committed
  48b2a24
- Remove added unified eviction planner test
  
  YhZhuang
  authored and
  yhzhuang
  committed
  139a9a1
- Remove low-signal unified capacity tests
  
  yhzhuang
  and
  ZYHowell
  committed
  9c31d3d
- Adapt shared capacity to current main
  yhzhuang
  committed
  1599357
- Address unified SWA admission feedback
  yhzhuang
  committed
  c2296be
- Support unified memory page envelopes in PD transfers
  
  yhzhuang
  and
  ZYHowell
  committed
  05cfb81
- Use decode request pool for unified SWA PD
  
  yhzhuang
  and
  ZYHowell
  committed
  c4551a5
- Reject unified Mooncake speculative transfers
  yhzhuang
  committed
  623f762
- Simplify unified draft index plumbing
  yhzhuang
  committed
  c9b4c29
- Fix unified SWA PD capacity accounting
  yhzhuang
  committed
  5a7d1ef
- Support unified memory decode host pools
  
  yhzhuang
  and
  ZYHowell
  committed
  d5e5e7a
- Fix unified draft retraction indices
  yhzhuang
  committed
  705f648
- Simplify unified decode host allocation
  
  yhzhuang
  and
  ZYHowell
  committed
  f37d710
Commits on Sep 2, 2026
- Gate unsupported unified hybrid host transfers
  yhzhuang
  committed
  1b75db1
- Fix unified HiCache physical transfers
  yhzhuang
  committed
  f806ad5
- Prefer same-side eviction for unified SWA
  ZYHowell
  committed
  08a06eb
- Merge updated shared-capacity branch into PD page envelopes
  ZYHowell
  committed
  6c46fed
- Merge updated PD page-envelope branch into decode host pool
  ZYHowell
  authored
  28962eb
- Prefer SWA tombstones before unified FULL eviction
  yhzhuang
  committed
  fe5787a
- Merge updated shared-capacity policy
  yhzhuang
  committed
  5d19c4f
- Merge updated UMP PD stack into host pool
  yhzhuang
  committed
  bdb7287
- Restore upstream unified cache eviction policy
  yhzhuang
  committed
  e6e491b
- Merge restored eviction policy into PD page envelopes
  yhzhuang
  committed
  cc12f23
- Merge restored eviction policy into decode host pool
  yhzhuang
  committed
  45b4663
- Use joint capacity accounting for unified SWA
  yhzhuang
  committed
  66fed93
- Merge joint capacity accounting into PD page envelopes
  yhzhuang
  committed
  aa6d1cd
- Merge joint capacity accounting into decode host pool
  yhzhuang
  committed
  43ebdb4
- Merge latest unified host-pool stack
  yhzhuang
  committed
  329fb0c
Commits on Sep 4, 2026
- Refactor unified host pool allocation
  
  yhzhuang
  and
  ZYHowell
  committed
  db64894
- Support unified HiCache buffer staging
  
  yhzhuang
  and
  ZYHowell
  committed
  f16293b
- Merge compacting unified host pool
  yhzhuang
  committed
  54d3892
- Reject unsafe unified decode host paths
  yhzhuang
  committed
  d3e06da
- Enable shared unified HiCache staging safely
  yhzhuang
  committed
  136669c
- Merge unified decode host safety gates
  yhzhuang
  committed
  63abe66
- Guard unified HiCache compatibility
  yhzhuang
  committed
  f0af6be
- Add unified capacity regression coverage
  yhzhuang
  committed
  c41b068
- Use physical SWA indices for PD transfer
  yhzhuang
  committed
  43ecd06
- Merge unified capacity fixes into PD envelopes
  yhzhuang
  committed
  6fe1e7d
- Merge transfer-index fixes into decode host pool
  yhzhuang
  committed
  3ef84f1
- Merge review fixes into HiCache transfers
  yhzhuang
  committed
  1f8c4fe
- Merge remote-tracking branch 'origin/main' into yonghao/ump-shared-capacity
  yhzhuang
  committed
  d315b7d
- Merge commit 'd315b7d65e' into yonghao/ump-pd-page-envelopes
  yhzhuang
  committed
  7fadf8e
- Merge commit '7fadf8efc0' into yonghao/ump-decode-host-pool
  yhzhuang
  committed
  372d211
- Merge commit '372d2111cc' into yonghao/ump-hicache-physical-transfers
  yhzhuang
  committed
  d4462ed
- Update PD priority test fixture for draft indices
  yhzhuang
  committed
  940d41b
- Update HiSparse test fixture for unified memory
  yhzhuang
  committed
  d01513d
- Merge commit 'd01513db8e' into yonghao/ump-pd-page-envelopes
  yhzhuang
  committed
  25d1e3b
- Merge commit '25d1e3bc64d22be2ed3665e033a2218a1f7cbce2' into yonghao/ump-decode-host-pool
  yhzhuang
  committed
  ec0e777
- Merge commit 'ec0e7777f38d651b0c3e849d033b81985fc091b3' into yonghao/ump-hicache-physical-transfers
  yhzhuang
  committed
  f417938
- Update decode offload test fixtures for sidecars
  yhzhuang
  committed
  b0018de
- Merge commit 'b0018def8d' into yonghao/ump-hicache-physical-transfers
  yhzhuang
  committed
  3c26277
- Keep physical reservation cleanup host-sync-free
  yhzhuang
  committed
  18142d6
Commits on Sep 8, 2026
- Plan unified FULL/SWA reclaim against physical capacity
  yhzhuang
  committed
  8bc1586
- Merge shared-capacity fixes into page-envelope transfers
  yhzhuang
  committed
  7f10ff8
- Merge capacity fixes and guard shared host-layout access
  yhzhuang
  committed
  6f9a8f2
- Merge host-pool updates and preserve unified transfer lifetimes
  yhzhuang
  committed
  95e9b6d
- Restore unified pool cleanup and scoped compatibility gates
  yhzhuang
  committed
  653c010
- Merge shared-capacity cleanup into PD page envelopes
  yhzhuang
  committed
  07df3f4
- Merge UMP cleanup into shared host pool
  yhzhuang
  committed
  d9ce0bb
- Merge UMP cleanup and restore host-sync-free physical release
  yhzhuang
  committed
  097e185
Commits on Sep 10, 2026
- Merge upstream main and adapt unified capacity to allocator refactors
  yhzhuang
  committed
  f83adaf
- Merge shared capacity refresh and adapt PD envelope allocators
  yhzhuang
  committed
  b32e13e
- Merge PD refresh and reconcile shared host pool with upstream UMBP
  yhzhuang
  committed
  a3a32f2
- Merge host pool refresh and adapt HiCache physical transfers
  yhzhuang
  committed
  b20d10f
- Keep HiSparse fixture compatible with Python 3.10
  yhzhuang
  committed
  f604efb
- Merge Python 3.10 fixture compatibility fix from shared capacity
  yhzhuang
  committed
  e09999e
- Merge Python 3.10 fixture compatibility fix from PD envelopes
  yhzhuang
  committed
  35519a8
- Merge Python 3.10 fixture compatibility fix from host pool
  yhzhuang
  committed
  87df0bc
- Remove unrelated UMP diff churn
  yhzhuang
  committed
  70312b5
- Merge shared-capacity cleanup into PD page envelopes
  yhzhuang
  committed
  054c220
- Merge PD cleanup into decode host pool
  yhzhuang
  committed
  7a71192
- Merge host-pool cleanup into physical transfers
  yhzhuang
  committed
  709e1df
Commits on Sep 12, 2026
- Fix unified pool admission rounding
  yhzhuang
  committed
  4e0e1c3
- Fix full-envelope PD transfers and merge capacity fixes
  yhzhuang
  committed
  69747f6
- Fix L2 producer ordering and host element metadata
  yhzhuang
  committed
  b7c0f51
- Fix SWA-only backup and shared-host prefetch fallback
  yhzhuang
  committed
  3870148
Commits on Sep 13, 2026
- Refactor unified SWA budget handling
  yhzhuang
  committed
  70671d5
- Merge shared-capacity cleanup
  yhzhuang
  committed
  66a2172
- Merge PD shared-capacity cleanup
  yhzhuang
  committed
  f7cda39
- Merge host-pool shared-capacity cleanup
  yhzhuang
  committed
  b03bcd2
- Centralize decode SWA reservation routing
  yhzhuang
  committed
  cb88f1f
- Merge decode reservation cleanup
  yhzhuang
  committed
  415c3bc
- Unify host transfer lifecycle and index preparation
  yhzhuang
  committed
  759b428
- Merge shared host transfer cleanup
  yhzhuang
  committed
  dc84a3b
- Separate storage hit allocation from queue policy
  yhzhuang
  committed
  320d041
- Keep short-prefix threshold policy at the cache boundary
  yhzhuang
  committed
  809821e
- Simplify shared SWA budget paths
  yhzhuang
  committed
  29545f8
- Merge shared SWA budget cleanup
  yhzhuang
  committed
  8d4460c
- Merge shared SWA budget cleanup
  yhzhuang
  committed
  3b85f00
- Merge shared SWA budget cleanup
  yhzhuang
  committed
  242578b
- Fix unified capturer indexing and asymmetric SWA reservation
  yhzhuang
  committed
  4d1fa0f
- Merge shared-capacity fixes and repair unified CPU copy API
  yhzhuang
  committed
  d0a10e5
- Merge PD fixes and use physical SWA offload indices
  yhzhuang
  committed
  4ed9263
- Merge host-pool fixes and preserve eviction progress under host pressure
  yhzhuang
  committed
  e951bb1
- Consolidate unified allocation, admission and capacity policies
  yhzhuang
  committed
  567f4f5
- Merge capacity cleanup and cover real SWA tail allocation
  yhzhuang
  committed
  6066493
- Merge unified admission and PD allocation review cleanup
  yhzhuang
  committed
  1e3a2c4
- Merge UMP cleanup and preserve non-unified HiCache failure semantics
  yhzhuang
  committed
  1fcd125
- Refactor SWA admission into allocator-owned memory budgets
  ch-wan
  committed
  6c7be62
Commits on Sep 14, 2026
- Fix unaligned unified SWA prefill admission
  yhzhuang
  committed
  4fdb2a7
- Merge unified prefill rounding fix into PD support
  yhzhuang
  committed
  5a8f410
- Merge unified prefill rounding fix into host pool
  yhzhuang
  committed
  39a7bcc
- Merge unified prefill rounding fix into HiCache transfers
  yhzhuang
  committed
  a9a744a
- Refactor unified SWA allocators into sibling capacity policies
  yhzhuang
  committed
  089673a
- Clean up unified PD rejection and transfer interfaces
  yhzhuang
  committed
  121fdde
- Unify host-pool allocation and L2 transfer lifecycles
  yhzhuang
  committed
  1ff144d
- Consolidate UMBP page layout and SWA host-pool dispatch
  yhzhuang
  committed
  e843a0a
- Merge reviewed shared-capacity cleanup into PD layer
  yhzhuang
  committed
  3c9040a
- Merge reviewed PD cleanup into host-pool layer
  yhzhuang
  committed
  a8e0085
- Merge host-pool cleanup preserving HiCache bindings
  yhzhuang
  committed
  8e0df01
- Use shared byte capacity for unified SWA pools
  
  yhzhuang
  authored and
  ch-wan
  committed
  564845d
- Keep HiSparse fixture compatible with Python 3.10
  
  yhzhuang
  authored and
  ch-wan
  committed
  a7084b3
- Remove unrelated UMP diff churn
  
  yhzhuang
  authored and
  ch-wan
  committed
  b505c11
- Fix unified pool admission rounding
  
  yhzhuang
  authored and
  ch-wan
  committed
  99ee780
- Refactor unified SWA budget handling
  
  yhzhuang
  authored and
  ch-wan
  committed
  8fd4aa4
- Simplify shared SWA budget paths
  
  yhzhuang
  authored and
  ch-wan
  committed
  fa6c95a
- Fix unified capturer indexing and asymmetric SWA reservation
  
  yhzhuang
  authored and
  ch-wan
  committed
  d9c7447
- Consolidate unified allocation, admission and capacity policies
  
  yhzhuang
  authored and
  ch-wan
  committed
  6cf450c
- Refactor SWA admission into allocator-owned memory budgets
  ch-wan
  committed
  0a80658
- Fix unaligned unified SWA prefill admission
  
  yhzhuang
  authored and
  ch-wan
  committed
  1f3b496
- Refactor unified SWA allocators into sibling capacity policies
  
  yhzhuang
  authored and
  ch-wan
  committed
  f208606
- Fix shared prefill deferral and capture and draft capacity bounds
  ch-wan
  committed
  f0a0085
- Validate inherited unified allocator PD and free-group contracts
  ch-wan
  committed
  ab2ea29
- Merge updated shared-capacity branch into UMP PD support
  yhzhuang
  committed
  e3fa99e
- Merge updated UMP PD support into unified host pools
  yhzhuang
  committed
  5e5433a
- Update staged transfer fixtures for host-pool hooks
  yhzhuang
  committed
  f7f0741
- Merge updated unified host pools and preserve HiCache transfer fixes
  yhzhuang
  committed
  74b7f42
- Explain SWA prefill reservation and chunking safety
  yhzhuang
  committed
  ab7d973
- Merge shared-capacity updates and simplify PD reservation checks
  yhzhuang
  committed
  ea634ec
- Merge PD updates and unify host layout and write interfaces
  yhzhuang
  committed
  eb907b6
- Merge host-pool updates and simplify HiCache allocation policies
  yhzhuang
  committed
  acce638
- Use declared HiCache transfer capability fields
  yhzhuang
  committed
  e6a273f
- Fix Rust SWA backup sources and gate sidecar error recovery
  yhzhuang
  committed
  ccd3487
- Merge host-pool capability cleanup into HiCache transfers
  yhzhuang
  committed
  d9c9565
- Refresh shared KV budgets during decode admission
  yhzhuang
  committed
  81d00a3
- Align HiCache prefix reuse with SWA tail allocation
  yhzhuang
  committed
  a640ec3
- Port profiled SWA byte-budget fix from #36729
  yhzhuang
  committed
  405e92b
- Merge shared KV budget fixes into unified host pool
  yhzhuang
  committed
  bd62e85
- Merge shared KV budget fixes into HiCache physical transfers
  yhzhuang
  committed
  bbbebd7
Commits on Sep 15, 2026
- Merge latest main after shared-capacity PR landed
  ZYHowell
  committed
  1c2fe92
- Merge updated PD page-envelope base
  ZYHowell
  committed
  3606f52
- Sync main through b803cfa0c4
  ZYHowell
  committed
  ba4a021
- Sync updated PD base through latest main
  ZYHowell
  committed
  7373a45
- Merge updated host-pool base and resolve HiCache conflicts
  ZYHowell
  committed
  3e1d4de
- Sync updated host-pool base through latest main
  ZYHowell
  committed
  15ec3e5
Commits on Sep 16, 2026
Commits on Sep 24, 2026
- Merge main and reconcile unified HiCache transfer contracts
  yhzhuang
  committed
  086fe1a
- Merge latest main and retain focused component-only fallback coverage
  yhzhuang
  committed
  5f17c46
- Merge remote-tracking branch 'origin/main' into task/t-0010-pr39479
  yhzhuang
  committed
  e8717bb
- Preserve Mooncake buffer host pools and reconcile allocator test contracts
  yhzhuang
  committed
  a213b8a
Commits on Sep 28, 2026
- Clean redundant unified HiCache test setup
  yhzhuang
  committed
  64eda39
Commits on Sep 29, 2026
- Align unified HiCache storage and staged SWA ownership
  yhzhuang
  committed
  6027473
Commits on Sep 30, 2026
- Remove redundant shared-host allocation collectives
  yhzhuang
  committed
  7b79095
- Align HiCache host refill and validate write policy transitions
  yhzhuang
  committed
  4154c31
- Document incoming host rows retained by tree refill
  yhzhuang
  committed
  573ff05
Commits on Oct 1, 2026
- Merge main into unified memory HiCache transfers
  ZYHowell
  committed
  95adcf7
- Preserve unified cache transfer lifetimes and SWA physical indices
  ZYHowell
  committed
  b55790f
Commits on Oct 2, 2026
- Merge main into unified-memory HiCache transfers
  ZYHowell
  committed
  e8364fe
Commits on Oct 3, 2026
- Merge main into unified-memory HiCache transfers
  ZYHowell
  committed
  2ce5783
Commits on Oct 4, 2026
- Merge main into unified-memory HiCache transfers (resolve _set_capacity add/add)
  metamergebot
  committed
  90e9dcb
- Merge main into unified-memory HiCache transfers (pick up #42454 test fix)
  metamergebot
  committed
  e6487f4

Commits

Commits on Sep 1, 2026

Commits on Sep 2, 2026

Commits on Sep 4, 2026

Commits on Sep 8, 2026

Commits on Sep 10, 2026

Commits on Sep 12, 2026

Commits on Sep 13, 2026

Commits on Sep 14, 2026