Repository navigation

[unified-memory] Token-major dense views for the unified memory pool (3/7) - #38592

Merged

ch-wan merged 15 commits into

sgl-project:mainfrom

caihuali95:mainline/token-major-dense-views

Oct 2, 2026

Merged

[unified-memory] Token-major dense views for the unified memory pool (3/7)#38592
ch-wan merged 15 commits into
sgl-project:mainfrom
caihuali95:mainline/token-major-dense-views

Commits on Oct 2, 2026
- refactor(unified-memory): add the token-major entry layout types
  
  Caihua Li
  authored and
  ch-wan
  committed
  681ad0c
- feat(unified-memory): store the unified pool token-major
  
  Caihua Li
  authored and
  ch-wan
  committed
  53a3b24
- refactor(unified-memory): delete the page-major envelope machinery
  
  Caihua Li
  authored and
  ch-wan
  committed
  ef45ec8
- fix(unified-memory): refuse trtllm_mha decode cuda graphs under the unified pool
  ch-wan
  committed
  e7ae772
- test(unified-memory): keep main's test edits in the token-major rewrites
  ch-wan
  committed
  9553048
- refactor(unified-memory): drop the pass-through CPU-copy overrides
  ch-wan
  committed
  7b8ac56
- docs(unified-memory): describe the token-major entry where the text still said layer-major
  ch-wan
  committed
  d2612c3
- test(unified-memory): import the paged-view helpers from their module
  ch-wan
  committed
  a2a96ce
- refactor(unified-memory): tidy the token-major layout code
  ch-wan
  committed
  6958595
- refactor(unified-memory): take a part name and a slot count in build_dense_views
  ch-wan
  committed
  11be130
- refactor(unified-memory): name the entry-layout module token_major
  ch-wan
  committed
  80f1eb3
- fix(unified-memory): tag HiCache storage keys with the unified page format
  ch-wan
  committed
  e8ef731
- docs(unified-memory): state the backend requirement the startup checks enforce
  ch-wan
  committed
  2c4e2d2
- fix(unified-memory): refuse misaligned per-rank rows with a clear error
  ch-wan
  committed
  d531e36
- style(unified-memory): keep the addressing rule in docstrings, drop the retelling
  ch-wan
  committed
  9423810

Commits

Commits on Oct 2, 2026