Repository navigation

feat(offload): support native DSv4 checkpoints with LMCache MP - #2250

Merged

valarLip merged 29 commits into

mainfrom

feat/dsv4-lmcache-mp

Sep 28, 2026

Commits on Sep 25, 2026
- feat(offload): support native DSv4 checkpoints with LMCache MP
  
  Honglie Yi
  and
  claude
  committed
  62893d7
Commits on Sep 26, 2026
- docs(offload): pass --eviction-policy to the LMCache MP server example
  
  Honglie Yi
  and
  claude
  committed
  19d92e0
- fix(lmcache_mp): skip native saves shorter than OFFLOAD_MIN_SAVE_TOKENS
  
  Honglie Yi
  and
  claude
  committed
  ad850b5
Commits on Sep 27, 2026
- fix(offload): keep early release safe without a BlockManager; one save threshold
  
  Honglie Yi
  and
  claude
  committed
  ec3fe93
- fix(lmcache_mp): bound unprovable transfers; fence native restores
  
  Honglie Yi
  and
  claude
  committed
  c944f61
- fix(lmcache_mp): end sessions after the last save; unwind failed admissions
  
  Honglie Yi
  and
  claude
  committed
  e93d0ef
- fix(lmcache_mp): keep draft PAGE regions out of the native image
  
  Honglie Yi
  and
  claude
  committed
  a608c55
- fix(attention): take the descriptor slot in DSv4.1 paged-state copies
  
  Honglie Yi
  and
  claude
  committed
  13721f0
- fix(offload): seed native and late-save hash chains from cache_seed
  
  Honglie Yi
  and
  claude
  committed
  971823c
- fix(offload): fail closed on disabled paged-state checkpoints and composite state release
  
  Honglie Yi
  and
  claude
  committed
  7cdef48
- perf(lmcache_mp): cache the native save frontier; reserve restore slots early
  
  Honglie Yi
  and
  claude
  committed
  17918ab
- docs(offload): document every offload env var; guard it with a test
  
  Honglie Yi
  and
  claude
  committed
  2f0d606
- test(lmcache_mp): make the raising-restore test independent of CUDA
  
  Honglie Yi
  and
  claude
  committed
  94c0741
Commits on Sep 28, 2026
- fix(lmcache_mp): release transfer memory only on a report, fail stop at a deadline
  
  Honglie Yi
  and
  claude
  committed
  83f515a
- fix(offload): lease the final save source when prefix caching is off
  
  Honglie Yi
  and
  claude
  committed
  5cc76a8
- fix(offload): reacquire a final save source only after a partial release
  
  Honglie Yi
  and
  claude
  committed
  eaac7eb
- fix(lmcache_mp): keep the native STATE image pinned until the STORE terminal
  
  Honglie Yi
  and
  claude
  committed
  818a555
- fix(envs): read an empty offload knob as its default everywhere
  
  Honglie Yi
  and
  claude
  committed
  c8156e8
- fix(lmcache_mp): keep failed adoptions releasable and surface broken invariants
  
  Honglie Yi
  and
  claude
  committed
  9b8f779
- test(lmcache_mp): run a native restore end to end and fix drifted copy doubles
  
  Honglie Yi
  and
  claude
  committed
  45943d1
- perf(lmcache_mp): invalidate a request's save frontier only on its own checkpoints
  
  Honglie Yi
  and
  claude
  committed
  4f0eeda
- refactor(attentions): one fenced descriptor staging for every checkpoint copier
  
  Honglie Yi
  and
  claude
  committed
  28dda85
- refactor(lmcache_mp): validate PAGE views once for both registrations
  
  Honglie Yi
  and
  claude
  committed
  ec7e2ec
- refactor(lmcache_mp): split the native worker's completion poll
  
  Honglie Yi
  and
  claude
  committed
  cf1fea4
- refactor(lmcache_mp): split mp/backend.py by responsibility
  
  Honglie Yi
  and
  claude
  committed
  ac5f2dd
- fix(offload): keep clock reclaim off MP requests; warn on truncated late saves
  
  Honglie Yi
  and
  claude
  committed
  ecffc99
- refactor(kv_transfer): publish each PAGE region and its byte view together
  
  Honglie Yi
  and
  claude
  committed
  069718a
- refactor(kv_transfer): make a PAGE unit one value, its region and view together
  
  Honglie Yi
  and
  claude
  committed
  603db8d
- Merge main into feat/dsv4-lmcache-mp
  
  Honglie Yi
  and
  claude
  committed
  feeb8fc

Navigation Menu

Repository navigation

feat(offload): support native DSv4 checkpoints with LMCache MP - #2250

feat(offload): support native DSv4 checkpoints with LMCache MP#2250
valarLip merged 29 commits into
mainfrom
feat/dsv4-lmcache-mp

Commits on Sep 25, 2026

feat(offload): support native DSv4 checkpoints with LMCache MP

Commits on Sep 26, 2026

docs(offload): pass --eviction-policy to the LMCache MP server example

fix(lmcache_mp): skip native saves shorter than OFFLOAD_MIN_SAVE_TOKENS

Commits on Sep 27, 2026

fix(offload): keep early release safe without a BlockManager; one save threshold

fix(lmcache_mp): bound unprovable transfers; fence native restores

fix(lmcache_mp): end sessions after the last save; unwind failed admissions

fix(lmcache_mp): keep draft PAGE regions out of the native image

fix(attention): take the descriptor slot in DSv4.1 paged-state copies

fix(offload): seed native and late-save hash chains from cache_seed

fix(offload): fail closed on disabled paged-state checkpoints and composite state release

perf(lmcache_mp): cache the native save frontier; reserve restore slots early

docs(offload): document every offload env var; guard it with a test

test(lmcache_mp): make the raising-restore test independent of CUDA

Commits on Sep 28, 2026

fix(lmcache_mp): release transfer memory only on a report, fail stop at a deadline

fix(offload): lease the final save source when prefix caching is off

fix(offload): reacquire a final save source only after a partial release

fix(lmcache_mp): keep the native STATE image pinned until the STORE terminal

fix(envs): read an empty offload knob as its default everywhere

fix(lmcache_mp): keep failed adoptions releasable and surface broken invariants

test(lmcache_mp): run a native restore end to end and fix drifted copy doubles

perf(lmcache_mp): invalidate a request's save frontier only on its own checkpoints

refactor(attentions): one fenced descriptor staging for every checkpoint copier

refactor(lmcache_mp): validate PAGE views once for both registrations

refactor(lmcache_mp): split the native worker's completion poll

refactor(lmcache_mp): split mp/backend.py by responsibility

fix(offload): keep clock reclaim off MP requests; warn on truncated late saves

refactor(kv_transfer): publish each PAGE region and its byte view together

refactor(kv_transfer): make a PAGE unit one value, its region and view together

Merge main into feat/dsv4-lmcache-mp