Repository navigation

feat: import vLLM 0.33.0 hybrid cache groups through the runtime probe - #677

Merged

Arsene12358 merged 96 commits into

mainfrom

yimingl/issue-475-hybrid-probe-import

Nov 14, 2026

Merged

feat: import vLLM 0.33.0 hybrid cache groups through the runtime probe#677
Arsene12358 merged 96 commits into
mainfrom
yimingl/issue-475-hybrid-probe-import

Commits on Oct 30, 2026
- feat: add state cache groups to the FPM resource schema
  
  Arsene12358
  and
  claude
  committed
  aa3a14d
- test: cover state cache groups in the grouped pool and scheduler
  
  Arsene12358
  and
  claude
  committed
  8c45017
- perf: pre-size the grouped lease ranges per projection
  
  Arsene12358
  and
  claude
  committed
  49c6543
- feat: accept state cache groups in the Python FPM profile
  
  Arsene12358
  and
  claude
  committed
  3837071
- feat: record the probe's prefix-caching settings with runtime memory
  
  Arsene12358
  and
  claude
  committed
  a43bd45
- docs: document state cache groups in the FPM profile
  
  Arsene12358
  and
  claude
  committed
  c94a4dc
- docs: describe state groups in the allocator notes and tidy test names
  
  Arsene12358
  and
  claude
  committed
  4fc5e42
- docs: split the state group allocator sentence
  
  Arsene12358
  and
  claude
  committed
  5bf93cb
Commits on Nov 6, 2026
- docs: define the page, block and block count of a state cache group
  
  Arsene12358
  and
  claude
  committed
  106dc90
- feat: map vLLM cache specs by class and record state evidence in the memory observer
  
  Arsene12358
  and
  claude
  committed
  3ac5c04
- fix: bound vLLM 0.31.0 cache regions by their last page
  
  Arsene12358
  and
  claude
  committed
  48489aa
- fix: record the new cache evidence only for vLLM 0.31.0 runtimes
  
  Arsene12358
  and
  claude
  committed
  a320df6
- feat: add the vLLM 0.31.0 runtime instrumentation bundle
  
  Arsene12358
  and
  claude
  committed
  17a86d3
- fix: take the view kernel block from the storage block only for MLA specs
  
  Arsene12358
  and
  claude
  committed
  45fde03
- feat: import vLLM state cache groups and prefix-caching evidence from runtime observations
  
  Arsene12358
  and
  claude
  committed
  055a198
- fix: check vLLM 0.31.0 cache aliasing by block ownership
  
  Arsene12358
  and
  claude
  committed
  31675b7
- fix: require prefix-caching evidence for vLLM 0.31.0 records and share the view checks
  
  Arsene12358
  and
  claude
  committed
  1fc9013
- fix: keep the 0.27.0 memory path to its legacy cache classes
  
  Arsene12358
  and
  claude
  committed
  eff51da
- test: pin the malformed prefix-caching evidence refusal
  
  Arsene12358
  and
  claude
  committed
  f551673
- feat: accept runtime state cache groups in onboarding import and compare prefix caching per phase
  
  Arsene12358
  and
  claude
  committed
  16236cd
- fix: compare prefix-caching evidence of every phase with the accepted probe
  
  Arsene12358
  and
  claude
  committed
  c1b3d70
- fix: name the fixed state bytes in the grouped KV forward error
  
  Arsene12358
  and
  claude
  committed
  548017e
- docs: describe hybrid cache group import through the vLLM 0.31.0 runtime probe
  
  Arsene12358
  and
  claude
  committed
  1076779
- chore: pin the installed vLLM 0.31.0 source hashes of the GB300 probe image
  
  Arsene12358
  and
  claude
  committed
  a6783bd
- fix: keep the runtime memory provenance of vLLM 0.27.0 and 0.28.0 imports
  
  Arsene12358
  and
  claude
  committed
  5b4f9d6
- fix: refuse a state group whose blocks_per_request contradicts its spec
  
  Arsene12358
  and
  claude
  committed
  e015953
- fix: say probes only for vLLM 0.31.0 memory and merge bindings into the first phase
  
  Arsene12358
  and
  claude
  committed
  8b5a268
- docs: count three adapters and scope the per-phase prefix-caching checks
  
  Arsene12358
  and
  claude
  committed
  142b09e
- docs: state the reasons in code comments instead of plan references
  
  Arsene12358
  and
  claude
  committed
  420ff9b
- fix: refuse prefix-caching evidence that contradicts the resolved cache settings
  
  Arsene12358
  and
  claude
  committed
  47a7560
- fix: require the block counts of Mamba state groups and refuse speculative blocks
  
  Arsene12358
  and
  claude
  committed
  6ad04e9
- fix: match Mamba layer views with the recorded state tensors
  
  Arsene12358
  and
  claude
  committed
  1cc3771
- fix: compare the cache geometry of every formal phase with the accepted probe
  
  Arsene12358
  and
  claude
  committed
  4457503
- fix: require the mode of every Mamba state group and the scheduler block sizes
  
  Arsene12358
  and
  claude
  committed
  ecce85d
- fix: apply the compressed-storage and view kernel block rules on import
  
  Arsene12358
  and
  claude
  committed
  f23d680
- fix: re-check seven observer guarantees of vLLM 0.31.0 records on import
  
  Arsene12358
  and
  claude
  committed
  b1aacd4
- docs: limit the block size claim of the compressed-storage comment
  
  Arsene12358
  and
  claude
  committed
  c25e3e5
- fix: keep extra cache settings in vLLM 0.27.0 and 0.28.0 provenance
  
  Arsene12358
  and
  claude
  committed
  c5790c8
- fix: read prefix-caching evidence only from vLLM 0.31.0 records
  
  Arsene12358
  and
  claude
  committed
  d270450
- test: cover the prefix-caching evidence check across mixed phases
  
  Arsene12358
  and
  claude
  committed
  968bc5a
- fix: require each cache group page to match its layer specs
  
  Arsene12358
  and
  claude
  committed
  1c72908
- fix: recompute the scheduler block sizes and Mamba state views on import
  
  Arsene12358
  and
  claude
  committed
  163f71c
- fix: check the hash block size of schedulers without prefix caching
  
  Arsene12358
  and
  claude
  committed
  459fa67
- test: reach the per-phase prefix-caching check of the phase binding again
  
  Arsene12358
  and
  claude
  committed
  4789c2f
- fix: check Mamba group blocks against the Mamba block size and kernels
  
  Arsene12358
  and
  claude
  committed
  b824610
- docs: name the source of the Mamba block in a test helper docstring
  
  Arsene12358
  and
  claude
  committed
  ab9ef96
- fix: refuse scheduler hash block sizes that vLLM cannot start with
  
  Arsene12358
  and
  claude
  committed
  ecfacf3
- docs: limit a test comment to the blocks in prefix caching
  
  Arsene12358
  and
  claude
  committed
  1dbd190
- fix: check scheduler hash block sizes with SlidingWindowMLASpec groups
  
  Arsene12358
  and
  claude
  committed
  49f11f0
- fix: require one SlidingWindowMLASpec choice to meet every hash rule
  
  Arsene12358
  and
  claude
  committed
  4837618
- fix: skip the abstract tokens_per_state of uniform cache group specs
  
  Arsene12358
  and
  claude
  committed
  4003cfe
- test: cover the fallback branches of the scheduler hash block check
  
  Arsene12358
  and
  claude
  committed
  34c26d5
- docs: update observer line citations and a test fake comment
  
  Arsene12358
  and
  claude
  committed
  bda81d8
- fix: read the remote config commit from the config object itself
  
  Arsene12358
  and
  claude
  committed
  83daeef
- docs: name the etcd and Dynamo inputs of the stock vLLM 0.31.0 image
  
  Arsene12358
  and
  claude
  committed
  43ad239
- docs: update observer line citations and two notes on the commit read
  
  Arsene12358
  and
  claude
  committed
  af47be4
- docs: say that the GB300 probes observed the GLM groups, and limit state import to vLLM 0.31.0
  
  Arsene12358
  and
  claude
  committed
  ef70678
- fix: check state group block counts against the recorded vLLM concurrency
  
  Arsene12358
  and
  claude
  committed
  8713e55
Commits on Nov 8, 2026
- Merge main into the state cache groups branch
  
  Arsene12358
  and
  claude
  committed
  5b0c794
- Merge the state cache groups branch into the hybrid probe import branch
  
  Arsene12358
  and
  claude
  committed
  46d9f83
Commits on Nov 9, 2026
- Merge main into the hybrid probe import branch
  
  Arsene12358
  and
  claude
  committed
  0c96820
Commits on Nov 10, 2026
- Merge main into the hybrid probe import branch
  Arsene12358
  committed
  7b54ff9
- fix: tell a hybrid cache record by its layer specs, not by its layer stride
  
  Arsene12358
  and
  claude
  committed
  f17160f
- refactor: remove the phase check that the cache geometry comparison covers
  
  Arsene12358
  and
  claude
  committed
  91bebb4
- feat: bundle the runtime probe for vLLM 0.33.0 and drop the 0.31.0 bundle
  
  Arsene12358
  and
  claude
  committed
  26c50f7
- fix: read the loaded config commit from the pinned snapshot on the probe route
  
  Arsene12358
  and
  claude
  committed
  c84f48e
- test: pin that an unpinned revision triggers no snapshot lookup on the probe route
  
  Arsene12358
  and
  claude
  committed
  dc9dae4
- feat: record and import the kernel-block views of vLLM 0.33.0
  
  Arsene12358
  and
  claude
  committed
  dbc388a
- docs: describe the kernel-block views in the vLLM 0.33.0 probe notes
  
  Arsene12358
  and
  claude
  committed
  4e4165b
- feat: hold the prefill checkpoint blocks of a state group in FPM profiles
  
  Arsene12358
  and
  claude
  committed
  19347bb
- feat: import one prefill checkpoint block of a Mamba state group
  
  Arsene12358
  and
  claude
  committed
  e5c8142
- test: pin the refusals of malformed prefill checkpoint evidence
  
  Arsene12358
  and
  claude
  committed
  a624121
- docs: describe the hybrid runtime probe on vLLM 0.33.0
  
  Arsene12358
  and
  claude
  committed
  5a97692
- docs: cite vLLM 0.33.0 lines in the comments of the hybrid probe path
  
  Arsene12358
  and
  claude
  committed
  c28839a
- docs: state the FlashKDA conditions and the unresolved memory of hybrid groups exactly
  
  Arsene12358
  and
  claude
  committed
  a9eebd1
- Merge main into the hybrid probe import branch
  
  Arsene12358
  and
  claude
  committed
  9d52b1a
- fix: import hybrid cache evidence only from vLLM 0.33.0 probe records
  
  Arsene12358
  and
  claude
  committed
  5682d5f
- docs: state that a vLLM patch release gets no hybrid cache evidence
  
  Arsene12358
  and
  claude
  committed
  401d4db
- test: import the live GLM-5.3-Flash probe record of vLLM 0.33.0
  
  Arsene12358
  and
  claude
  committed
  2f85832
- test: rebuild the GLM-5.3-Flash test fakes from the live vLLM 0.33.0 record
  
  Arsene12358
  and
  claude
  committed
  f42cb20
- docs: add the measured vLLM 0.33.0 values of the GLM-5.3-Flash probe
  
  Arsene12358
  and
  claude
  committed
  ab9ba5a
- docs: scope the scheduler mamba_block_size note to the multiprocess executor
  
  Arsene12358
  and
  claude
  committed
  a53c0a5
- Merge main into the hybrid probe import branch
  
  Arsene12358
  and
  claude
  committed
  18ebfbe
- docs: state the pinned Dynamo scheduler file and correct source citations
  
  Arsene12358
  and
  claude
  committed
  8ca8a23
- fix: keep the grouped review line of plain drafts and name state groups apart
  
  Arsene12358
  and
  claude
  committed
  a95291a
- test: cover the hybrid import and observer refusals that had no test
  
  Arsene12358
  and
  claude
  committed
  3bba901
- refactor: remove a layer view refusal that cannot fire
  
  Arsene12358
  and
  claude
  committed
  92d2f02
- chore: keep ruff off the frozen bundle copies of the vLLM 0.33.0 probe fixture
  
  Arsene12358
  and
  claude
  committed
  5f4200a
- docs: scope the vLLM 0.31.0 import refusal to hybrid probe records
  
  Arsene12358
  and
  claude
  committed
  011dd8d
- fix: refuse a prefix match unit that vLLM 0.33.0 rejects for a single cache group
  
  Arsene12358
  and
  claude
  committed
  02885ca
Commits on Nov 11, 2026
- docs: note how vLLM 0.33.0 sets the block size of a single cache group
  
  Arsene12358
  and
  claude
  committed
  34a356d
- Merge main into the hybrid probe import branch
  
  Arsene12358
  and
  claude
  committed
  fc1dec6
- Merge main into the hybrid probe import branch
  
  Arsene12358
  and
  claude
  committed
  7a88f33
Commits on Nov 13, 2026
- ci: switch workflows to renamed AISim runner pools (#861)
  saturley-hall
  committed
  d32900b
Commits on Nov 14, 2026
- fix: merge main and retain hybrid runtime probe assets
  
  jasonqinzhou
  authored and
  Arsene12358
  committed
  c4eb77f
- fix: observe and validate Mamba startup block reservations
  
  jasonqinzhou
  authored and
  Arsene12358
  committed
  1c8fa60

Commits

Commits on Oct 30, 2026

Commits on Nov 6, 2026

Commits on Nov 8, 2026

Commits on Nov 9, 2026

Commits on Nov 10, 2026

Commits on Nov 11, 2026

Commits on Nov 13, 2026

Commits on Nov 14, 2026