[None][perf] Integrate Mooncake store for MinimaxM3 - #18676

Merged

brb-nv merged 24 commits into

NVIDIA:feat/m3_with_msafrom

brb-nv:user/brb/m3-mooncake-store

Sep 5, 2026

Commits on Sep 4, 2026

[None][chore] Install the Mooncake Python store bindings in the container
brb-nv
committed
01fd5ce
[None][feat] Add a Mooncake distributed store KV cache connector
brb-nv
committed
92199c7
[None][feat] Gate, register and test the mooncake-store connector
brb-nv
committed
b49a4b6
[None][doc] Document the mooncake-store connector
brb-nv
committed
ead8bd0
[None][chore] Add mooncake-store to the LLM args golden manifest
brb-nv
committed
8a32553
save changes to install process
brb-nv
committed
8bf2059
[None][feat] Span the Mooncake store pool across prefill and decode nodes
brb-nv
committed
32625df
[None][fix] Stage mooncake-store KV pages through pinned host memory
brb-nv
committed
bd0acb4
[None][fix] Force partial reuse off when the mooncake-store connector is used
brb-nv
committed
41d312e
[None][doc] Add a handover guide for the mooncake-store connector
brb-nv
committed
6056b19
[None][fix] Preempt context requests when the KV pool has nothing to spill to
brb-nv
committed
abe576c
[None][feat] provision the Mooncake store pool during trtllm-serve bringup
brb-nv
committed
8549d5b
[None][fix] Let the config size the Mooncake staging buffer
brb-nv
committed
d16989d
[None][feat] Ship the Mooncake pool parts a server cannot own
brb-nv
committed
a3404ea
[None][chore] Assemble the Mooncake pool from what TensorRT-LLM ships
brb-nv
committed
7199b90
[None][feat] Configure the whole Mooncake pool, launch none of it
brb-nv
committed
ca85079
[None][chore] Polish mooncake-store docs, config handling, and tests
brb-nv
committed
fb3cc71
[None][chore] Drop the local mooncake experiment scratch from the branch
brb-nv
committed
d7db7f2
[None][chore] Drop the benchmark job-watching helper
brb-nv
committed
2ba3bca
[None][chore] Drop the stall-report diagnostic from the branch
brb-nv
committed
5dc8ffb
[None][test] Collapse redundant mooncake-store tests into parametrized cases
brb-nv
committed
652948c
[None][test] Run the mooncake-store and KV-cache-v2 scheduler tests on the M3 stage
brb-nv
committed
e6d39fb

Commits on Sep 5, 2026

formatting
brb-nv
committed
6b11d7f
address comment from Pietro
brb-nv
committed
8665cf3

Navigation Menu

Uh oh!

[None][perf] Integrate Mooncake store for MinimaxM3 - #18676

[None][perf] Integrate Mooncake store for MinimaxM3#18676
brb-nv merged 24 commits into
NVIDIA:feat/m3_with_msafrom
brb-nv:user/brb/m3-mooncake-store

Commits on Sep 4, 2026

[None][chore] Install the Mooncake Python store bindings in the container

[None][feat] Add a Mooncake distributed store KV cache connector

[None][feat] Gate, register and test the mooncake-store connector

[None][doc] Document the mooncake-store connector

[None][chore] Add mooncake-store to the LLM args golden manifest

save changes to install process

[None][feat] Span the Mooncake store pool across prefill and decode nodes

[None][fix] Stage mooncake-store KV pages through pinned host memory

[None][fix] Force partial reuse off when the mooncake-store connector is used

[None][doc] Add a handover guide for the mooncake-store connector

[None][fix] Preempt context requests when the KV pool has nothing to spill to

[None][feat] provision the Mooncake store pool during trtllm-serve bringup

[None][fix] Let the config size the Mooncake staging buffer

[None][feat] Ship the Mooncake pool parts a server cannot own

[None][chore] Assemble the Mooncake pool from what TensorRT-LLM ships

[None][feat] Configure the whole Mooncake pool, launch none of it

[None][chore] Polish mooncake-store docs, config handling, and tests

[None][chore] Drop the local mooncake experiment scratch from the branch

[None][chore] Drop the benchmark job-watching helper

[None][chore] Drop the stall-report diagnostic from the branch

[None][test] Collapse redundant mooncake-store tests into parametrized cases

[None][test] Run the mooncake-store and KV-cache-v2 scheduler tests on the M3 stage

Commits on Sep 5, 2026

formatting

address comment from Pietro