chore: agentx v0.3 - #1571

Merged

cquil11 merged 152 commits into

mainfrom

chore/agentx-v0.3

Jun 2, 2026

Commits on May 17, 2026

mi355x kimi-fp4 agentic: switch from SimpleCPUOffloadConnector to OffloadingConnector
cquil11
committed
846af91
dsv4-fp4-b200-vllm-agentic: bump image to cquil v0.21.0 custom build

cquil11
and
claude
committed
9996180
Add dsv4-fp4-mi355x-sglang-agentic config + launcher

cquil11
and
claude
committed
aae82c0
dsv4-fp4-b200-vllm-agentic: drop docker.io/ prefix from image

cquil11
and
claude
committed
8feadd4

Commits on May 18, 2026

Add dsv4-fp4-gb300-dynamo-vllm-agentic with local-recipe overlay

cquil11
and
claude
committed
5e1ca4e
gb300 agentic recipes: quote PORT as string for fork srtctl schema

cquil11
and
claude
committed
3eb9cbf
launch_gb300-cw.sh: mirror IS_AGENTIC branch from launch_gb300-nv.sh

cquil11
and
claude
committed
7b3756e
gb300 agentic launchers: use upstream NVIDIA/srt-slurm + fix venv pip

cquil11
and
claude
committed
2ae4bf9
gb300 launchers: use real upstream srt-slurm SHA (was fabricated)

cquil11
and
claude
committed
b858480
gb300 agentic: strip chat parser flags from worker config + harden cw launcher

cquil11
and
claude
committed
893f5b8
gb300-nv launcher: point dsv4 MODEL_PATH at the real shared NFS path

cquil11
and
claude
committed
43b3a05
gb300-nv launcher: switch dsv4 MODEL_PATH to /data/ mount to dodge NFS ELOOP

cquil11
and
claude
committed
4195071
gb300 agentic launchers: pin to fork branch with --mem=0 patch

cquil11
and
claude
committed
948eaa5
gb300-nv launcher: move squash files to /data/ mount (same NFS ELOOP)

cquil11
and
claude
committed
a3512cb
gb300 agentic: set --mem=0 via recipe srun_options (canonical mechanism)

cquil11
and
claude
committed
52af9d4
gb300 agentic: add sbatch_directives.mem=0 (the missing layer)

cquil11
and
claude
committed
3274dea
gb300 agentic: add sbatch_directives.cpus-per-task=72 (fix etcd starvation)

cquil11
and
claude
committed
92d2738
gb300 agentic: pin to nv-only + try /scratch model path

cquil11
and
claude
committed
1614e7f
gb300-nv agentic: clone cquil11 fork + pass --no-preflight

cquil11
and
claude
committed
4ff2e50
gb300 agentic: wire aiperf mmap dataset cache

cquil11
and
claude
committed
a3d946c
bump aiperf submodule: sync with ai-dynamo/aiperf PR #875

cquil11
and
claude
committed
7530760
agentic: install git on-demand for aiperf editable install

cquil11
and
claude
committed
0678059
agentic: switch to no-subagents loader + sudo git install for non-root containers

cquil11
and
claude
committed
62ef027
agentic: drop -e from aiperf install (sidesteps git + userns-remap)

cquil11
and
claude
committed
18bc0bc
agentic: simplify git install to bare apt-get update && install; keep -e

cquil11
and
claude
committed
ea13e41
gb300-nv agentic: add srun_options.container-remap-root

cquil11
and
claude
committed
3f4b095
gb300-nv launcher: bump srt-slurm SHA to include benchmark_stage fix

cquil11
and
claude
committed
482348c
bump aiperf submodule: hang fix on cancel path

cquil11
and
claude
committed
dac50f7
runners(gb300): snapshot server-log tarball on script EXIT (handle cancel)

cquil11
and
claude
committed
e575981
agentic: bump --failed-request-threshold 0.05 -> 0.20

cquil11
and
claude
committed
609b74d

Commits on May 19, 2026

bump aiperf submodule: quieter warnings + tqdm in non-tty

cquil11
and
claude
committed
afacd5b
benchmark_lib: disable failed-request threshold (1.0) for capacity-bound runs

cquil11
and
claude
committed
4c9a4b5
launch_gb300-nv: snapshot server logs BEFORE rm -rf outputs

cquil11
and
claude
committed
b2ffd9b
bump aiperf to a6812b03: fix UIType.TQDM crash

cquil11
and
claude
committed
48f151e
bump aiperf to 2f30ea86: revert TQDM + warning-downgrade changes

cquil11
and
claude
committed
a4ee9a7
agentic recipes: raise NATS max_payload from 1MiB default to 32MiB

cquil11
and
claude
committed
329d168
bump aiperf to 61a9ed80: per-lane start-token counts in TrajectorySource log

cquil11
and
claude
committed
f8b85c9
add dsv4-fp4-gb300-cw-dynamo-vllm-agentic — CoreWeave sibling config

cquil11
and
claude
committed
fa28004
bump aiperf to a2b9d6b5: cc-traces dataset 051226 -> 051826 (98 traces)

cquil11
and
claude
committed
4a46881
bump aiperf to 90c93aba: revert per-lane start-token logging

cquil11
and
claude
committed
20d4dd8
bump aiperf to a61553fd: drop preemptions from realtime log

cquil11
and
claude
committed
21f71b6
b200/b300 vllm-agentic: no-offload curves vs new cc-traces 051826

cquil11
and
claude
committed
6d10eaf
launch_b300-nv: drop nonexistent b300-020 from salloc nodelist

cquil11
and
claude
committed
2ce6131
launch_b300-nv: add --container-remap-root to enable apt-get inside container

cquil11
and
claude
committed
c2c04df
remove utils/trace-replay submodule

cquil11
and
claude
committed
a70f1ba
remove trace-replay references; standardize on aiperf_artifacts

cquil11
and
claude
committed
6558228
update aiperf submodule branch tracking to cjq/agentx-v0.3

cquil11
and
claude
committed
3af753b

Commits on May 20, 2026

track aiperf submodule on cjq/agentx-v0.3-subagents

cquil11
and
claude
committed
aa7348f
chore: update aiperf tiered subagent joins
cquil11
committed
3273663
chore: update aiperf tiered join docs
cquil11
committed
1722c11
chore: update aiperf idle gap cap
cquil11
committed
9d94969
chore: update aiperf idle gap cap precedence
cquil11
committed
dc35e35
chore: update aiperf idle gap semantics
cquil11
committed
da16c0b
chore: update aiperf join examples
cquil11
committed
bd290a0
benchmarks(agentic): switch to with-subagents corpus + idle-gap cap

cquil11
and
claude
committed
9ea7370
benchmarks(agentic): trim workload distribution analyzer to ISL/OSL only

cquil11
and
claude
committed
a2707d4
benchmarks(agentic): restore generate_aiperf_plots.py for server-metrics panels

cquil11
and
claude
committed
8a267b7
benchmarks(agentic): drop conc=96,128 from b200 dsv4 vllm agentic sweep

cquil11
and
claude
committed
a258f90
benchmarks(agentic): fix generate_aiperf_plots.py artifact dir lookup

cquil11
and
claude
committed
d79bc5f

Commits on May 21, 2026

chore: bump aiperf submodule to de702eaf (mmap cache hardlink)

cquil11
and
claude
committed
5c15fa9
feat: add lmcache mp agentic offload
cquil11
committed
c149b9d
fix: run lmcache on dsv4 tep agentic
cquil11
committed
ed79577
fix: clean lmcache agentic startup logs
cquil11
committed
01ed357
fix: disable lmcache dsv4 offload
cquil11
committed
21ed1eb
switch to native offloading
cquil11
committed
907ad2e
switch to native offloading
cquil11
committed
4abc590
fix: size native dsv4 offload to 2.8tb
cquil11
committed
3d7bfe2
switch to native offloading
cquil11
committed
ad505ff
switch to native offloading
cquil11
committed
1cede80
benchmarks(agentic): drop dsv4 b200 native offload from 2.8TB to 1.2TB

cquil11
and
claude
committed
99cd035
feat(agentic): add Kimi LMCache offload coverage
cquil11
committed
b07bd58
feat(agentic): add Qwen SGLang HiCache starts
cquil11
committed
327c4d9
fix(agentic): size SGLang HiCache per rank
cquil11
committed
6b87f49
fix(agentic): tune B300 HiCache defaults
cquil11
committed
9e6e81a
fix(agentic): tune MI355X HiCache defaults
cquil11
committed
1a300d3
fix(agentic): cap Kimi LMCache CPU pool per rank
cquil11
committed
859aec5
fix(agentic): cap MI355X HiCache per-rank memory
cquil11
committed
5398ba9
fix(agentic): skip MI355X HiCache server warmup
cquil11
committed
9a8f89c
fix(agentic): skip non-finite SGLang metrics
cquil11
committed
9f3fb05
fix(agentic): size Qwen HiCache host pools
cquil11
committed
5ebf81f
fix(agentic): cap replay contexts to server window
cquil11
committed
dbfbd56

Commits on May 22, 2026

fix(agentic): cap MI355X HiCache graph capture
cquil11
committed
8fa3c96
fix(matrix): apply runner filter to agentic configs
cquil11
committed
83fa8ec
fix(config): use registered MI355X runner labels
cquil11
committed
f999fef
fix(agentic): use direct HiCache copies for Qwen MI355X
cquil11
committed
afaec72
mi355x qwen sgl offload
cquil11
committed
1e730d7
fix(agentic): use LMCache MP for Kimi B200
cquil11
committed
e29fb3b
feat(agentic): add LMCache MP for Kimi MI355X
cquil11
committed
bb64d3e
mi355x qwen sgl offload
cquil11
committed
91b24b5
fix(agentic): avoid CUDA NIXL import on MI355X LMCache
cquil11
committed
5a3cd6a
chore: bump aiperf submodule to 5b3db5a2 (merge PR #2)

cquil11
and
claude
committed
4fec279
fix(agentic): fail replay above 10 percent request errors
cquil11
committed
4a51237
benchmarks(agentic): retarget HF dataset constants to with-subagents-051926

cquil11
and
claude
committed
4aeb164
fix(agentic): propagate replay failures
cquil11
committed
36cb524
fix(agentic): remove CUDA LMCache deps on ROCm
cquil11
committed
10222f4
fix(agentic): keep LMCache cupy deps on ROCm
cquil11
committed
8f01cb4
fix(agentic): use ROCm CuPy for Kimi LMCache MP
cquil11
committed
265fc75
fix(agentic): add ROCm LMCache MP block fallback
cquil11
committed
f34e024
fix(agentic): defer ROCm LMCache pinned expansion
cquil11
committed
20d6508
fix(agentic): lazily patch ROCm LMCache allocator
cquil11
committed
0103241
fix(agentic): avoid partial LMCache import patching
cquil11
committed
5db2668
fix(agentic): filter Kimi MI355X replay context
cquil11
committed
5819b31
fix(agentic): normalize Kimi MI355X max context
cquil11
committed
165d41c
fix(agentic): update AIPerf replay metadata
cquil11
committed
229d541
fix(agentic): refresh AIPerf mmap cache schema
cquil11
committed
81fd6bf
fix(agentic): carry AIPerf prefix metadata
cquil11
committed
e80a843
fix(agentic): use final LMCache capacity on ROCm
cquil11
committed
69cdbc2
fix(agentic): extend Kimi MI355X LMCache read lease
cquil11
committed
03a85ab

Commits on May 26, 2026

feat: Kimi-K2.5-MXFP4 LMCache MP offloading for MI355X agentic benchmarks (#1564)
andyluo7
authored
4941697
chore(agentx): update aiperf prefix cache metric
cquil11
committed
9e41c1a
fix(agentx): refresh aiperf mmap cache schema
cquil11
committed
380dcd7
fix(agentx): carry prefix counts into mmap metadata
cquil11
committed
bc41a72
fix(agentx): default to pre-canned assistant replay
cquil11
committed
60fcd42
dsv4
cquil11
committed
81d381d
dsv4
cquil11
committed
8724609
dsv4
cquil11
committed
06c606a
fix(agentx): update aiperf realtime cache metrics
cquil11
committed
7ad7dd4
testing kimi
cquil11
committed
5403a6b
testing kimi
cquil11
committed
1c6d297
chore(aiperf): bump submodule for unique_in_srv realtime metric
cquil11
committed
acc2c73
runners(h200-dgxc-slurm): remap container UID to root to match b200-dgxc

cquil11
and
claude
committed
967c50c
fix(agentx): re-enable weka live assistant replay
cquil11
committed
4be3ef0

Commits on May 27, 2026

benchmarks(single_node): move fixed-seq-len scripts into fixed_seq_len/ subdir

cquil11
and
claude
committed
8eec0d4
Merge origin/main into chore/agentx-v0.3 with fixed_seq_len/ reorg fixups

cquil11
and
claude
committed
f89cdfe
chore: update agentx v0.3 aiperf
cquil11
committed
049a873
chore: update agentx weka dataset
cquil11
committed
711cb85
chore: update agentx snapshot logging
cquil11
committed
284cfa5
benchmarks: drop redundant ${VAR:-default} defaults from recipe scripts

cquil11
and
claude
committed
1b41cd0
runners(h200-{nb,cw}): wire AIPERF mmap cache mount + env

cquil11
and
claude
committed
a98fcaa
benchmarks(agentic): add WEKA_LOADER_OVERRIDE; switch minimax to 256k corpus

cquil11
and
claude
committed
e1e4d44
benchmarks: retarget WEKA_LOADER_OVERRIDE 256k variant to 052726-256k

cquil11
and
claude
committed
4e62c59
utils(proxy_to_weka): drop exact-duplicate rows in load_session_rows

cquil11
and
claude
committed
eab58e9
nvidia-master(kimik2.5-fp4-b200-vllm-agentic): bump vLLM v0.20.2 -> v0.21.0

cquil11
and
claude
committed
88a1153
feat(agentic): add qwen3.5-fp8-h100-sglang-agentic recipe

cquil11
and
claude
committed
72cf856
runners(h100-dgxc-slurm): wire AIPERF mmap cache mount + env

cquil11
and
claude
committed
3406355
chore(aiperf): bump submodule for SGLang realtime srv-row fallbacks
cquil11
committed
4933cf3
chore(aiperf): bump submodule for _total counter-lookup fix
cquil11
committed
6d884b9
agentic(sglang): drop --disable-radix-cache from every recipe
cquil11
committed
77e648d
chore(aiperf): bump submodule for SGLang counter-pair cache hit rate
cquil11
committed
b27295c

Commits on May 28, 2026

testing qwen
cquil11
committed
842a0cf
testing qwen
cquil11
committed
5d10625
testing qwen
cquil11
committed
717385a
testing qwen
cquil11
committed
6a77acb
chore(aiperf): bump submodule for weka_trace id()-keyed dict fix

cquil11
and
claude
committed
c00454e
chore(aiperf): bump submodule for parallel reconstruction dropped-subagent skip

cquil11
and
claude
committed
ae8ba76
chore(aiperf): bump submodule for mmap-cache stale-lock bypass

cquil11
and
claude
committed
bcf338c
testing qwen
cquil11
committed
0e8ac92
chore(aiperf): bump submodule for snapshot warmup fix
cquil11
committed
57fdef7

Commits on Jun 2, 2026