Repository navigation

fix: count only uncached tokens against the legacy agg prefill budget - #333

Open

kangclzjc wants to merge 7 commits into

ai-dynamo:mainfrom

kangclzjc:fix/legacy-agg-prefix-scheduling

Commits on Sep 29, 2026
- fix: count only uncached tokens against the legacy agg prefill budget
  
  kangclzjc
  and
  claude
  committed
  3eae51e
- test(parity): re-pin prefix chunked-prefill goldens for the uncached budget
  
  kangclzjc
  and
  claude
  committed
  ccc48f0
- fix(sdk): key the run_agg result cache on prefix and correction scales
  
  kangclzjc
  and
  claude
  committed
  0153c89
- fix: weight the partial request's cached prefix in the mixed-step pass 1
  
  kangclzjc
  and
  claude
  committed
  a47d8de
- docs: qualify the --prefix mix-step, throughput and TTFT claims
  
  kangclzjc
  and
  claude
  committed
  df7fc8b
- fix(sdk): reject prefix >= isl before building the agg sweep grid
  
  kangclzjc
  and
  claude
  committed
  d802e9a
- fix(sdk): price whole-batch prefill steps without decode requests or TPOT weight
  
  kangclzjc
  and
  claude
  committed
  1f4c130