Repository navigation

feat(rccl): score the madengine gate against a same-node baseline - #12899

Merged

i-kosarev merged 27 commits into

developfrom

ci/madengine-same-node-ab

Oct 30, 2026

Merged

feat(rccl): score the madengine gate against a same-node baseline#12899
i-kosarev merged 27 commits into
developfrom
ci/madengine-same-node-ab

Commits on Oct 26, 2026
- fix(rccl): score madengine training runs on the running-average throughput
  
  mkuznet1
  and
  cursoragent
  authored
  ee4ea1a
- fix(rccl): point llama-4-scout at its own multiple_results CSV
  
  mkuznet1
  and
  cursoragent
  authored
  1226015
- feat(rccl): score the madengine gate against a same-node baseline
  
  mkuznet1
  and
  cursoragent
  authored
  4d0a68a
- ci(rccl): bump the madengine pin to 10a0414 (madengine#213)
  
  mkuznet1
  and
  cursoragent
  authored
  ec19e97
- ci(rccl): run madengine from a conda env the compute nodes can execute
  
  mkuznet1
  and
  cursoragent
  authored
  4cb6bbd
- ci(rccl): name the baseline and candidate RCCL builds in the madengine summary
  
  mkuznet1
  and
  cursoragent
  authored
  2bd3dae
- ci(rccl): upload the madengine results from each A/B phase directory
  
  mkuznet1
  and
  cursoragent
  authored
  84a5816
- ci(rccl): pin madengine at #213 rebased on #190; drop the template patch
  
  mkuznet1
  and
  cursoragent
  authored
  d0fdac6
- fix(rccl): give each A/B phase the allocation's time limit
  
  mkuznet1
  and
  cursoragent
  authored
  81523a9
- ci(rccl): pin madengine on ROCm develop and MAD on the current mad-rccl
  
  mkuznet1
  and
  cursoragent
  authored
  165ec7c
- fix(rccl): fail the A/B when an expected precision is missing from both phases
  
  mkuznet1
  and
  cursoragent
  authored
  02fe825
- fix(rccl): keep each workload's archived results apart; lock the datastore
  
  mkuznet1
  and
  cursoragent
  authored
  dfc2388
- docs(rccl): state what the madengine gate does, not how it got there
  
  mkuznet1
  and
  cursoragent
  authored
  c27329f
- fix(rccl): cancel the allocation when the A/B times out
  
  mkuznet1
  and
  cursoragent
  authored
  f85ed45
- fix(rccl): expect BF16 from llama-4-scout too
  
  mkuznet1
  and
  cursoragent
  authored
  bb20fbc
- fix(rccl): keep conda and pip out of the runner account's home
  
  mkuznet1
  and
  cursoragent
  authored
  76fe419
- fix(rccl-ci): build the madengine overlay only on the compute nodes
  
  mkuznet1
  and
  cursoragent
  authored
  7cd9603
- fix(rccl-ci): tighten the same-node A/B gate and its cleanup
  
  mkuznet1
  and
  cursoragent
  authored
  36b8720
- fix(rccl-ci): never pull an image to clean up a node workspace
  
  mkuznet1
  and
  cursoragent
  authored
  3abc26e
- style(rccl-ci): trim comments to the constraints they state
  
  mkuznet1
  and
  cursoragent
  authored
  9827ce5
Commits on Oct 29, 2026
- fix(rccl-ci): give the nodes back when the driver is interrupted
  i-kosarev
  committed
  19be2de
- ci(rccl): release the allocation from a step the runner itself starts
  i-kosarev
  committed
  614ff32
Commits on Oct 30, 2026
- fix(rccl-ci): kill the allocation's group even if scancel is interrupted
  
  i-kosarev
  and
  claude
  committed
  31d4b5d
- fix(rccl-ci): cancel a still-queued allocation, and never score stale results
  
  i-kosarev
  and
  claude
  committed
  2e990a0
- feat(rccl-ci): score the A/B ratio against the previous run's ratio too
  
  i-kosarev
  and
  claude
  committed
  a629835
- fix(rccl-ci): take only a passing run's ratio as the reference
  
  i-kosarev
  and
  claude
  committed
  453c3ea
- fix(rccl-ci): key the previous-run reference on the base image too
  
  i-kosarev
  and
  claude
  committed
  c0e4d6d

Commits

Commits on Oct 26, 2026

Commits on Oct 29, 2026

Commits on Oct 30, 2026