Skip to content

Teach the dashboard and the CI checkers the policy namespace - #2649

Open
fzyzcjy wants to merge 1 commit into
tom/refactor-miles/op28-24from
tom/refactor-miles/op28-25
Open

Teach the dashboard and the CI checkers the policy namespace#2649
fzyzcjy wants to merge 1 commit into
tom/refactor-miles/op28-24from
tom/refactor-miles/op28-25

Conversation

@fzyzcjy

@fzyzcjy fzyzcjy commented Aug 18, 2026

Copy link
Copy Markdown
Collaborator

Part of #1837

@claude claude Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Claude Code Review

This repository is configured for manual code reviews. Comment @claude review for a one-time review, or @claude review always to subscribe this PR to a review on every future push.

Tip: disable this comment in your organization's Code Review settings.

This was referenced Aug 25, 2026
This was referenced Aug 27, 2026
@fzyzcjy
fzyzcjy force-pushed the tom/refactor-miles/op28-25 branch from 4892069 to 80dac03 Compare August 28, 2026 11:42
@fzyzcjy
fzyzcjy force-pushed the tom/refactor-miles/op28-24 branch 2 times, most recently from 5d96759 to 5b408d6 Compare August 28, 2026 12:38
@fzyzcjy
fzyzcjy force-pushed the tom/refactor-miles/op28-25 branch 2 times, most recently from 239634a to 7a76cb7 Compare August 28, 2026 14:33
@fzyzcjy
fzyzcjy force-pushed the tom/refactor-miles/op28-24 branch from 02bc9d3 to c991a46 Compare August 28, 2026 15:04
@fzyzcjy
fzyzcjy force-pushed the tom/refactor-miles/op28-25 branch from 7a76cb7 to 662d788 Compare August 28, 2026 15:04
- Record which step key every metric was logged against, and answer it from `/api/meta`: a multi policy
  run writes `alpha/train/loss` against `alpha/train/step`, which the key-prefix rule the chart axis used
  cannot guess, so every namespaced curve was drawn against the wrong axis.
- Read the perf points of the bubble strip by suffix, since the strip keyed off the exact `perf/step_time`
  and a namespaced run left it empty.
- Strip the namespace before the in-process checkers read a metric: `check_kl` and the rollout log-prob
  check index `train/ppo_kl` and `rollout/log_probs`, and the CI history gate captures a fixed key list,
  so a namespaced run silently checked nothing at all.

- Cover both halves: the recorded step keys and the bubble lookup, and that the checkers see the names
  they are written against whichever policy produced the step.
@fzyzcjy
fzyzcjy force-pushed the tom/refactor-miles/op28-25 branch from 662d788 to 8ebe30e Compare August 28, 2026 18:20
@fzyzcjy
fzyzcjy force-pushed the tom/refactor-miles/op28-24 branch from c991a46 to 5c79908 Compare August 28, 2026 18:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant