feat(core): report infrastructure failure from verify, not just a reward - #2611

Merged

yuhezhang-ai merged 7 commits into

NVIDIA-NeMo:mainfrom

waple0820:feat/verify-response-mask-sample

Sep 18, 2026

Commits on Sep 15, 2026

feat(core): report infrastructure failure from verify, not just a reward
waple0820
committed
d6d3120
feat(core): count environment-reported masking in the progress metrics
waple0820
committed
e0c685e
fix(core): exclude masked samples from the evaluation score, not just telemetry
waple0820
committed
b452126
feat(core): report failure_kind from the shared vocabulary
waple0820
committed
a1c31cf
fix(core): apply masking on the consumer paths, not only in aggregation
waple0820
committed
d75682b
fix(core): keep completeness and coverage honest under masking
waple0820
committed
3a88965
test: update server expectations for the new contract fields
waple0820
committed
ca37a95