Add metric comparison helpers for FT tests - #1410

Merged

fzyzcjy merged 28 commits into

mainfrom

tom/pr_chain/trainer_ft/dev_revert_reversed/add-metric-comparison-helpers-for-ft-tests

Jul 10, 2026

Commits on Jul 10, 2026

Add a deterministic_random reward type
fzyzcjy
committed
96eecb4
Add an inplace_modify_args context manager
fzyzcjy
committed
2c1d4a7
Add fault-tolerance support tweaks to shared utilities
fzyzcjy
committed
7b00c75
Preserve the process-group backend across reload
fzyzcjy
committed
635aa50
Add fault-tolerance foundation utilities
fzyzcjy
committed
7a33a63
Add structured logfmt logging helper
fzyzcjy
committed
8dc8ddd
Add a Clock abstraction with a fake clock for tests
fzyzcjy
committed
96d220f
Add a fault injector test utility
fzyzcjy
committed
a005a2f
Add control-server data models
fzyzcjy
committed
8365971
Add a cell health checker and heartbeat utilities
fzyzcjy
committed
e308821
Add the fault-tolerance dependency, CI label, and logger-config setup
fzyzcjy
committed
4a52fcf
Always reconnect rollout engines on weight-update setup
fzyzcjy
committed
2ed9fcf
Add a fault-injection RPC to train actors
fzyzcjy
committed
a838a0b
Delay splitting train data by DP until actor-side processing
fzyzcjy
committed
c7798b5
Add a deterministic NCCL backend for order-stable collectives
fzyzcjy
committed
d0b41fc
Add a per-process identity helper
fzyzcjy
committed
a48d03f
Add structured event models keyed by per-process identity
fzyzcjy
committed
3e85a86
Add structured event logging keyed by per-process identity
fzyzcjy
committed
dc11be3
Add event-log snapshot and restore checkpointing
fzyzcjy
committed
691e4a7
Log training metrics as MetricEvents through the event logger
fzyzcjy
committed
5a91150
Add the witness id allocator
fzyzcjy
committed
34fb714
Trace witness ids through the model via injected witness parameters
fzyzcjy
committed
fd3bc9c
Add event-log checksum-consistency analysis rules
fzyzcjy
committed
85f120b
Add an event-log witness-tracing analysis rule
fzyzcjy
committed
5b5c797
Add the event-log analyzer that applies analysis rules
fzyzcjy
committed
493ef68
Add dump and inference-engine-checksum comparison helpers for FT tests
fzyzcjy
committed
81b95c4
Add metric comparison helpers for FT tests
fzyzcjy
committed
71d38e2
Merge remote-tracking branch 'origin/main' into tom/pr_chain/trainer_ft/dev_revert_reversed/add-metric-comparison-helpers-for-ft-tests
fzyzcjy
committed
ffe1109

Navigation Menu

Uh oh!

Add metric comparison helpers for FT tests - #1410

Add metric comparison helpers for FT tests#1410
fzyzcjy merged 28 commits into
mainfrom
tom/pr_chain/trainer_ft/dev_revert_reversed/add-metric-comparison-helpers-for-ft-tests

Commits on Jul 10, 2026

Add a deterministic_random reward type

Add an inplace_modify_args context manager

Add fault-tolerance support tweaks to shared utilities

Preserve the process-group backend across reload

Add fault-tolerance foundation utilities

Add structured logfmt logging helper

Add a Clock abstraction with a fake clock for tests

Add a fault injector test utility

Add control-server data models

Add a cell health checker and heartbeat utilities

Add the fault-tolerance dependency, CI label, and logger-config setup

Always reconnect rollout engines on weight-update setup

Add a fault-injection RPC to train actors

Delay splitting train data by DP until actor-side processing

Add a deterministic NCCL backend for order-stable collectives

Add a per-process identity helper

Add structured event models keyed by per-process identity

Add structured event logging keyed by per-process identity

Add event-log snapshot and restore checkpointing

Log training metrics as MetricEvents through the event logger

Add the witness id allocator

Trace witness ids through the model via injected witness parameters

Add event-log checksum-consistency analysis rules

Add an event-log witness-tracing analysis rule

Add the event-log analyzer that applies analysis rules

Add dump and inference-engine-checksum comparison helpers for FT tests

Add metric comparison helpers for FT tests

Merge remote-tracking branch 'origin/main' into tom/pr_chain/trainer_ft/dev_revert_reversed/add-metric-comparison-helpers-for-ft-tests