Add math modality benchmarking support - #1604

Merged

sarahyurick merged 9 commits into

NVIDIA-NeMo:mainfrom

ronjer30:math-benchmark-fixes

Apr 2, 2026

Commits on Apr 2, 2026

Add math modality benchmarking support with three scoped entries
ronjer30
committed
27f2873
Address PR review comments: thread safety, executor choices, and download refactor
ronjer30
committed
468de8c
Update boto3 version constraints and optimize JSONL processing in math_pipeline_benchmark.py
ronjer30
committed
35b473a
Minor refactor metrics computation in math_pipeline_benchmark.py to improve performance
ronjer30
committed
9a75160
Address review comments, add CC Index lookup benchmark and harden math benchmarking pipeline
ronjer30
committed
681a689
Fix benchmark script robustness for module loading and metric aggregation.
ronjer30
committed
eff7a71
Update nightly benchmark config and related script to set default to Xenna executor
ronjer30
committed
77cd985
Add data integrity requirements to math benchmark entries and rename output rows metric
ronjer30
committed
db431b1
Address review comments
ronjer30
committed
40c847a