Support mini-swe-agent as agent harness#1212

Merged

wasiahmad merged 104 commits intomainfrom

Feb 16, 2026

Commits on Nov 29, 2025

some support
wasiahmad
committed

Commits on Dec 22, 2025

fixing a minor bug
wasiahmad
committed

Commits on Feb 4, 2026

Add HMMT Nov 2025 dataset (#1061)

i-vainn
authored and
wasiahmad
committed
Use docker build cache (#1056)

gwarmstrong
authored and
wasiahmad
committed
ci: Add CodeRabbit configuration file (#1063)

authored and
wasiahmad
committed
FIX integration tests by escaping aalcr and adding judge args (#1062)

gwarmstrong
authored and
wasiahmad
committed
ENH add tool calling args (#1067)

gwarmstrong
authored and
wasiahmad
committed
Fix sglang tool calling (#1070)

gwarmstrong
authored and
wasiahmad
committed
Network Blocking for Sandbox Code Execution (#1071)

gwarmstrong
authored and
wasiahmad
committed
Fixes to support SWE-bench Multilingual (#1064)

ludwig-n
authored and
wasiahmad
committed
fix: IFBench error handling and build improvements (#1073)

gwarmstrong
authored and
wasiahmad
committed
FIX math verify handle leading zeros and int literals cases (#1074)

gwarmstrong
authored and
wasiahmad
committed
build: move data preparation to beginning of gpu tests build (#1077)

gwarmstrong
authored and
wasiahmad
committed
MAINT update langugage-data dependency (#1076)

gwarmstrong
authored and
wasiahmad
committed
MAINT: Add audio requirements to vllm image (#1081)

gwarmstrong
authored and
wasiahmad
committed
Add apex-shortlist dataset (#1080)

authored and
wasiahmad
committed
Introduce regex for small differences of formatting from judge (#1082)

authored and
wasiahmad
committed
Add LCB Prompts, fix regex bug in robust_eval, remove CR, make summarize_robustness generic for more benchmarks, update docstrings. (#1079)

gnalbandyan
authored and
wasiahmad
committed
MAINT pin nemo-evaluator (#1095)

gwarmstrong
authored and
wasiahmad
committed
Update issue templates

gwarmstrong
authored and
wasiahmad
committed
Delete .github/ISSUE_TEMPLATE directory

gwarmstrong
authored and
wasiahmad
committed
enable blank issues (#1096)

gwarmstrong
authored and
wasiahmad
committed
Fix input_file path handling when executor is "none" (#1089)

bzantium
authored and
wasiahmad
committed
TST for #1089 (#1097)

gwarmstrong
authored and
wasiahmad
committed
Stepheng/prover cleanup (#1078)

authored and
wasiahmad
committed
add stem dependencies in main python sandbox (#1099)

authored and
wasiahmad
committed
Audiometrics unification (#1093)

authored and
wasiahmad
committed
FEAT Add Tavily Search (#1085)

authored and
wasiahmad
committed
updating code extraction logic (#1086)

wasiahmad
and
gwarmstrong
committed
Sandbox add stem (#1101)

authored and
wasiahmad
committed
Handle none output in wmtp24++ (#1091)

authored and
wasiahmad
committed
ENH enable sandbox env overrides in generate (#1107)

gwarmstrong
authored and
wasiahmad
committed
Search Tool Parameter updates (#1112)

gwarmstrong
authored and
wasiahmad
committed
autoformalize cleanup (#1098)

authored and
wasiahmad
committed
HF ASR Leaderboard Evaluation (#1104)

authored and
wasiahmad
committed
Stepheng/nemotron math proofs docs (#1111)

stephencge
authored and
wasiahmad
committed
Stepheng/prover gpt oss fix (#1114)

stephencge
authored and
wasiahmad
committed
add Nemotron-Math-V2.pdf (#1113)

authored and
wasiahmad
committed
SWE-bench: don't pass external environment variables into Apptainer containers (#1116)

ludwig-n
authored and
wasiahmad
committed
Adding clan PR with AudioBench and Librispeech PC. (#1103)

Jorjeous
authored and
wasiahmad
committed
Schema overrides for tool-calling (#1118)

gwarmstrong
authored and
wasiahmad
committed
FIX tool call error handling and search tool errors (#1120)

gwarmstrong
authored and
wasiahmad
committed
Use run.Script for generate pipeline (#1052)

gwarmstrong
authored and
wasiahmad
committed
Port ICPC changes to IOI (#1046)

authored and
wasiahmad
committed
replace raise error with LOG.warning in AA LCR dataset prepare (#1119)

authored and
wasiahmad
committed
FIX tavily search results return type (#1123)

gwarmstrong
authored and
wasiahmad
committed
Revert "Use run.Script for generate pipeline (#1052)" (#1125)

gwarmstrong
authored and
wasiahmad
committed
Fix: add serialized_output on bad request (#1127)

gwarmstrong
authored and
wasiahmad
committed
update paper link (#1128)

wedu-nvidia
authored and
wasiahmad
committed
update paper link, references to dataset, self-correction differences (#1129)

stephencge
authored and
wasiahmad
committed
FIX ioi ignore (#1131)

gwarmstrong
authored and
wasiahmad
committed
download AA-LCR_extracted-text.zip via hf_hub_download (#1126)

authored and
wasiahmad
committed
Evaluation on Livecodebench-pro (#1115)
wasiahmad
committed
Evaluation support for SWE-rebench (#1102)

committed
Trust remote code in tokenizer (#1146)

authored and
wasiahmad
committed
Merge branch 'main' into mini_swe_agent
wasiahmad
committed
adding mini-swe-agent in generation-task
wasiahmad
committed
updating mini-swe-agent cmd
wasiahmad
committed
updating mini-swe-agent cmd
wasiahmad
committed
updating mini-swe-agent cmd
wasiahmad
committed
updating mini-swe-agent cmd
wasiahmad
committed
updating mini-swe-agent cmd
wasiahmad
committed
updating mini-swe-agent cmd
wasiahmad
committed
updating mini-swe-agent cmd
wasiahmad
committed
updating mini-swe-agent cmd
wasiahmad
committed
updating mini-swe-agent cmd
wasiahmad
committed
updating mini-swe-agent cmd
wasiahmad
committed
updating mini-swe-agent cmd
wasiahmad
committed

Commits on Feb 5, 2026

Commits on Feb 10, 2026

Commits on Feb 16, 2026

Merge branch 'main' into mini_swe_agent
wasiahmad
authored