feat(experimentalist): add a fast, diagnostic smoke agent fixture - #1089

Merged

gaiadilorenzo merged 52 commits into

mainfrom

experimentalist-smoke-agent-proposal/cschueller

Aug 13, 2026

Commits on Aug 13, 2026

feat(experimentalist): add a fast, diagnostic smoke agent fixture

schuellc-nvidia
authored and
Gaia Di Lorenzo
committed
95b258e
docs(experimentalist): document the model pair and platform URL the run needs

schuellc-nvidia
authored and
Gaia Di Lorenzo
committed
4d00ba0
fix(experimentalist): make g1 solvable by inference, not guesswork

schuellc-nvidia
authored and
Gaia Di Lorenzo
committed
3047691
fix(experimentalist): refuse a symlinked answer before scoring it

schuellc-nvidia
authored and
Gaia Di Lorenzo
committed
8d7e05c
refactor(experimentalist): run the smoke gates for two rounds, not one

schuellc-nvidia
authored and
Gaia Di Lorenzo
committed
a9cbbd2
fix(experimentalist): make the task template a first-class fixture asset

schuellc-nvidia
authored and
Gaia Di Lorenzo
committed
bddc03b
test(experimentalist): refuse to score a broken Insight suite

schuellc-nvidia
authored and
Gaia Di Lorenzo
committed
386f4d9
test(experimentalist): fail an Insight metric that cannot see the repair

schuellc-nvidia
authored and
Gaia Di Lorenzo
committed
bfb1fd8
test(experimentalist): clarify smoke agent guards
Gaia Di Lorenzo
committed
3ef5232
test(experimentalist): simplify smoke test docstrings
Gaia Di Lorenzo
committed
13572da
chore : fix reasoning effort
Gaia Di Lorenzo
committed
ac3cf0d
test(experimentalist): add mode 1 smoke loop coverage
Gaia Di Lorenzo
committed
ccfec80
chore: test mode 2
Gaia Di Lorenzo
committed
7f9849c
test(experimentalist): add mode 2 smoke loop coverage
Gaia Di Lorenzo
committed
41fe459
test(experimentalist): consolidate mode 1 smoke checks
Gaia Di Lorenzo
committed
a710af4
test(experimentalist): expand mode 1 insight evidence
Gaia Di Lorenzo
committed
7ad86d4
test(experimentalist): extend mode 2 smoke timeout
Gaia Di Lorenzo
committed
ed186c9
test(experimentalist): use terra and luna for smoke loops
Gaia Di Lorenzo
committed
e589739
chore: allow empty datasets
Gaia Di Lorenzo
committed
904ed70
chore: remove duplicate cache
Gaia Di Lorenzo
committed
4b35cae
chore: up eval author tasks to 5
Gaia Di Lorenzo
committed
c193453
chore: allow empty datasets
Gaia Di Lorenzo
committed
6d47005
test(experimentalist): require a sandbox for the smoke E2E loops

schuellc-nvidia
authored and
Gaia Di Lorenzo
committed
4ad20b1
test(experimentalist): run smoke loops in sandbox
Gaia Di Lorenzo
committed
0ca530f
chore: revert unneeded request timeout
Gaia Di Lorenzo
committed
0e96918
chore: revert unrelated change
Gaia Di Lorenzo
committed
9c0d88e
chore: revert unrelated change
Gaia Di Lorenzo
committed
7eb6fd6
chore: revert unwanted change
Gaia Di Lorenzo
committed
c729767
test(experimentalist): isolate smoke E2E runs
Gaia Di Lorenzo
committed
635334b
chore: remove unused model client import
Gaia Di Lorenzo
committed
9f22d68
chore(experimentalist): remove unused smoke test tools
Gaia Di Lorenzo
committed
b9b3525
test(experimentalist): share smoke runs across assertions
Gaia Di Lorenzo
committed
74a92ef
chore: assume existing sandbox
Gaia Di Lorenzo
committed
1e5cc91
chore(tests): increase e2e test timeouts
Gaia Di Lorenzo
committed
c25e501
docs: update example aent to smoke agent
Gaia Di Lorenzo
committed
1356c79
fix(experimentalist): finalize when no improvements remain
Gaia Di Lorenzo
committed
8106afb
docs(experimentalist): explain smoke scenario
Gaia Di Lorenzo
committed
74c9f25
refactor(experimentalist): render smoke tasks from manifest
Gaia Di Lorenzo
committed
5144fcc
fix(experimentalist): target full smoke objectives
Gaia Di Lorenzo
committed
f46146a
docs(experimentalist): correct the smoke-agent weakness reference

schuellc-nvidia
authored and
Gaia Di Lorenzo
committed
8bedf2a
fix(experimentalist): address smoke agent review feedback
Gaia Di Lorenzo
committed
d6f2f2d
test(experimentalist): report both digests when the task tree changes

schuellc-nvidia
authored and
Gaia Di Lorenzo
committed
ce54161
docs(experimentalist): reunite the smoke-agent headings with their content

schuellc-nvidia
authored and
Gaia Di Lorenzo
committed
5b5bc5f
chore: remove internal details
Gaia Di Lorenzo
committed
d3e3660
docs(experimentalist): clarify smoke agent setup
Gaia Di Lorenzo
committed
0b212ad
refactor(experimentalist): consolidate smoke fixture docs
Gaia Di Lorenzo
committed
7aab5ac
docs: simplify getting started guide
Gaia Di Lorenzo
committed
1e56719
docs(experimentalist): keep the fuller smoke-fixture README

schuellc-nvidia
authored and
Gaia Di Lorenzo
committed
95ffeee
docs: revert the walkthorugh
Gaia Di Lorenzo
committed
f2292ad
fix(experimentalist): repair full-suite test collection
Gaia Di Lorenzo
committed
6aa685f
Merge branch 'main' into experimentalist-smoke-agent-proposal/cschueller
gaiadilorenzo
authored
b3e18cd
Merge branch 'main' into experimentalist-smoke-agent-proposal/cschueller
gaiadilorenzo
authored
38e225b