chore: add v1 end-to-end eval test suite - #1609

Merged

mikasenghaas merged 11 commits into

feat/nano-as-v1from

chore/v1-e2e-tests

Jun 10, 2026

Commits on Jun 10, 2026

chore(v1): add end-to-end eval test suite under tests/v1

mikasenghaas
and
claude
committed
4930a4a
chore(v1): move fixture tasksets to tests/v1/fixtures; add cross-harness tests

mikasenghaas
and
claude
committed
48aef53
chore(v1): satisfy ruff (E731 lambda -> def, ruff format)

mikasenghaas
and
claude
committed
1765494
chore(v1): merge harness+runtime into one matrix; gate tools on SUPPORTS_TASK_TOOLS

mikasenghaas
and
claude
committed
e047bc8
chore(v1): self-contained v0 legacy tests via echo fixtures; inline run helpers

mikasenghaas
and
claude
committed
e1ad887
Merge remote-tracking branch 'origin/feat/nano-as-v1' into chore/v1-e2e-tests
mikasenghaas
committed
ccc09ff
test(v1): adapt legacy shape test to #1606 message-graph (trajectory -> nodes)

mikasenghaas
and
claude
committed
73dd43d
feat(v1): SUPPORTS_USER_SIM harness flag + container-safe multi-turn user-sim fixture

mikasenghaas
and
claude
committed
044829a
fix(v1): run the user simulator in its own runtime, reached host-side

mikasenghaas
and
claude
committed
e605edf
test(v1): matrix task-tools + user-sim across server runtimes

mikasenghaas
and
claude
committed
476eed3
test(v1): rename agentic-echo fixture -> echo-agentic-v1 (echo_* naming)

mikasenghaas
and
claude
committed
c4f8300