[WIP] add SWE-bench Lite accuracy eval / 添加 SWE-bench Lite 准确率评估 - #1947

Merged

adibarra merged 52 commits into

mainfrom

feat/swebench-lite-eval

Jul 17, 2026

GitHub Advanced Security / CodeQL succeeded Jul 17, 2026 in 3s

2 new alerts including 2 medium severity security vulnerabilities

New alerts in code changed by this pull request

Security Alerts:

2 medium

See annotations below for details.

View all branch alerts.

Annotations

Check warning on line 287 in .github/workflows/e2e-tests.yml

Code scanning / CodeQL

Workflow does not contain permissions Medium

Actions job or workflow does not limit the permissions of the GITHUB_TOKEN. Consider setting an explicit permissions block, using the following as a minimal starting point: {}

Check warning on line 426 in .github/workflows/e2e-tests.yml

Code scanning / CodeQL

Workflow does not contain permissions Medium

Actions job or workflow does not limit the permissions of the GITHUB_TOKEN. Consider setting an explicit permissions block, using the following as a minimal starting point: {}