(MOT-4279) test(harness): validate shell coder and sandbox workflow - #635
Merged
Conversation
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
|
Caution Review failedThe pull request is closed. ℹ️ Recent review info⚙️ Run configurationConfiguration used: Organization UI Review profile: CHILL Plan: Pro Plus Run ID: 📒 Files selected for processing (10)
📝 WalkthroughWalkthroughAdds a ChangesShell coder sandbox E2E flow
Estimated code review effort: 4 (Complex) | ~45 minutes Sequence Diagram(s)sequenceDiagram
participant E2E Runner
participant Engine
participant Coder
participant Shell
participant Sandbox
E2E Runner->>Engine: Send shell_coder_sandbox prompt
Engine->>Engine: Expose worker::add
Engine->>Coder: Install coder worker
Engine->>Shell: Install shell worker
Coder->>Coder: Create, update, move, and read Python file
Shell->>Shell: Execute final Python file on host
E2E Runner->>Sandbox: Create isolated Python sandbox
Sandbox->>Sandbox: Execute Python and return stdout
E2E Runner->>Sandbox: List and stop sandbox
Possibly related PRs
Suggested labels: Poem
✨ Finishing Touches📝 Generate docstrings
🧪 Generate unit tests (beta)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
Contributor
skill-check — worker0 verified, 49 skipped (no docs/).
Four for four. Nicely done. |
ytallo
marked this pull request as ready for review
July 29, 2026 23:20
This was referenced Jul 30, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
shell_coder_sandboxreal-model E2E scenarioWhy
The quality suite did not exercise a full coding workflow across dynamically installed workers and an isolated microVM. This left worker readiness, cross-surface coordination, exact file mutations, and sandbox teardown without real-model regression coverage.
Impact
The new scenario becomes part of the code-defined CI matrix. It fails when the model skips or reorders required operations, uses the wrong execution surface, produces unexpected output, leaves a sandbox running, or records any function-call error.
Validation
cargo test -p harness-e2e(55 passed)bash -n tests/e2e/run-ci.shgit diff --checkFixes MOT-4279
Summary by CodeRabbit
New Features
Bug Fixes
Documentation