Skip to content

test(sandbox): cover typed Fleet state verification - #3672

Merged
f-trycua merged 47 commits into
mainfrom
test/fleet-typed-verification-20260908
Sep 9, 2026
Merged

test(sandbox): cover typed Fleet state verification#3672
f-trycua merged 47 commits into
mainfrom
test/fleet-typed-verification-20260908

Conversation

@f-trycua

@f-trycua f-trycua commented Sep 9, 2026

Copy link
Copy Markdown
Collaborator

Scope

Refs #2512, #3654, and #3664. Test-only coverage for generated CuaDriver.verify_state through sandbox.driver.connect(). No public API or runtime behavior changes.

  • Check window identity, window and element predicates, session, bounded verification wait, stability, and screenshot-flag serialization.
  • Preserve typed Satisfied, Unsatisfied, and Unknown outcomes and predicate metadata. A successful exchange does not turn Unknown into Satisfied.
  • Prove that a closed connection refuses verification without another exchange.

Validation

  • Focused typed-driver tests: 53 pass with CUA_SANDBOX_REQUIRE_NATIVE_DRIVER=1, zero skipped. Black, Ruff, and whitespace checks pass.
  • The assembled candidate 43a332a66d8379b4fb9330c6a96f0654cc4afea1 includes these tests. Its contract and generated-binding workflow passes, including 237 Sandbox/native bridge regressions.
  • The same candidate passes Windows and Linux desktop matrices. Those are cumulative compatibility results, not live verification proof for this synthetic test.

Tests load candidate Sandbox source and matching native bindings. A missing required bridge fails instead of skipping. Final merge checks verify current head, source equivalence after ancestor updates, and review state.

Limits

These tests use synthetic Fleet service responses. They do not prove live guest accessibility/window observation, image qualification, or release readiness. Live typed verification remains a separate qualification gate.

No release, publication, deployment, or host installation is included. This PR changes only libs/python/cua-sandbox/tests/test_typed_driver_native.py.

trycua-release[bot] and others added 28 commits July 23, 2026 13:46
# Conflicts:
#	libs/cua-driver/rust/crates/cua-driver-sdk/src/lib.rs
@codecov-commenter

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!

f-trycua and others added 15 commits September 8, 2026 19:22
Co-authored-by: Francesco Bonacci <195596869+f-trycua@users.noreply.github.com>
* fix(sandbox): bound typed Driver lifecycle and request deadlines

* fix(cua-driver): allow explicit unrestricted envelope sessions

* docs(sandbox): clarify launcher-selected Driver permissions

---------

Co-authored-by: Francesco Bonacci <195596869+f-trycua@users.noreply.github.com>
@f-trycua
f-trycua changed the base branch from fix/driver-envelope-mode-20260908 to feat/sandbox-typed-driver-20260907 September 9, 2026 03:08
@f-trycua
f-trycua marked this pull request as ready for review September 9, 2026 03:09
@f-trycua
f-trycua requested a review from ddupont808 as a code owner September 9, 2026 03:09
@f-trycua
f-trycua changed the base branch from feat/sandbox-typed-driver-20260907 to main September 9, 2026 03:14
@f-trycua
f-trycua requested a review from injaneity as a code owner September 9, 2026 03:14
@f-trycua
f-trycua merged commit bd4c100 into main Sep 9, 2026
20 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants