fix(cu): bind Maka Computer actions to observed window captures - #699

Closed

hqhq1025 wants to merge 73 commits into

apache:mainfrom

hqhq1025:feat/cu-runtime-helper

Commits on Jul 7, 2026

feat(core): add Computer Use shared types (PR-CORE-CU-0)
hqhq1025
committed
f8baf10

Commits on Jul 8, 2026

feat(desktop): Phase-1 Computer Use AX dispatch helper (PR-RUNTIME-CU wip)
hqhq1025
committed
fb34b02
feat(runtime): computer_use permission category + `computer` tool + dispatch seam (PR-RUNTIME-CU)
hqhq1025
committed
e9d9afa
feat(desktop): CuDispatchBackend that spawns the Swift helper over NDJSON (PR-RUNTIME-CU)
hqhq1025
committed
6c4a8a3
feat(runtime): computer tool image output + S16 redaction + unsupported_action code
hqhq1025
committed
703732b
feat(desktop): cua-driver computer-use backend — wired end-to-end + review-hardened
hqhq1025
committed
1fc4c5b
docs(desktop): correct cua-driver keyboard fail-closed rationale (live e2e)
hqhq1025
committed
fb103c1
feat(desktop): port cua/Codex agent-cursor engine (Dubins glide + spring + palette)
hqhq1025
committed
025d0c6
feat(desktop): Maka-owned cursor overlay window hosting the ported engine
hqhq1025
committed
d95d031
feat(desktop): drive the agent-cursor overlay from real computer-use actions
hqhq1025
committed
e49cd06
build(desktop): wire cursor overlay into build + dev pipeline
hqhq1025
committed
0424b0e
fix(ui): add missing computer_use preset to permission dialog REASON_PRESETS
hqhq1025
committed
365d9f5
fix(desktop): make computer-use actually reachable in the real dev app + e2e harness
hqhq1025
committed
4d3328b
fix(desktop): fail closed on cua-driver click/scroll — desktop-scope WARPS the real cursor
hqhq1025
committed
9ff0667
chore(desktop): broaden CU e2e harness — multi-scenario suite + overlay coord logging
hqhq1025
committed
a9c0add
feat(desktop): no-warp click via window-at-point pid targeting (restores safe clicking)
hqhq1025
committed
449166a
fix(desktop): kill the duplicate cua cursor + raise frame cap for Retina screenshots
hqhq1025
committed
78ff21c

Commits on Jul 9, 2026

Commits on Jul 11, 2026

fix(cu): make background input focus-safe
hqhq1025
committed
5024aa0
Merge remote-tracking branch 'origin/main' into feat/cu-runtime-helper
hqhq1025
committed
675e039
docs(cu): record verified background boundary
hqhq1025
committed
5b85e9e
docs(cu): close PR verification checklist
hqhq1025
committed
b3b8ddf
fix(cu): target Electron pages exactly
hqhq1025
committed
9410dd7
Merge remote-tracking branch 'origin/main' into feat/cu-runtime-helper
hqhq1025
committed
2338fbb
docs(cu): record semantic verification
hqhq1025
committed
67a1fe1
docs(cu): close semantic rollout
hqhq1025
committed
26f5261

Commits on Jul 12, 2026

fix(cu): sync cursor to completed actions
hqhq1025
committed
70393f7
Merge remote-tracking branch 'origin/main' into feat/cu-runtime-helper
hqhq1025
committed
dd4b22e
Revert "fix(cu): sync cursor to completed actions"
hqhq1025
committed
1f8a4c7
docs(cu): split backend and model-loop work
hqhq1025
committed
dd45d5d
Merge remote-tracking branch 'origin/main' into feat/cu-runtime-helper
hqhq1025
committed
8662daf
feat(cu): add MiniMax frame adapter
hqhq1025
committed
f104d80
feat(runtime): add OpenAI computer use loop core
hqhq1025
committed
f49bc39
feat(cu): add provider-specific model loop harnesses
hqhq1025
committed
c83a8c7
Merge branch 'feat/cu-runtime-helper' into feat/cu-real-model-loop
hqhq1025
committed
d8d03d3
Merge remote-tracking branch 'origin/main' into feat/cu-real-model-loop
hqhq1025
committed
6dc8ba1
fix(cu): preserve cursor completion API after backend merge
hqhq1025
committed
34f4509
feat(runtime): add OpenAI Responses transport
hqhq1025
committed
c5d7ba6
feat(runtime): add CUA frame state identity
hqhq1025
committed
682ed68
feat(runtime): add OpenAI computer backend
hqhq1025
committed
47e05a0
feat(cu): add provider E2E matrix reporting
hqhq1025
committed
0a297a4
test(cu): add focus and cursor safety sentinel
hqhq1025
committed
ae5b3fc
feat(cu): validate OpenAI model loops through Maka runtime
hqhq1025
committed
a30f16d
test(cu): add layered E2E scenario fixtures
hqhq1025
committed
729b8e1
test(cu): add layered provider model-loop validation
hqhq1025
committed
a4fd5ca
feat(cu): align provider harnesses with Codex lab
hqhq1025
committed
7c15270
feat(cu): add unified Maka Computer harness
hqhq1025
committed
8c7fd28
Merge remote-tracking branch 'origin/main' into feat/cu-real-model-loop
hqhq1025
committed
db97828
test(cu): define Maka Sky layered contracts
hqhq1025
committed
f4b0ca7
feat(cu): bind Maka observations to runtime actions
hqhq1025
committed
c674ad4
feat(cu): bind semantic actions to window captures
hqhq1025
committed
9b5e874
fix(cu): keep coordinate authority capture-local
hqhq1025
committed
675433d
Merge origin/main into feat/cu-runtime-helper
hqhq1025
committed
2830522
fix(cu): harden bound action dispatch
hqhq1025
committed
051216c
build(cu): pin merged cua-driver compatibility release
hqhq1025
committed
3d64e29
test(desktop): wait for attachment-ready composer
hqhq1025
committed
e19eeb4
Merge remote-tracking branch 'origin/main' into codex/pr699-final
hqhq1025
committed
da5d999
Merge origin/main into feat/cu-runtime-helper
hqhq1025
committed
0f59878
fix(cu): bind adapted actions to source frame
hqhq1025
committed
51e2e1d