Repository navigation
Token stack inside native Codex sessions: 11/15 tools with passing checks, four real limits, and a correction to #296's QMD row - #343
Merged
Conversation
…s QMD row Codex side of #296: one native `codex exec` session per tool (codex-cli 0.155.1, gpt-6-astra, effort max) in a dedicated worktree, using RTK's standing instructions, the Context Mode plugin, the #289 user-scope MCP servers and the CLIs. 11 of 15 tools pass their answer checks; RTK +17782 saved for the run-only worktree; nine exact o200k comparisons from 28.2% to 99.8%; Codex-returned usage 7,085,015 input (6,253,312 cached) and 164,906 output over 17 sessions. The four failures are real limits: jCodeMunch is project-scoped (#240), QMD's catalog index excludes adoption/, Repomix --compress dropped a declaration, Context Hub lacks the upstream facts. #296's QMD PASS retrieved a wrong document for its question; its README now says so. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
You have reached your Codex usage limits for code reviews. You can see your limits in the Codex usage dashboard. |
Codex review (gpt-6-astra, read-only) confirmed every number and evidence class and asked for three fixes: replace the live-clone path, the session-derived codebase-memory project id and the SocratiCode collection id with placeholders, and state the QMD document count per attempt (121, then 122 as the live index grew). Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Owner
Author
|
Cross-family review, Codex gpt-6-astra, read-only, effort high. needs_changes → fixed. Every README and docs number matches receipt.json, the usage totals sum correctly, and the evidence classes, the four failure descriptions and the #296 QMD correction are all supported. It found three receipt defects:
All three are fixed in the latest commit. The receipt now scans clean (0 matches for those paths and ids), and validate and the evidence manifest pass. |
seathatflowsinourveins
pushed a commit
that referenced
this pull request
Sep 27, 2026
…asks, metrics, gate, procedure) Freezes the E2E preregistration half of full-save/PLAN.md step 9 (the baseline-receipt half already merged via #369) before any organic run: 77 frozen task definitions (16 reused Claude + 15 reused Codex information needs from #296/#343's receipts, 46 seeded/control tasks), every AA §8.3 metric/threshold/guardrail/outcome rule with its three "proposed" bounds now stated as frozen, the AA §8.1b capability gate, the AA §8.4 procedure, the AA §8.5 overturn conditions, the identity scheme, the Q1 blind-process qualification, the Workflow script that will run arms B/A/A0 (syntax-checked only, never executed), and the measurement runbook. Corrected on independent Claude review (11 findings, 95 turns) and a GPT-6 cross-family review (2 findings, 1 high) plus one combined repair round (13/13 addressed with failing-first evidence): relocated from blueprints/token-practice-e2e/ to evidence/artifacts/token-adoption-e2e-20260926/ per adoption-audit/PLAN.md line 402; moved the Workflow script out of examples/claude-native/workflows/ to avoid that directory's shared PACKET/ROUTING contract test, which this one-off frozen script correctly does not match; corrected PR-A's status (its base branch merged as #369 -- baseline only, tooling-fix scope still open); added the six AA §6 machine-readable policy fields the JSON was missing; fixed a wrong Codex arm-A lifecycle binding; blocked the one information need (an otel-tui receiver task) that no current role may legally run, pending a named permitted role; froze the coordinator's own main-dispatch task at xhigh instead of max; fixed a denylist word-boundary gap that let underscore-qualified MCP names slip past; and sealed the five normative files' SHA256 with an append-only amendment rule. Also refreshes PR #376 and #364's status to merged (both landed while this unit was in review), while recording that #364's field-preservation gap (workflow.run_id/tool_use_id still missing from collector.yaml) persists after its merge. Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
seathatflowsinourveins
added a commit
that referenced
this pull request
Sep 27, 2026
…asks, (#381) metrics, gate, procedure) Freezes the E2E preregistration half of full-save/PLAN.md step 9 (the baseline-receipt half already merged via #369) before any organic run: 77 frozen task definitions (16 reused Claude + 15 reused Codex information needs from #296/#343's receipts, 46 seeded/control tasks), every AA §8.3 metric/threshold/guardrail/outcome rule with its three "proposed" bounds now stated as frozen, the AA §8.1b capability gate, the AA §8.4 procedure, the AA §8.5 overturn conditions, the identity scheme, the Q1 blind-process qualification, the Workflow script that will run arms B/A/A0 (syntax-checked only, never executed), and the measurement runbook. Corrected on independent Claude review (11 findings, 95 turns) and a GPT-6 cross-family review (2 findings, 1 high) plus one combined repair round (13/13 addressed with failing-first evidence): relocated from blueprints/token-practice-e2e/ to evidence/artifacts/token-adoption-e2e-20260926/ per adoption-audit/PLAN.md line 402; moved the Workflow script out of examples/claude-native/workflows/ to avoid that directory's shared PACKET/ROUTING contract test, which this one-off frozen script correctly does not match; corrected PR-A's status (its base branch merged as #369 -- baseline only, tooling-fix scope still open); added the six AA §6 machine-readable policy fields the JSON was missing; fixed a wrong Codex arm-A lifecycle binding; blocked the one information need (an otel-tui receiver task) that no current role may legally run, pending a named permitted role; froze the coordinator's own main-dispatch task at xhigh instead of max; fixed a denylist word-boundary gap that let underscore-qualified MCP names slip past; and sealed the five normative files' SHA256 with an append-only amendment rule. Also refreshes PR #376 and #364's status to merged (both landed while this unit was in review), while recording that #364's field-preservation gap (workflow.run_id/tool_use_id still missing from collector.yaml) persists after its merge. Co-authored-by: Scout <scout@local> Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Scope
evidence/artifacts/token-e2e-codex-20260926/(README and receipt.json), the Codex side of Token stack inside Ultracode subagents: 16/16 tools E2E with lifetime counters, exact comparisons and five new host receipts #296;docs/token-efficiency-stack.md.19092db0lane:foundationevidence/artifacts/token-e2e-ultracode-20260925/README.md,docs/token-efficiency-stack.md, and their registrations.SOTA sources
codex exec --json --output-schema -o(native help), andturn.completed.usageevents for the returned usage.rtk init --codex;HEADROOM_OFFLINE=1(Headroom: run the MCP server with its usage beacon off (HEADROOM_OFFLINE=1, DO_NOT_TRACK=1) #304);o200k_base, viatools/token-report/token_manifest.py compare.Evidence-class table
native_provenon this hostreceipt.jsontools[]adoption/; Repomix--compressdropped a declaration; Context Hub has a content gapnative_proven(retained sessions and reruns)tools[].verdict_notecounters.rtk_gain_codex_worktree_onlylocal_integration(exact counts; not provider savings)tools[].exact_comparisoncodex_usage_totalsource_reviewcorrections_to_296The Headroom and Context Mode (Codex) deltas are host-wide: the after snapshot came about 12 hours after the runs. They are recorded but not credited to this run.
Local commands run
Checklist
🤖 Generated with Claude Code