Skip to content

Top rule: research first, never self-write without a SOTA source; required sota-sources check - #294

Merged
seathatflowsinourveins merged 1 commit into
mainfrom
claude/top-rule-sota-sources-20260925
Sep 25, 2026
Merged

seathatflowsinourveins merged 1 commit into
mainfrom
claude/top-rule-sota-sources-20260925

Conversation

@seathatflowsinourveins

Copy link
Copy Markdown
Owner

Scope

  • What this PR changes:
    • the user's top rule becomes the first line of AGENTS.md and of the portable user profile examples/claude-native/CLAUDE.md;
    • a required sota-sources check fails any PR whose description lacks a non-empty SOTA sources section.
  • Base commit: 0074a0c3
  • Lane: lane:shared. It touches AGENTS.md, the portable profile and .github/; the foundation and trading lanes need to acknowledge it.
  • Owned paths touched: AGENTS.md, examples/claude-native/CLAUDE.md, .github/pull_request_template.md, .github/workflows/validate.yml, .github/main-ruleset.json, manifests/evidence.json, docs/decisions/2026-09-25-top-rule-sota-sources.md

SOTA sources

Evidence-class table

Claim Evidence class Command / receipt
The full suite passes with the change local_integration python3 -m unittest → Ran 5591 tests, OK (skipped=648)
Manifests and catalogs are consistent local_integration scripts/validate.py, validate_catalogs.py, build_ecosystem.py --check and evidence_manifest.py --check all pass
The new job is safe and well formed local_integration zizmor --offline --strict-collection 0 findings; actionlint 1.7.12 (sha256 verified) rc 0
The body matcher accepts and rejects correctly synthetic Node test of 4 cases: empty section fails, filled passes, last section passes, missing fails
No secrets local_integration guarded gitleaks on the 7 changed files: no leaks

Local commands run

$ python3 -m unittest
Ran 5591 tests in 313.801s
OK (skipped=648)
$ python3 scripts/validate.py
{"components": 69, "hashed_files": 5612, "profiles": 4, "receipts": 147, "status": "passed"}

Decision record

docs/decisions/2026-09-25-top-rule-sota-sources.md: the evidence, the alternatives considered (template checklist only, reviewer-only, per-file automated check) and the comparison that would overturn it (filler-only sources in more than 20% of 30 merged PRs).

Checklist

  • New/changed GitHub Actions are pinned to a full commit SHA with a version comment.
  • Workflows keep top-level permissions: contents: read; the new job needs nothing more.
  • No secrets printed, logged or committed; no new required secret.
  • No new paid hosting, subscription or billing surface.
  • Peer-owned untracked files and worktrees preserved.

🤖 Generated with Claude Code

… a required sota-sources check

AGENTS.md and the portable user profile examples/claude-native/CLAUDE.md
open with the user's top rule: research maintained SOTA repositories,
installable skills and published references first; install the
best-evidenced source or build only from a cited reference, and name it;
stars and installs guide discovery but are not evidence.

validate.yml gains the sota-sources job (harden-runner audit first, then
the official actions/github-script v9.0.0, pinned 3a2844b7), which fails a
PR whose description lacks a non-empty SOTA sources section; the PR
template gains the section; main-ruleset.json lists the check;
manifests/evidence.json carries the new hashes. Decision record:
docs/decisions/2026-09-25-top-rule-sota-sources.md.

Checks: full suite 5,591 tests OK (648 skipped); validate.py,
validate_catalogs.py, build_ecosystem.py --check and
evidence_manifest.py --check pass; zizmor offline strict 0 findings;
actionlint 1.7.12 rc 0; guarded gitleaks clean.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
@seathatflowsinourveins seathatflowsinourveins added the lane:shared Touches files owned by both lanes; needs both lanes' acknowledgement label Sep 25, 2026
@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Sep 25, 2026 •

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review ⚠️ Failed 2026-09-25T21:49:45.611002Z b1a9b6b PR opened
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@seathatflowsinourveins
seathatflowsinourveins enabled auto-merge (squash) September 25, 2026 21:55
@seathatflowsinourveins
seathatflowsinourveins merged commit 7bbb021 into main Sep 25, 2026
24 checks passed
@seathatflowsinourveins
seathatflowsinourveins deleted the claude/top-rule-sota-sources-20260925 branch September 25, 2026 22:11
seathatflowsinourveins added a commit that referenced this pull request Sep 25, 2026
Brings in #294 (top rule and the required sota-sources check) and the other
main commits since c9d74ea so CI judges this PR against current main.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
seathatflowsinourveins added a commit that referenced this pull request Sep 26, 2026
…base layer (research-verified) (#327)

* Harness rules cleanup: each rule once, token practice as the base layer

The portable user rules (examples/claude-native/CLAUDE.md), the project
CLAUDE.md and docs/harness-defaults.md state each constraint once, grouped
under headings, with a token-practice base-layer section that points to
docs/token-practice.md. Decided wording stays verbatim: the top rule, the
core-rule sentences, and the StructuredOutput and refusal sentences.

Duplicates removed: the repeated quality and evidence-not-authority
sentences, "Keep routine tasks solo" (now the ladder's first rung), the
project CLAUDE.md lines that AGENTS.md already carries, and the doubled
acceptance, discovery and reuse sentences in the harness defaults. Stale
facts corrected: 4,096 is a per-call item limit, not a run limit (official
workflows doc); the core sentence no longer "opens" the portable file
(the top rule does since #294). The profile recipe tells hosts to replace
an earlier merged copy whole.

docs/decisions/2026-09-26-harness-rules-cleanup.md records the sources
(Claude Code 2.1.283 help and bundled reference, official docs read
2026-09-26, Codex AGENTS.md docs), a coverage table for every removed or
moved sentence, the o200k_base counts, alternatives and the overturn
comparison.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>

* AGENTS.md: each rule once, token practice as the base layer (shared hot file)

Group the project rules under headings with bullets (Evidence and
completion; Token practice (base layer); Workers, effort and lanes; Hosts,
credentials and records; Trading north star). The top rule and the
Claude effort rule stay verbatim.

One statement each for rules that appeared several times: six "load only
the needed layer" sentences, three counter-separation sentences, three
catalog-inclusion sentences, two upstream-executable sentences, two
evidence-class sentences and two reuse sentences. "Research existing
upstream skills ... before writing custom orchestration" is covered by the
top rule. "Run the repository validation command" now names
python3 scripts/validate.py. Trading text changes only where a sentence
was a generic duplicate, a narrative connector, or stale ("the latest
bounded wave" now names the catalyst-convergence wave, added 2026-09-19).

o200k_base (gpt-tokenizer 3.4.0): 2,332 -> 2,237 tokens. Coverage table
and sources: docs/decisions/2026-09-26-harness-rules-cleanup.md. This is
the branch's last commit because AGENTS.md is a shared hot file
(docs/lanes.md); the PR is lane:shared.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>

* AGENTS.md repair round: base-layer delegation for Codex, dashboard rules out of the trading section

- Token practice gains "Delegate a step when only its conclusion is needed, and
  return concise findings with source or artifact locations." and the caching
  bullet adds compaction. Codex reads AGENTS.md but not CLAUDE.md; Codex 0.155.1
  lists multi_agent as stable and enabled. "Deferred" is not added because its
  tool_search flags are listed as removed.
- The grand-dashboard checkpoint and Grafana/Dagu observation sentences move
  verbatim from Trading north star to Hosts, credentials and records:
  observability/grand-dashboard/state.json is a shared hot file with foundation
  gates (docs/lanes.md).
- The decision record now describes what AGENTS.md carries, adds both moves to
  the coverage table, and quotes re-measured counts (AGENTS.md 2,332 -> 2,259
  o200k tokens, -73; structure cost +56; cross-file pairs 17, all listed).

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>

* Register the harness-rules cleanup files (hot-file commit)

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>

---------

Co-authored-by: Scout <scout@local>
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

lane:shared Touches files owned by both lanes; needs both lanes' acknowledgement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant