Skip to content

AGENTS.md: embed after qmd update, and name the foundation-adoption and foundation-docs collections - #417

Merged
seathatflowsinourveins merged 7 commits into
mainfrom
claude/qmd-refresh-embed-20260927
Sep 29, 2026
Merged

seathatflowsinourveins merged 7 commits into
mainfrom
claude/qmd-refresh-embed-20260927

Conversation

@seathatflowsinourveins

@seathatflowsinourveins seathatflowsinourveins commented Sep 27, 2026 •

Copy link
Copy Markdown
Owner

Scope

  • What this PR changes: one AGENTS.md sentence (line 30, the qmd catalog refresh) and the matching step in adoption/update.md ("Refresh only adopted retrieval"). Refresh is qmd --index native-agent-stack-catalog update, then embed where that index carries embeddings; scoped use names query, search and get and all four collections (us-equities-catalog, us-equities-foundation, foundation-adoption, foundation-docs).
  • Base: origin/main b1be50c8, merged in by the hot-file protocol (final head 17552f79).
  • Lane: lane:shared. AGENTS.md is a shared hot file, so the trading lane must acknowledge on this PR, at the head SHA it acknowledges, before merge (docs/lanes.md L149-150). The trading lane relies on the two us-equities-* collection names, which stay.
  • Owned paths touched: AGENTS.md (line 30), adoption/update.md, manifests/evidence.json (re-registration, last commit).
  • Not touched: catalogs/us-equities/ (trading lane; its lexical recipe stays consistent with the conditional wording) and the token-lanes carrier blocks (sealed for the PR-H: E2E preregistration for the token-save-practice stack (frozen tasks, metrics, gate, procedure) #381 run; Token lanes: jCodeMunch route without execute, then order with written arguments #435 covers them after it).

Why

The named qmd catalog index gained foundation-adoption and foundation-docs on 2026-09-27. Upstream qmd v2.8.3 gives new or changed documents no vectors until embed runs, so the vector and hybrid arms of query miss them. A measured local observation on 2026-09-29: after qmd update the index reported 38 documents pending; embed then embedded 731 chunks from those 38 documents in 6m02s (3,284 vectors, none pending).

Corrected 2026-09-29: this change is not part of #381 Amendment 3, which on main is the builder-body and M4 change (#464). The current #381 owner, native-agent-stack-2d (docs/decisions/2026-09-28-ecosystem-roadmap.md, #475), decided on 2026-09-29 that this lands before the seal, and it froze the host counts after update and embed. The A/B behind the wording (lexical hit@5 1/10, vector 9/10, hybrid 10/10) is recorded in evidence/artifacts/qmd-scope-embed-20260927/ on the open gateway-lane PR #423; this PR does not depend on it.

Evidence

  • Repair round 2026-09-29 (native-agent-stack-10), measured locally and not upstream tests: python3 scripts/validate.py, scripts/evidence_manifest.py --check and scripts/component_matrix.py --check exit 0; every test module that references AGENTS.md passes on the final tree: test_adjudicate 116, test_adoption_docs_consistency 37 (1 skip), test_adoption_status 86, test_blind_checkout 40, test_codex_lane 76, test_codex_worker_lane 58 (8 skips, need NAS_CODEX_INTEGRATION=1), test_ecosystem_manifest 56, test_install_claude_profile 63 (3 skips, PyYAML absent), test_landscape_sweep_harness 123 (3 skips), test_runtime_worker_openhands 121, test_runtime_worker_skills 22, test_token_e2e_preregistration 34. Skips are environment-gated and are not passes for those cases.
  • Final head 17552f79 (main b1be50c8 merged in), measured 2026-09-29 and not upstream tests: scripts/validate.py, scripts/evidence_manifest.py --check and scripts/component_matrix.py --check exit 0 (run by the merge script). The twelve test modules that reference AGENTS.md pass when run one module at a time with TMPDIR outside /tmp: test_adjudicate 116, test_adoption_docs_consistency 37 (1 skip), test_adoption_status 86, test_blind_checkout 40, test_codex_lane 76, test_codex_worker_lane 58 (8 skips), test_ecosystem_manifest 56, test_install_claude_profile 63 (3 skips), test_landscape_sweep_harness 123 (3 skips), test_runtime_worker_openhands 121, test_runtime_worker_skills 22, test_token_e2e_preregistration 34. With TMPDIR under /tmp, test_adjudicate, test_blind_checkout and test_codex_lane fail on this host, and also on a clean checkout of origin/main b1be50c8, because a stray /tmp/.git directory exists (codex_lane: /tmp has .git); hosted CI has none.
  • qmd behaviour, read in the installed qmd 2.8.3 source (dist/store.js): embedding runs only for vec and hyde searches, and skipRerank returns RRF-scored candidates without a model, so a typed lexical query with rerank off is model-free while a plain query expands and reranks with models downloaded on first use. That is why query is not gated on embeddings and why update.md says only a plain query downloads models (recipes/README.md L774 prescribes the model-free form for the lexical lane).
  • Review: GPT-6 (gpt-6-astra, effort max, codex exec -s read-only; the model is the -m request, not an observed resolution) approved the first head with no findings. A Claude evidence review (Opus, max) returned needs_changes with minors: the sentence contradicted adoption/update.md and the trading-lane recipe (fixed by making embed conditional on the index carrying embeddings and aligning update.md); the body cited an artifact not on main (fixed above). An independent verifier then re-ran the checks and found the added query gate stricter than the sources; that is fixed too.

Residuals

🤖 Generated with Claude Code

SOTA sources

  • qmd v2.8.3 (https://github.com/tobi/qmd/releases/tag/v2.8.3), README "Commands": qmd update re-indexes changed files, and qmd embed builds the vectors that qmd query (hybrid) and vec/hyde need.
  • Installed qmd 2.8.3 source (dist/store.js, structured search and skipRerank paths) for the model-free typed lexical query; recipes/README.md L774 in this repository.

Scout and others added 2 commits September 27, 2026 12:44
…nd foundation-docs collections

The named catalog index gained the adoption/ and docs/ collections on 2026-09-27
(E1's qmd miss was a scope failure: adoption/update.md was outside the index). qmd
v2.8.3 gives new or changed documents no vectors until `qmd embed` runs, so the
refresh step now runs update followed by embed, and the hybrid `query` joins
`search` and `get`.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Scout and others added 5 commits September 28, 2026 22:43
…dence manifest, PR files re-registered)

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
…ex carries embeddings

Review repair for #417 (F1-F3). The PR made `update` then `embed` the
routine refresh on every host that adopted the named index, and listed
`query` unconditionally, while adoption/update.md and the lexical profile
in catalogs/us-equities/native-workflows.md (L30, L45-46: "downloads no
QMD models") run `update` only.

- AGENTS.md line 30 (F1): `embed` follows `update` where that index
  carries embeddings, and `query` applies on such an index; `search` and
  `get` stay unconditional as on main. All four collections and the
  native-workflows.md pointer are kept. 62 words (PR sentence: 61).
- adoption/update.md, Refresh only adopted retrieval (F2): add `status`
  (the discriminator is `Vectors: N embedded` above 0) and a conditional
  `embed`, and state why update's closing "Run 'qmd embed'" notice is
  not the signal (it prints on a lexical index too).
- No file references the unmerged qmd-scope-embed-20260927 artifact (F3).
- manifests/evidence.json: AGENTS.md and adoption/update.md re-registered
  (docs/lanes.md hot-file protocol); the four generated reports are
  byte-identical after --write.

Sources (tobi/qmd v2.8.3, tag commit facd35e0; its README is
byte-identical to the installed @tobilu/qmd 2.8.3 copy):
README L556 (models auto-downloaded on first use), L644-L651 (embed,
embed -f), L1016-L1018 (update re-indexes); src/cli/qmd.ts L561 (status
Vectors line) and L994-L1002 (update's embed notice); src/store.ts
L1974-L1978 (embed without -f takes only pending documents).

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…ed lexical query with rerank off is model-free

The round-one verifier found the extra gate stricter than qmd v2.8.3 requires: structuredSearch embeds only for vec and hyde searches and skipRerank returns RRF-scored candidates without a model, and recipes/README.md prescribes that form for the lexical lane. AGENTS.md L30 keeps query in the scoped tools again; update.md now says only a plain query downloads models.

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
…t, branch files re-registered)

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
…t, branch files re-registered)

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
@seathatflowsinourveins

Copy link
Copy Markdown
Owner Author

Review record, 2026-09-29 (native-agent-stack-10). Merge candidate: head 17552f79, which is 61680c9b plus the repairs below and merges of main (latest b1be50c8). The PR is lane:shared; it waits for the trading lane's acknowledgement at this head (docs/lanes.md L149-150). The Gate A owner (native-agent-stack-2d) decided on 2026-09-29 that it lands before its seal.

  • Two model families reviewed 61680c9b, read-only: GPT-6 (gpt-6-astra, effort max, codex exec -s read-only; the model is the -m request, not an observed resolution) approved with no findings. A Claude evidence-reviewer (Opus, max) returned needs_changes with minors: the one-line sentence contradicted adoption/update.md and the trading-lane recipe, and the body cited an artifact that is not on main.
  • Repair: embed follows update where the index carries embeddings, adoption/update.md says the same and gives the status check, and the body no longer cites an unmerged artifact. An independent Opus stack-verifier re-ran the checks and found the builder's extra gate on query stricter than qmd v2.8.3 requires; the coordinator removed that gate and re-read the installed qmd source (embedding runs only for vec and hyde searches; skipRerank returns RRF-scored candidates without a model). That last change has not been through a second independent review.
  • Checks on the merge candidate: scripts/validate.py, scripts/evidence_manifest.py --check and scripts/component_matrix.py --check exit 0; every test module that references AGENTS.md passes on this tree (12 modules, environment-gated skips listed in the body). These are local integration checks, not upstream tests. Hosted required checks are read with gh pr checks 417 --required immediately before merging.

@seathatflowsinourveins

Copy link
Copy Markdown
Owner Author

Trading lane acknowledgement (docs/lanes.md:149-150). Reviewed at head 17552f79 by ecosystem-roadmap-2026, which holds the trading lane.

  • Trading paths: none changed.
  • QMD collections: the AGENTS.md line keeps both us-equities-catalog and us-equities-foundation. Each is named once in the removed text and once in the added text, so trading-lane catalog lookup is unchanged.

No objection.

@seathatflowsinourveins
seathatflowsinourveins merged commit 6ac2b60 into main Sep 29, 2026
27 of 30 checks passed
@seathatflowsinourveins
seathatflowsinourveins deleted the claude/qmd-refresh-embed-20260927 branch September 29, 2026 05:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

lane:shared Touches files owned by both lanes; needs both lanes' acknowledgement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant