Conversation
…_quality ruleset BLOCKED diagnostic (Aaron 2026-04-28)
Captures detection pattern for the failure mode Aaron has seen
across multiple projects: code_quality:severity=all ruleset
returns 'pending for N analyzed languages' even though every
per-language Analyze (X) leg succeeds. Actual signal is the
umbrella CodeQL check (no language suffix) being NEUTRAL with
'1 configuration not found' details.
30-second detection: gh pr view N --json statusCheckRollup
--jq '.[]|select(.name=="CodeQL")|{conclusion}' — if NEUTRAL
on a code_quality-BLOCKED PR, this is the failure mode.
Industry-wide pattern per Aaron 2026-04-28 ('i've seen these
before').
Open question deferred: why same default-setup state
('not-configured') yields umbrella SUCCESS on AceHack vs
NEUTRAL on LFG. Aaron's hypothesis (2026-04-28T14:23Z): org-
level Code Security policy on LFG creates inheritance
expectation that AceHack's personal-account context lacks.
Agency-Signature-Version: 1
Agent: otto
Agent-Runtime: claude-code
Agent-Model: claude-opus-4-7
Credential-Identity: AceHack-shared
Credential-Mode: shared-with-aaron
Human-Review: not-implied-by-credential
Human-Review-Evidence: aaron-explicit-ask
Action-Mode: autonomous-fail-open
Task: codeql-umbrella-detection-memory
There was a problem hiding this comment.
Pull request overview
Adds a new memory/ feedback entry documenting a repeatable diagnostic for a CodeQL/ruleset “BLOCKED but everything looks green” failure mode, and indexes it in memory/MEMORY.md for retrieval.
Changes:
- Add a new memory file describing how to detect the “umbrella
CodeQLcheck is NEUTRAL while per-languageAnalyze (X)legs are SUCCESS” situation. - Add the new memory entry to the top of
memory/MEMORY.md(newest-first index).
Reviewed changes
Copilot reviewed 2 out of 2 changed files in this pull request and generated 2 comments.
| File | Description |
|---|---|
| memory/feedback_codeql_umbrella_neutral_vs_per_language_detection_pattern_aaron_2026_04_28.md | New diagnostic memory describing the umbrella-CodeQL-NEUTRAL signal and a fast gh pr view … --json statusCheckRollup check. |
| memory/MEMORY.md | Adds a top-of-index link/summary for the new memory file. |
| ## Composes with | ||
|
|
||
| - `feedback_no_required_approval_on_zeta_BLOCKED_means_threads_or_ci_aaron_2026_04_28.md` | ||
| — the 5-class BLOCKED taxonomy. This adds a 6th sub-class: |
There was a problem hiding this comment.
This says the referenced “5-class BLOCKED taxonomy” “adds a 6th sub-class”, but the taxonomy defines five top-level classes and this change introduces a subclass under class 5 (“class-5b”). Suggest rewording to avoid implying a new 6th top-level class and to keep the numbering consistent with the existing class-5 / class-4 scheme.
| — the 5-class BLOCKED taxonomy. This adds a 6th sub-class: | |
| — the 5-class BLOCKED taxonomy. This adds a subclass under class 5: |
|
|
||
| **📌 Fast path: read `CURRENT-aaron.md` and `CURRENT-amara.md` first.** These per-maintainer distillations show what's currently in force. Raw memories below are the history; CURRENT files are the projection. (`CURRENT-aaron.md` refreshed 2026-04-25 with the Otto-281..285 substrate cluster + factory-as-superfluid framing — sections 18-22; prior refresh 2026-04-24 covered sections 13-17.) | ||
|
|
||
| - [**CodeQL umbrella check NEUTRAL while per-language Analyze legs SUCCESS — code_quality ruleset BLOCKED detection pattern (Aaron 2026-04-28)**](feedback_codeql_umbrella_neutral_vs_per_language_detection_pattern_aaron_2026_04_28.md) — When `code_quality:severity=all` ruleset says "Code quality results are pending for N analyzed languages" despite per-language `Analyze (X)` legs SUCCESS, check the umbrella `CodeQL` check (no language suffix) for NEUTRAL conclusion + "1 configuration not found" details. Industry-wide pattern; Aaron seen across other projects. |
There was a problem hiding this comment.
Grammar: “Aaron seen across other projects” is missing a verb/object and reads ungrammatical. Consider rewriting to “Aaron has seen this across other projects.”
| - [**CodeQL umbrella check NEUTRAL while per-language Analyze legs SUCCESS — code_quality ruleset BLOCKED detection pattern (Aaron 2026-04-28)**](feedback_codeql_umbrella_neutral_vs_per_language_detection_pattern_aaron_2026_04_28.md) — When `code_quality:severity=all` ruleset says "Code quality results are pending for N analyzed languages" despite per-language `Analyze (X)` legs SUCCESS, check the umbrella `CodeQL` check (no language suffix) for NEUTRAL conclusion + "1 configuration not found" details. Industry-wide pattern; Aaron seen across other projects. | |
| - [**CodeQL umbrella check NEUTRAL while per-language Analyze legs SUCCESS — code_quality ruleset BLOCKED detection pattern (Aaron 2026-04-28)**](feedback_codeql_umbrella_neutral_vs_per_language_detection_pattern_aaron_2026_04_28.md) — When `code_quality:severity=all` ruleset says "Code quality results are pending for N analyzed languages" despite per-language `Analyze (X)` legs SUCCESS, check the umbrella `CodeQL` check (no language suffix) for NEUTRAL conclusion + "1 configuration not found" details. Industry-wide pattern; Aaron has seen this across other projects. |
Summary
Captures a diagnostic pattern Aaron has seen across multiple projects but hadn't yet been encoded:
code_quality:severity=allruleset returns 'pending for N analyzed languages' despite every per-languageAnalyze (X)leg succeeding. The actual signal is the umbrellaCodeQLcheck (no language suffix) NEUTRAL with '1 configuration not found' details.What it captures
gh pr view N --json statusCheckRollup --jq '.[]|select(.name=="CodeQL")|{conclusion}'— if NEUTRAL on a code_quality-BLOCKED PR, this is the failure mode.Composes with
Agency-Signature-Version: 1
Agent: otto
Agent-Runtime: claude-code
Agent-Model: claude-opus-4-7
Credential-Identity: AceHack-shared
Credential-Mode: shared-with-aaron
Human-Review: not-implied-by-credential
Human-Review-Evidence: aaron-explicit-ask
Action-Mode: autonomous-fail-open
Task: codeql-umbrella-detection-memory