Skip to content

fix(evidence): drop retired Agent Desk from q5 ground truth in AI-search controlled questions - #90

Closed
nish3451 wants to merge 13 commits into
mainfrom
fix/q5-ground-truth-drop-agent-desk
Closed

fix(evidence): drop retired Agent Desk from q5 ground truth in AI-search controlled questions#90
nish3451 wants to merge 13 commits into
mainfrom
fix/q5-ground-truth-drop-agent-desk

Conversation

@nish3451

@nish3451 nish3451 commented Aug 10, 2026

Copy link
Copy Markdown
Collaborator

What

The AI-search controlled question q5-what-is-tinystudio-io (What is tinystudio.io?) carried ground truth naming the retired Agent Desk as part of the current offer:

tinystudio.io is TinyStudio's own site: the leak audit, plus the Agent Desk behind it.

The Agent Desk is legacy (de-indexed, noindex, absent from the sitemap, demoted in offer.md/llms.txt). The site's own q5 answer on the homepage identity section is "This site: the leak audit and the desk behind it."

Change

  • evidence-fixtures/ai-search/controlled-questions.json: q5 truth now reads "tinystudio.io is TinyStudio's own site: the leak audit, plus the desk that closes the leaks the audit finds." — consistent with q1/q2's established "desk that closes the leaks" phrasing.
  • public/audit.html: regenerated the embedded ai-search-evidence bundle so the drift guard passes.

No captured runs changed (honesty rules: evidence records stay as observed). Historical evidence docs untouched.

Verification

  • npm run check — TinyStudio.io checks passed (includes the embed drift guard).
  • npm test — all suites green (90 tests across check, headings, sitemap, worker, UI, contract; 0 failures).

Summary by CodeRabbit

  • Documentation
    • Updated AI search evidence to clarify that tinystudio.io contains TinyStudio’s leak audit and desk for addressing identified leaks.
    • Replaced outdated references to the “Agent Desk” with clearer site descriptions.

…rch controlled questions

The q5 truth ('What is tinystudio.io?') named the retired Agent Desk as part
of the current offer. The Agent Desk is legacy, not the product TinyStudio
sells; the site's own q5 answer is 'This site: the leak audit and the desk
behind it.' Replace the truth with the current offer language, consistent
with q1's 'a desk that closes the leaks the audit finds', and regenerate the
embedded bundle in public/audit.html so the drift guard passes.
@chatgpt-codex-connector

Copy link
Copy Markdown

You have reached your Codex usage limits for code reviews. You can see your limits in the Codex usage dashboard.
To continue using code reviews, add credits to your account and enable them for code reviews in your settings.

@greptile-apps greptile-apps Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nish3451 has reached the 50-credit limit for trial accounts. To continue receiving code reviews, upgrade your plan.

@coderabbitai

coderabbitai Bot commented Aug 10, 2026

Copy link
Copy Markdown

Review Change Stack

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro Plus

Run ID: 799a2230-39ba-4bb8-9644-0cd0e965a4d5

📥 Commits

Reviewing files that changed from the base of the PR and between 5d2ad26 and ce0620b.

📒 Files selected for processing (2)
  • evidence-fixtures/ai-search/controlled-questions.json
  • public/audit.html

📝 Walkthrough

Walkthrough

The q5 AI-search truth statement now describes tinystudio.io as TinyStudio’s site with the leak audit and leak-closing desk. The controlled fixture and embedded audit evidence use aligned wording.

Changes

Q5 evidence wording

Layer / File(s) Summary
Align q5 truth statements
evidence-fixtures/ai-search/controlled-questions.json, public/audit.html
The q5 truth statement replaces the “Agent Desk” reference with a description of TinyStudio’s site, leak audit, and leak-closing desk.

Estimated code review effort: 1 (Trivial) | ~2 minutes

Possibly related PRs

🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The title clearly and concisely describes the removal of the retired Agent Desk from the q5 AI-search ground truth.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch fix/q5-ground-truth-drop-agent-desk

Comment @coderabbitai help to get the list of available commands.

@greptile-apps greptile-apps Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nish3451 has reached the 50-credit limit for trial accounts. To continue receiving code reviews, upgrade your plan.

@greptile-apps greptile-apps Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nish3451 has reached the 50-credit limit for trial accounts. To continue receiving code reviews, upgrade your plan.

@greptile-apps greptile-apps Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nish3451 has reached the 50-credit limit for trial accounts. To continue receiving code reviews, upgrade your plan.

@greptile-apps greptile-apps Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nish3451 has reached the 50-credit limit for trial accounts. To continue receiving code reviews, upgrade your plan.

@greptile-apps greptile-apps Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nish3451 has reached the 50-credit limit for trial accounts. To continue receiving code reviews, upgrade your plan.

@greptile-apps greptile-apps Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nish3451 has reached the 50-credit limit for trial accounts. To continue receiving code reviews, upgrade your plan.

@greptile-apps greptile-apps Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nish3451 has reached the 50-credit limit for trial accounts. To continue receiving code reviews, upgrade your plan.

@greptile-apps greptile-apps Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nish3451 has reached the 50-credit limit for trial accounts. To continue receiving code reviews, upgrade your plan.

@greptile-apps greptile-apps Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nish3451 has reached the 50-credit limit for trial accounts. To continue receiving code reviews, upgrade your plan.

@greptile-apps greptile-apps Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nish3451 has reached the 50-credit limit for trial accounts. To continue receiving code reviews, upgrade your plan.

@greptile-apps greptile-apps Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nish3451 has reached the 50-credit limit for trial accounts. To continue receiving code reviews, upgrade your plan.

@greptile-apps greptile-apps Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nish3451 has reached the 50-credit limit for trial accounts. To continue receiving code reviews, upgrade your plan.

@nish3451

Copy link
Copy Markdown
Collaborator Author

Conflict-locked against current main (mergeStateStatus DIRTY) after #102 and the 2026-08-12 evidence re-runs; closing as the stale delivery path. The identical two-file change (controlled-questions.json q5 truth + regenerated audit.html bundle, same wording) is re-landed on the fresh base by #137 (fix/q5-ground-truth-drop-agent-desk-lane1), which passes npm run check and npm test on its own tree and sits directly on current origin/main.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant