t1095: Extend pattern tracker schema with strategy, quality, failure_mode, and token columns#1629
t1095: Extend pattern tracker schema with strategy, quality, failure_mode, and token columns#1629marcusquinn merged 3 commits intomainfrom
Conversation
Add companion table for pattern records with columns: strategy (normal/prompt-repeat/escalated), quality (ci-pass-first-try/ci-pass-after-fix/ needs-human), failure_mode (hallucination/context-miss/incomplete/wrong-file/ timeout), tokens_in, tokens_out. Migration backfills existing records with strategy=normal. Table created in both init_db and migrate_db for new and existing databases.
|
Warning Rate limit exceeded
⌛ How to resolve this issue?After the wait time has elapsed, a review can be triggered using the We recommend that you space out your commits to avoid hitting the rate limit. 🚦 How do rate limits work?CodeRabbit enforces hourly rate limits for each developer per organization. Our paid plans have higher rate limits than the trial, open-source and free plans. In all cases, we re-allow further reviews after a brief timeout. Please see our FAQ for further information. ✨ Finishing Touches🧪 Generate unit tests (beta)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
🔍 Code Quality Report�[0;35m[MONITOR]�[0m Code Review Monitoring Report �[0;34m[INFO]�[0m Latest Quality Status: �[0;34m[INFO]�[0m Recent monitoring activity: 📈 Current Quality Metrics
Generated on: Wed Feb 18 02:34:05 UTC 2026 Generated by AI DevOps Framework Code Review Monitoring |
…e_mode, tokens (t1095) Update cmd_record to accept --strategy, --quality, --failure-mode, --tokens-in, --tokens-out flags with validation. Store extended metadata in pattern_metadata companion table. Update cmd_stats, cmd_export, cmd_report to surface the new fields. Update help text with new options and examples. All changes are backward-compatible — existing callers without new flags continue to work.
Summary of ChangesHello @marcusquinn, I'm Gemini Code Assist1! I'm currently reviewing this pull request and will post my feedback shortly. In the meantime, here's a summary to help you and other reviewers quickly get up to speed! This pull request significantly enhances the pattern tracking system by introducing a dedicated schema for extended pattern metadata. This allows for the capture of more granular details such as the strategy used, quality of outcome, specific failure modes, and token usage for each pattern. These additions provide a more comprehensive understanding of AI agent performance and behavior, enabling deeper analysis and more informed decision-making. Highlights
Changelog
Activity
Using Gemini Code AssistThe full guide for Gemini Code Assist can be found on our documentation page, here are some quick tips. Invoking Gemini You can request assistance from Gemini at any point by creating a comment using either
Customization To customize Gemini Code Assist for GitHub experience, repository maintainers can create a configuration file and/or provide a custom code review style guide (such as PEP-8 for Python) by creating and adding files to a Limitations & Feedback Gemini Code Assist may make mistakes. Please leave feedback on any instances where its feedback is incorrect or counter productive. You can react with 👍 and 👎 on @gemini-code-assist comments. If you're interested in giving your feedback about your experience with Gemini Code Assist for Github and other Google products, sign up here. You can also get AI-powered code generation, chat, as well as code reviews directly in the IDE at no cost with the Gemini Code Assist IDE Extension. Footnotes
|
🔍 Code Quality Report�[0;35m[MONITOR]�[0m Code Review Monitoring Report �[0;34m[INFO]�[0m Latest Quality Status: �[0;34m[INFO]�[0m Recent monitoring activity: 📈 Current Quality Metrics
Generated on: Wed Feb 18 02:40:16 UTC 2026 Generated by AI DevOps Framework Code Review Monitoring |
![gemini-code-assist[bot]](https://avatars.githubusercontent.com/in/956858?s=60&v=4){kind=small}
There was a problem hiding this comment.
Code Review
This pull request successfully extends the pattern tracker schema with new columns for strategy, quality, failure mode, and token counts. The changes include creating a companion table pattern_metadata, updating the cmd_record function to handle these new fields with appropriate validation, and enhancing cmd_stats, cmd_export, and cmd_report to utilize and display this new data. The cmd_help output and examples have also been updated for clarity. Overall, the implementation is robust, including idempotency for migrations and validation for new inputs. However, there are a few areas for improvement regarding code maintainability and robustness.
🔍 Code Quality Report�[0;35m[MONITOR]�[0m Code Review Monitoring Report �[0;34m[INFO]�[0m Latest Quality Status: �[0;34m[INFO]�[0m Recent monitoring activity: 📈 Current Quality Metrics
Generated on: Wed Feb 18 02:57:23 UTC 2026 Generated by AI DevOps Framework Code Review Monitoring |
|
![coderabbitai[bot]](https://avatars.githubusercontent.com/in/347564?s=60&v=4){kind=small}
…d t1094.1 (t1107) All t1094 deliverables confirmed implemented: - Prompt strategy tracking → t1095 (pr:#1629) - Output quality gradient + failure categorization → t1096 (pr:#1632) - Token usage → t1095 (pr:#1629) - A/B comparison → t1098+t1099 (pr:#1637, pr:#1634) - Prompt-repeat strategy → t1097 (pr:#1631) - Build-agent reference → t1094.1 (pr:#1633) t1094 parent ready to be marked complete: verified:2026-02-18
1 participant
Summary
Extends the pattern tracker schema with 5 new structured columns for richer analytics on autonomous task execution patterns.
New columns (in pattern_metadata companion table)
Design decisions
Changes
Testing
Ref #1620