-
Notifications
You must be signed in to change notification settings - Fork 2k
Add CI investigation guidance: always use ci-analysis skill #35106
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Changes from 2 commits
b1e2df1
5a4b6f0
25e1a80
115d1fd
1b8ca97
9ff1363
71eb5af
7b2a0f9
f35da54
bcdb797
6787a3f
ebeeb36
b397906
75f67b8
0977c16
edfec60
393bbb0
b759724
f7b3ff5
50756c7
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -101,6 +101,24 @@ When referencing or triggering CI pipelines, use these current pipeline names: | |
|
|
||
| **⚠️ Old pipeline names** (e.g., `MAUI-UITests-public`, `MAUI-public`) are **outdated** and should NOT be used. Always use the names above. | ||
|
|
||
| ### Investigating CI Failures | ||
|
|
||
| **🚨 ALWAYS use the `ci-analysis` skill when investigating CI failures or assessing merge readiness.** Do NOT manually query AzDO APIs or rely solely on `gh pr checks` pass/fail counts. | ||
|
|
||
| The `ci-analysis` skill provides: | ||
| - **Helix log retrieval** — downloads and parses actual test failure messages from Helix work items | ||
| - **Known issue matching** — automatically correlates failures against `Known Build Error` labeled issues | ||
| - **Cross-build aggregation** — analyzes all pipeline runs (maui-pr, maui-pr-uitests, maui-pr-devicetests) in one pass | ||
| - **Test result details** — reports actual failing test names and error messages, not just job-level pass/fail | ||
|
||
|
|
||
| **When to use it:** | ||
| - "How does CI look?" / "Is CI green?" / "Can we merge?" | ||
| - "What's failing?" / "Are these known failures?" | ||
| - "Is this PR safe to merge?" / "Any CI concerns?" | ||
| - After any PR push to verify the build | ||
|
|
||
| **Anti-pattern:** Manually running `curl` against AzDO APIs and `python3` scripts to parse timelines. This misses Helix work item details, doesn't cross-reference known issues, and doesn't aggregate test results across runs — leading to incomplete or incorrect CI assessments. | ||
|
|
||
| ### Code Formatting | ||
|
|
||
| Always format code before committing: | ||
|
|
||
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
PR description claims updates to
.github/skills/pr-finalize/SKILL.md(new CI verification phase / renumbering), but this PR diff only shows changes to.github/copilot-instructions.md. Either include thepr-finalizechanges in this PR or update the PR description so it matches what’s actually being changed.