cicd: add a github workflow for xfails report script #2273
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,102 @@ | ||
| name: Update XFails Report | ||
|
|
||
| on: | ||
| schedule: | ||
| # Run weekly on Monday at 00:00 UTC | ||
| - cron: '0 0 * * 1' | ||
| workflow_dispatch: # Allow manual triggering | ||
|
|
||
| permissions: | ||
| contents: write | ||
| pull-requests: write | ||
|
|
||
| jobs: | ||
| update-xfails-report: | ||
| runs-on: ubuntu-latest | ||
| timeout-minutes: 30 | ||
| steps: | ||
| - name: Checkout repository | ||
| uses: actions/checkout@v4.2.2 | ||
| with: | ||
| fetch-depth: 1 # Shallow clone is sufficient for scanning test files | ||
| token: ${{ secrets.GITHUB_TOKEN }} | ||
|
|
||
| - name: Set up Python | ||
| uses: actions/setup-python@v5 | ||
| with: | ||
| python-version: '3.11' | ||
|
|
||
| - name: Create reports directory | ||
| run: mkdir -p reports | ||
|
|
||
| - name: Run XFails tracker | ||
| run: | | ||
| python scripts/xfails_tracker.py > reports/xfails_report.txt 2>&1 || { | ||
| echo "Error: XFails tracker script failed" | ||
| cat reports/xfails_report.txt | ||
| exit 1 | ||
| } | ||
|
|
||
| - name: Check for changes | ||
| id: check_changes | ||
| run: | | ||
| # Check if xfails report file is new (unstaged) or has changes | ||
| if git ls-files --error-unmatch reports/xfails_report.txt >/dev/null 2>&1; then | ||
| # File is tracked, check for changes | ||
| if git diff --quiet reports/xfails_report.txt; then | ||
| echo "changed=false" >> $GITHUB_OUTPUT | ||
| echo "No changes detected in xfails report" | ||
| else | ||
| echo "changed=true" >> $GITHUB_OUTPUT | ||
| echo "Changes detected in xfails report" | ||
| fi | ||
| else | ||
| # File is untracked (newly created) | ||
| echo "changed=true" >> $GITHUB_OUTPUT | ||
| echo "XFails report file is new" | ||
| fi | ||
|
|
||
| - name: Create Pull Request | ||
| if: steps.check_changes.outputs.changed == 'true' | ||
| uses: peter-evans/create-pull-request@v7 | ||
| with: | ||
| token: ${{ secrets.FLASHINFER_BOT_TOKEN }} | ||
| committer: flashinfer-bot <flashinfer-bot@users.noreply.github.com> | ||
| author: flashinfer-bot <flashinfer-bot@users.noreply.github.com> | ||
| commit-message: | | ||
| chore: update xfails report | ||
|
|
||
| Auto-generated xfails report based on current test suite markers. | ||
| branch: auto-update-xfails-report | ||
| base: main | ||
| delete-branch: true | ||
| title: 'chore: Update XFails Report' | ||
| body: | | ||
| ## Summary | ||
|
|
||
| This PR updates the xfails report based on the current test suite. | ||
|
|
||
| ## Changes | ||
|
|
||
| - Updated `reports/xfails_report.txt` with current xfail markers from the test suite | ||
|
|
||
| ## How to Review | ||
|
|
||
| 1. Review the changes to `reports/xfails_report.txt` | ||
| 2. Check if the number of xfails has increased or decreased | ||
| 3. Review the reasons for any new xfails | ||
| 4. Consider addressing xfails that may no longer be needed | ||
|
|
||
| ## Notes | ||
|
|
||
| - This is an automated PR generated weekly | ||
| - The report shows all `pytest.mark.xfail` markers in the test suite | ||
| - Grouped by reason for easy analysis | ||
|
|
||
| --- | ||
|
|
||
| 🤖 This PR was automatically generated by the [update-xfails-report workflow](.github/workflows/update-xfails-report.yml) | ||
| labels: | | ||
| automated | ||
| maintenance | ||
| testing | ||
|
Comment on lines
+59
to
+102
Contributor
There was a problem hiding this comment. 🧩 Analysis chain🌐 Web query:
💡 Result: The latest major release is v8 — use peter-evans/create-pull-request@v8 (you can pin to a specific patch like @v8.x.x). [1][2] Sources: Upgrade peter-evans/create-pull-request to v8. Update the action version from 🤖 Prompt for AI Agents |
||
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
🧩 Analysis chain
🌐 Web query:
latest version of actions/checkout GitHub Action 2025💡 Result:
The latest major version is v6 — use actions/checkout@v6. [1][2]
Sources:
[1] actions/checkout GitHub repository README.
[2] Checkout page on the GitHub Marketplace.
Update actions/checkout to the latest version.
The version v4.2.2 is outdated. The latest stable version is v6. Update to
actions/checkout@v6to ensure security patches and bug fixes are included.🤖 Prompt for AI Agents