Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add script for analysing bors CI failures #2306

Merged
merged 1 commit into from
Nov 9, 2020
Merged

Conversation

Anviking
Copy link
Member

@Anviking Anviking commented Nov 9, 2020

Issue Number

ADP-471

Overview

  • Script fetches recent bors comments and parses our classification of them
  • Prints
    • list of recent bors comments, with full details for unclassified failures
    • failure rate due to flaky tests
    • flaky failures broken down per associated bug ticket (most severe at top)

Comments

Skärmavbild 2020-11-09 kl  13 04 04

Squashed:
- Use curl instead of httpie
- Make sure to also fetch new comments on old PRs
- Extract linked issues / "tags" from failures
- Don't include #expected failures in summary stats
- Exclude "This PR was included in a batch that successfully built"
- Break down failures per tag
- Refactor into a single jq statement for reusability and readability
- Sort the per-tag breakdown
- Print title of issues
- Also print issue url
- Fixup: minutes are %M, not %m
- Use a single function to format urls, in case we want to change it
- Correctly parse "#0 on macos", ignore duplicates
- Improve filters
@Anviking Anviking force-pushed the anviking/bors-stats branch from ea8f7f8 to b4d2996 Compare November 9, 2020 12:08
@Anviking Anviking self-assigned this Nov 9, 2020
Copy link
Contributor

@piotr-iohk piotr-iohk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@Anviking
Copy link
Member Author

Anviking commented Nov 9, 2020

bors r+

@iohk-bors
Copy link
Contributor

iohk-bors bot commented Nov 9, 2020

Build succeeded:

@iohk-bors iohk-bors bot merged commit 1ee823d into master Nov 9, 2020
@iohk-bors iohk-bors bot deleted the anviking/bors-stats branch November 9, 2020 17:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants