-
Notifications
You must be signed in to change notification settings - Fork 29.7k
Test reporter #28297
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Test reporter #28297
Conversation
dd3f754 to
16bb5a7
Compare
|
This is working on Cirrus, need to check into how I can make it work for LUCI. |
|
This is still TODO on LUCI but would be an improvement for Cirrus. Marking ready for review. /cc @goderbauer |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
|
This doesn't appear to be working properly: https://cirrus-ci.com/task/4970475997364224 |
|
Something's messed up on Windows. Checking. |
|
That will be fixed by #28970 |
| } | ||
|
|
||
| Future<bq.BigqueryApi> _getBigqueryApi() async { | ||
| // TODO(dnfield): How will we do this on LUCI? |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
| if (privateKey == null || privateKey.isEmpty) { | ||
| return null; | ||
| } | ||
| final auth.ServiceAccountCredentials accountCredentials = auth.ServiceAccountCredentials( //.fromJson(credentials); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
nit: stray comment on this line?
|
What's the background here? |
|
The compact formatter makes it really hard to find what tests actually failed - particularly since Cirrus only shows us the tail of the log (which almost never contains the test that failed). I also would like to see all of our test results in a database so we could find failing tests rather than checking failing bots. This is currently turned off though, as it had a couple problems I haven't been able to fully sort through yet. |

This PR wraps all test output so that errors are printed last. It also sends all test result data to a bigquery table we can look at to get better info about what tests failed and when without needing to visit specific builder pages.
It's only implemented for Cirrus at the moment. It should be possible to implement for LUCI as well, but I'd rather tackle that separately.