Improve usage reporting in automated tests

[kate-osborn]

Proposed changes

Problem: Pipelines are failing intermittently due to r33 reporting errors.

Solutions:

• In the graceful recovery and reconfig tests, do not fail if there are errors in the NGINX logs. Instead, log the errors and continue. In the reconfig tests, all NGINX error logs are captured in the results file. Since the graceful recovery tests are part of the functional tests that run on every push to a PR and merge to main, it is not desirable to write the error logs to a file. Instead, if an unexpected error is seen in the NGINX logs, the test is skipped and the error is logged in the test output. Since we are sending traffic through NGINX during the graceful recovery tests, we will still catch any unrecoverable NGINX errors.
• Reporting for conformance tests is disabled.

Testing: Ran graceful recovery and reconfig tests locally and verified new behavior.

Example of NGINX error logs in reconfig results:

Example of NGINX error logs outputted by graceful recovery tests (this error was forced by commenting out an expected error message):

Checklist

Before creating a PR, run through this checklist and mark each as complete.

• I have read the CONTRIBUTING doc
• I have added tests that prove my fix is effective or that my feature works
• I have checked that all unit tests pass after adding my changes
• I have updated necessary documentation
• I have rebased my branch onto main
• I will ensure my PR is targeting the main branch and pulling from my branch from my own fork

Release notes

If this PR introduces a change that affects users and needs to be mentioned in the release notes,
please add a brief note that summarizes the change.

NONE

[kate-osborn]

Opening as draft to test in pipeline

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 89.93%. Comparing base (7d4e20c) to head (a8702ce).
Report is 1 commits behind head on main.

Additional details and impacted files

@@           Coverage Diff           @@
##             main    #2971   +/-   ##
=======================================
  Coverage   89.93%   89.93%           
=======================================
  Files         111      111           
  Lines       11423    11423           
  Branches       50       50           
=======================================
  Hits        10273    10273           
  Misses       1089     1089           
  Partials       61       61           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[kate-osborn]

I'm still waiting on the NFR workflow to complete, but this can be reviewed in the meantime.