test: Add a new Github action to track failing conformance tests

[danieljbruce]

Summary:

This PR adds a required Github action that ensures all conformance tests pass except for the conformance tests listed in the known_failures.txt file. This way we can be sure that changes won't be made in the future that cause conformance tests to fail that were passing before without us knowing.

Background:

This "conformance test PR" added a Github action that checks to see if all conformance tests are passing. This Github action fails even if one conformance test fails, but many of the conformance tests are failing at this time. So this existing Github action is useful for tracking the overall status of the conformance tests, but we need another Github action to ensure that addressing a known failure doesn't cause other conformance tests to fail.

Changes:

.github/sync-repo-settings.yaml: The new Github action called mandatory-conformance is added as a required status check in the continuous integration pipeline. This check makes it so we cannot merge PRs when a code change causes a passing conformance test to suddenly begin failing without adding that test to the known_failures.txt list. This will ensure that we do not merge PRs that introduce failing conformance tests without being explicit about introducing the test failure.

.github/workflows/mandatory-conformance.yaml: This file was created by copying conformance.yaml from this "conformance test PR" and then changing every mention of conformance to mandatory-conformance to introduce a new Github action that must pass in order for the PR to be merged.

.kokoro/mandatory-conformance.sh: This file was created by copying conformance.sh from this "conformance test PR" and then changing the line of code that runs the conformance tests to only run tests that are not in the known_failures.txt list. The line of code that prints the logs is also omitted so that it doesn't overwrite the logs produced in conformance.sh.

known_failures.txt: In this file a backslash is added to address an error and each test is now listed on a separate line so that each time a PR addresses a specific conformance test the diff will show us exactly what test has been addressed. If the test names are not on separate lines then it may be challenging to see exactly what tests have been added or removed to the known failures list. Also, this Github action revealed a list of other conformance tests that are failing that have been added to the list including:
TestReadRows_Retry_StreamReset
TestCheckAndMutateRow_Generic_Headers
TestMutateRows_Generic_DeadlineExceeded
TestReadRows_Generic_CloseClient
TestReadRows_Generic_DeadlineExceeded
TestReadRows_Retry_WithRoutingCookie
TestReadRows_Retry_WithRoutingCookie_MultipleErrorResponses
TestReadRows_Retry_WithRetryInfo
TestReadRows_Retry_WithRetryInfo_MultipleErrorResponse
TestSampleRowKeys_Generic_Headers
TestSampleRowKeys_Generic_DeadlineExceeded
TestSampleRowKeys_Retry_WithRoutingCookie

Next Steps:

In future PRs we will address one conformance test at a time shortening the known_failures.txt list with each conformance test we successful change from failing to passing.

[generated-files-bot]

Warning: This pull request is touching the following templated files:

• .kokoro/mandatory-conformance.sh - .kokoro files are templated and should be updated in synthtool

[conventional-commit-lint-gcf]

🤖 I detect that the PR title and the commit message differ and there's only one commit. To use the PR title for the commit history, you can use Github's automerge feature with squashing, or use automerge label. Good luck human!

-- conventional-commit-lint bot
https://conventionalcommits.org/

[danieljbruce]

This is the new required Github action

[danieljbruce]

Changes:

1. Backslash after TestMutateRow_Generic_DeadlineExceeded
2. All test names on their own line
3. Lots of tests added to the file that are actually failing