Improving the test results copy functionality

[howard-e]

Currently, the app supports copying results for reports when updating a TestPlanVersion's phase under the following conditions:

• When the earlier TestPlanReports' data to be used is a part of a DRAFT TestPlanVersion
  • Note that if a report is marked as final while in DRAFT, when the newer report is included and copies over the results, it also copies the marked final status and isn't unmarked in the Test Queue to make it clear that those results have been copied over.
• Assertion text for a command for a test has not changed.

The above creates the following problems when:

• A TestPlanVersion is in an advanced phase (CANDIDATE or RECOMMENDED) and it has results which could be copied over into a new version, to make subsequent test collection and review cycles easier
• When assertion text has changed in the instance of just a typo being fixed and now several tests using that assertion has to be completely copied over again.
• When commands have been added, removed or edited and now several unrelated results for other commands in that test have to be completely copied over again

The suggestions as noted through recent CG discussions and functional reviews is that the following needs to happen to support a better results copying process between TestPlanVersions and their TestPlanReports:

• During the tests comparison process between versions, relax constraints to allow situations such as typos to be considered "the same" (Support copying of results' assertions even when there is a changed assertion #956)
• Need to account for when commands have been added, removed or edited for a test (Support results being copied even when commands have been added or removed between versions #967)
• Unmark test plan reports as final once the results have been copied into a new TestPlanVersion's TestPlanReports to make it clearer that the results have been successfully copied. Test administrators will be able to make changes and mark as final again, if appropriate (Unmarks newly copied test plan reports as final during results copy process #974)
• Functionality to support copying results when a TestPlanVersion is in an advanced phase (Copy results from advanced phase #976)
• Need to be able to pull older results when also adding an individual Test Plan Report to the Test Queue instead instead of just providing that functionality during the advance process from the Data Management page (Copy results when adding to Test Queue #978)

Note

• Deprecated test plans remain in test queue and in-progress results are lost when a newer test plan version deprecates an older test plan version #877 describes additional detailed requirements of this process that are currently in place, and should be maintained.

[howard-e]

During the tests comparison process between versions, relax constraints to allow situations such as typos to be considered "the same".

Resolved by #956

[howard-e]

From CG discussion on Mar 13:

• Need to account for when commands have been added or removed from a test
• Need to be able to pull older results when also adding an individual Test Plan Report to the Test Queue instead instead of just providing that functionality during the advance process from the Data Management page