configfailurepolicy=continue only works for BeforeTest when using TestNG XML file

[bj-9527]

configfailurepolicy=continue only works for BeforeTest when using TestNG XML file

Fixes #2731

Did you remember to?

• Add test case(s)
• Update CHANGES.txt
• Auto applied styling via ./gradlew autostyleApply

We encourage pull requests that:

• Add new features to TestNG (or)
• Fix bugs in TestNG

If your pull request involves fixing SonarQube issues then we would suggest that you please discuss this with the
TestNG-dev before you spend time working on it.

Note: For more information on contribution guidelines please make sure you refer our Contributing section for detailed set of steps.

[krmahadevan]

This is where I have a concern.

The documentation says this Whether TestNG should continue to execute the remaining tests in the suite or skip them if an @Before* method fails. Default behavior is skip.

But here we are trying to move forward with trying to run the next lower level configuration even when the earlier higher order one failed.

[bj-9527]

Whether TestNG should continue to execute the remaining tests in the suite or skip them if an @before* method fails. Default behavior is skip.

In my opinion, the default behavior is skip because of that the default config policy is set to FailurePolicy DEFAULT_CONFIG_FAILURE_POLICY = FailurePolicy.SKIP; , I'm not sure the description for Continue, will look up in document.

[juherr]

I think the behavior change should be configurable because there are too many changes that will be difficult to review (so, right by default).

[bj-9527]

I think the behavior change should be configurable because there are too many changes that will be difficult to review (so, right by default).

I added two test class, one for skip and anther is for continue, please help to check

[juherr]

The tests are failling and the change must not modify the current tests or the behavior by default. The new behavior may enabled by a new option.