Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

"Missed" tests are not reported correctly #51

Open
mricaud opened this issue Apr 29, 2020 · 2 comments
Open

"Missed" tests are not reported correctly #51

mricaud opened this issue Apr 29, 2020 · 2 comments
Assignees
Labels
Milestone

Comments

@mricaud
Copy link
Contributor

mricaud commented Apr 29, 2020

Here are 2 "missed" tests (originaly from issue #13):

1) Run-time error

The reports index (target/xspec-report/index.html) is not correct:
image

2) Compilation error

The missing test doesn't appear in the reports index:
image
It used to be there in version 1.5.1
Note that the folder target\xspec-reports\identity-2_test.xspec is created but is almost empty.

@cmarchand
Copy link
Collaborator

Not sure if this can be solved.

@cmarchand cmarchand self-assigned this Apr 29, 2020
@cmarchand cmarchand added the bug label Apr 29, 2020
@cmarchand cmarchand added this to the 2.1.0 milestone Apr 29, 2020
@Glodenox
Copy link
Contributor

Glodenox commented May 5, 2020

The same seems to happen if you have an XSLT that throws an error via fn:error() or <xs:template terminate="yes"> when that scenario doesn't have catch="yes" set. It also prevents the next tests in that file from taking place, which isn't ideal, but less of an issue in my eyes.

Also because of this, the surefire results don't indicate any issues in builds. People who have set the property testFailureIgnore to true, because they have their build server analyze the Surefire results after the build to check whether it became unstable, might not notice this or push problematic artifacts to the server.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants