No FFV1 implementation checks count in XML

[kieranjol]

I'm on Ubunutu 16.04 with the daily snapshot of mediaconch and libmediainfo.
I only just noticed that while several Matroska implementation checks run in the GUI and CLI, no FFV1 checks run:

<implementationChecks checks_run="0" fail_count="0" pass_count="0">
      <name>MediaConch FFV1 Implementation Checker</name>

Here's an example file where this happens: https://drive.google.com/file/d/0ByvCvU9YVB09WTNSQ2ZEdXk2YXM/view?usp=sharing

I'm assuming that something is wrong with my command/environment?

[kieranjol]

And the full report, just in case:
https://gist.github.com/kieranjol/9a5d18b0c38b501fe1d85811aab27371

[dericed]

hmmm, can you retry with --force

[kieranjol]

I used `--force` in my initial command line , I should have posted it: mediaconch --force -fx testplz.mkv

[kieranjol]

I replicated on Windows 10 with today's snapshot.

I think this could also be related, though it might be a seperate issue:
mediaconch -mi filename
returns nothing.I installed the latest libmediainfo as well on Win10 and Ubuntu,

[JeromeMartinez]

We use a different method for checking FFV1 bitstream because the one we use for MKV is too slow with so much data as it is in FFV1 (thousands of frames and we need to parse the whole frame content).
As a result, the XML sees only fails for the moment.

We definitely need to change the output, showing also the count of succeeded tests instead of "0".

[kieranjol]

Hi Jerome, that would be ideal. My usage of Mediaconch involves looking at those summary judgements using an XML parser and determining if the validation=PASS/FAIL. It's good to know that fail_count=0 means that analysis was carried out, but it would be ideal to know that n checks were carried out and all passed, even if each one isn't documented in XML elements.

[JeromeMartinez]

ok. we need to do:

• @dericed, we need to agree about where you find this value in the trace, then adapt the XSL for peeking this value
• we also need to be sure about the meaning of this value: for Matroska tests, it is easy, there is only 1 Matroska part, but for FFV1 we have several frames. Maybe we need 2 numbers: the count of frames parsed (e.g. "90000" for a 1-hour PAL file) + the total count of tests (e.g. "1800000" for a 1-hour PAL file and 20 tests per frame). Comments?